Do I need to buy or already have an IoT Starter kit to be able to use the IoT data plans?

No, if you have an approved device for use on the AT&T network then you can use that to connect your SIMs to the network.