Do I need a different/extra plan to have an iPhone?

I'm trying to pick one up tonight of the craigslist. Can I just pop in my sim and good to go?

Or do I need to have ATT set it up or somethign?