If it really bothers you, I'd recommend a paint correction. I got one on my Jet Black car and results were amazing.
Swirls are just minor scratches in the paint as others have said. Likely due to harsh car washing from the previous owner who didn't know any better.
After that, start being more careful with the paint such as avoiding automated car washes.