I hear ya OP. I have always been the laziest car guy amongst car nuts that I know when it comes to washing it frequently and keeping it shiny.
It's not like I abuse my car and run them through mud, salted roads without care. I just wash it when I get around to it after it has gotten dirty for a while (could be up to 3 weeks after getting dirty).
Like most have said, I also enjoy driving it as the key reason of owning this car. Of course, it gives me extra joy when I am driving around in it clean and shiny!!!