Not sure what your body fat percentage is, but I'm 6' and didn't lose my love handles entirely until I hit 185. Now it's different, though. I've got much more muscle mass on me and I'm about 190 without any sort of fat around my hips.
Past:'08 E92 335i|ZPP|ZSP|6AT|four (4) HPFPs
Present:'15 Mustang GT|401A|PP|6MT|Recaros
Sig pic unrelated. I like to go sideways and stuff.