I owned a E46 M3 for almost seven years and absolutely loved the car
. The rasp of the inline 6 is intoxicating
.
I'd say go for it.
I would definitely recommend the 6MT over the SMG though. The SMG is not very refined and can be pretty harsh in DD use.