This is from Ricky Gervais' interview with Richard Dawkins. It PERFECTLY describes how I feel:

"I hate being labeled an Atheist because it's not how I live my life. I don't live my life going around going "I'm an Atheist, I'm an Atheist..." There's billions of other aspects to my life, why I do things. It's just when God's put into the equation, I don't take that on board. I don't do anything because a god's watching me, or because I feel God owns anything, or God's driving me. It's a strange word, and it's a strange label."

Giving it a label just seems to give religious people the license to call it a "belief system". as backwards as that is. I only use the term because it's the only way most people go "Oooooh, she's serious then". Unfortunately simply saying "I'm not religious" doesn't seem to get the point across adequately... [/end rant]