Does Anyone Else Have This Problem?

I am a huge silver and gold fan. I am also well aware of the constantly deteriorating value of the U.S. dollar. I am finally aware of the fact that paper money is (when you pull the blinders off) just that - a piece of paper I.O.U.
OK, then why do I have this compulsion to pull the old style bills from circulation when I find them? Anyone else do this? I now have a stash of some old style bills - all circulated, no star notes, ranging in series dates from 1969 -1991. Mostly 10's occasional 20 and 5's. ebay shows they are not worth a premium (and yes I have checked all the series and signatures - nothing of note.)
It seems I am wasting my time because as money, they are losing value due to inflation. As collectibles - well they just aren't collectible. And yet they are different. I should just use them to buy silver.
Shouldn't I?
OK, then why do I have this compulsion to pull the old style bills from circulation when I find them? Anyone else do this? I now have a stash of some old style bills - all circulated, no star notes, ranging in series dates from 1969 -1991. Mostly 10's occasional 20 and 5's. ebay shows they are not worth a premium (and yes I have checked all the series and signatures - nothing of note.)
It seems I am wasting my time because as money, they are losing value due to inflation. As collectibles - well they just aren't collectible. And yet they are different. I should just use them to buy silver.
Shouldn't I?