If you likewise believe it is OK to have second hand items... then check out local second hand, "Opportunity" shops, garage sales and things like that.  It is amazing what you can find.  I've picked up an antique "glue pot" which looks exactly like a mini cauldron - for only $5 at an antique store.  I've also got a brass pot plant holder that I use as my main Cauldron (because it is big enough to have a fire in - it's up on little legs and has dragons etched into it).  I have chalices and Censors I have picked up  second hand too.  You could maybe find old brooms suitable for a Besom... numerous things to use as a censor.... goblets... cushions.. let your imagination go.

I have a whole heap of spice racks I bought to put my herbs into....

I don't want to gove a whole list of shops you can buy stuff from, in case some of them are bad to deal with... but search google for "ritual tools" or whatever you want, and you are bound to find some links.  Maybe I will add some later..

Somebody did show me an "ebay" type site for pagan stuff, which I think sounds interesting.  http://www.auctionwitch.com/