Luna Bazaar has been my go to website for lanterns and candle holders for years. Known for their wallet friendly wedding and party supplies they are a one stop shop for candle holders, vases, lanterns, parasols, luminaries, etc. Here are a few of my favorites...

The accordion Chinese lanterns are only $1.75 each. I have mine lining the roof over my porch. They also look great hung in a tree.

The rice paper votives are only $3.50 each and they come in a variety of colors and patterns. Loving the ikat votive!

How beautiful would this white paper bag luminary be lining the path to your next party?! A pack of 4 is just $3.95. They even sell flameless LED tea light candles to go inside for $1.95.