What thin metals in sheets can I solder?

There is even food safe brazing rod, 5% silver 95% tin. You want tight-fit parts with that.

Start looking at the packaging of store items too. Some things come in metal tins and sometimes they sell just the tins which get marked down after the holiday. I got lots of "parts boxes" at 75% off over the years.