Wise, Neoware and HP make some ThinClients which either already run Linux or can run Linux
A Neoware with a 300MHz CPU and at least 128MB of RAM should work
They sell for about $30 each, maybe less
It shouldn't be too expensive to retrofit one to boot from a Live CD or a small 2.5" HDD 