friiks:
Would it be possible to install multiple sensors stacked above each other to determine the size of the coin, so it could fall through instead of rolling?
Yes, that should work. When the lowest photodiode/phototransistor first has the light to it blocked, read the sensors above it to see how many of them are blocked too.