OK, new LED in, looks all dandy now. 
Unfortunately I could not get a nice high brightness white LED, as that should look even better.
All in all, given I could not find a single link on the interweb to explain how to do the replacement, I must say I am impressed with myself :
Edit: I wonder how well an UV LED would work. I have some that are 410nm range, which I understand should be ok to look at indirectly. :-/