Can I Bypass a proprietary DC Adapter Tip?

One other question. I do have a PSP power adapter and the tip fits in the CD player. However the PSP adapter says it outputs 5v. Is the difference between 4.5v and 5v enough to do serious damage to the player if I plug the PSP adapter in briefly to see if it will at least power on?

Thanks for the help thus far