Magnetic core memory is fast, they had 600ns in the 1970's and could probably have gotten that even lower given time. It's non-volatile.
Larger cores require more current.
Another method you may consider