I met a guy in 1998 who had done his Ph.D building full color direct to retina projection. He was doing VR with it back then. That's how long this technology has been in development.

He did it at MIT and if I understood correctly, the US military bought everything (he had no say in the matter).