The hand gestures are awkward, I think, and I hope ends up being one of those guesses we got horribly wrong. The idea of gestures is partly the result of thinking about information in terms of objects that need to be "handled" in some way or other; gestures are a way of making data objects tactile, in at least some sense.
But I think this is a gross underestimation of the symbolic capability of the human brain. When I type at the keyboard, for instance, I am engaging with an interface that is very abstractly related to the content I am dealing with, and yet I can manipulate that interface with a high degree of dexterity, speed, and control. Language generally works by manipulating meaningful symbolic representations with incredibly fine-grained control. We can do it with our fingers, we can do it with the muscles in our throat, and we can do it with tiny squiggles of pixels transmitting light into our retina. We should be looking for ways of taking advantage of new symbolic structures, instead of making us paw at media like a bear at honey. Seriously, anyone knows anything about ASL or other signing systems should be embarrassed at the complete lack of sophistication in our gesture interfaces. It's like we are proud of our illiteracy.
These are interface problems, and hopefully neural interfaces, including retinal tracking, have a bigger impact on our interfacing with screens in the future.
h/t , left the comment in his thread:
Peter G McDermott originally shared this post:
The Evolution of Screen Technology
If you look at most of the sci-fi movies from the 70's and 80's, they featured CRT's still as the technology of the future. With the advent of Plasma and LCD (now OLED), we are starting to see that screens no longer need the "deep" real estate they did before. But how fast are they evolving?
If you were to count how many color LCD screens (or plasma/oled for that matter) in your house, how many would you have? Right now, just in the room I'm sitting in, I have six. So how many can we expect to have in the future? Will all of our refrigerators come with embedded tablets in the door? Will our windows show us the weather and our calendars? Will we check our e-mail in the mirror while we brush our teeth?