Skipping to the end – the answer is I don’t know – but I think it’s worth considering!
I’ve recently been considering if point and click ‘desktop’ / ‘window’ interfaces stifle innovation because they seem to be all encompassing and universal on all modern operating systems. Even though we have some desktop variations the metaphor still seems to be pervasive for most everyday tasks. It may be that this is not a problem, just as we use a desk for most writing tasks and a pen and paper and a filing system – these are part of everyday life and are no longer questioned – these tools are familiar and comfortable and so are now just ‘invisible’ to us. However, what if our reliance on the desktop is misplaced – what happens if there are better ways of interacting with applications and their data. We can see that systems exist – like zigzag – but these is pretty complex and difficult to use and implement, showing no traction outside research.
I’m, not sure if a move back to text based systems or at least a complimentary system would not be a good thing. Point and click has a tendency to make developers in some way sloppy. As interfaces are visual and point and click is all that is required interfaces have become ever complex without much complexity being hidden behind a more simplistic GUI.
Things are not all bad – indeed the Web maybe where most of the novel interface work may be occurring. As an example take the Facebook status update which allow the user to type the
@ symbol before a friends name is typed, which brings up a selection list. This means the user is not required to stop typing, select a listbox – scroll up and down what could be a hundred choices – and then select a friend – but just select using the cursor keys from a much shortened list. Indeed this reminds me in some ways of the Canon Cat ‘leap’ keys:
You moved through your data using two extra keys called Leap keys located in front of the spacebar key and by typing strings of characters. The Cat jumped to the next occurrence of that string. Raskin claimed that the Cat’s Leap-key search method to scroll from the top to the bottom of the page took 2 seconds, a mouse took 4 seconds, and cursor took 8 seconds. Larger documents increased these search ratios.
The Leap keys also controlled text selection (indicated by hilighting), deletion, copying, and moving. If the selected text was a mathematical formula one keystroke with a special key calculated the mathematical result and the answer appeared on the screen with a dotted underline overlaying the original formula. If the selected text was a computer program written in either FORTH or 68000 assembly language, then a special key let you execute the program (I don’t think many Cat users did any Cat programming). You performed mail merges by selecting columnar text data and pressing another special key. Repetitive command sequences could be automated by assigning commands and text strings to the Cat’s numeric keys. One special key let you dial a selected telephone number either for voice or modem communications. Data received from the built-in modem flowed into your text as if you had typed it.
I’m not sure if there really is an answer here, or if we should just consider hybrid solutions, but for me typing using symbols to enable special faster interactions seems logical, the less I take my keys and attention from the keyboard, the faster my interactions seem to be; especially when I am cognitively focused on a single task.