Eye-based Navigation Research From IBM 64
leviramsey writes: "The Jakarta Post (through Lexis-Nexis) has an article on MAGIC, an eye-tracking component of BlueEyes, a project to add greater sensory abilities to computers IBM's Almaden Research Center. Oddly enough IBM's site has very little on MAGIC under that name, though a reference is made to PupilFinder which seems to be the technology underlying MAGIC. The article speculates about possible applications, including in cars (gulp!) and goes into detail on other components of the project, several of which are very interesting."
Noooooooo! (Score:1)
No! Use touch screens!
"Gorilla Arm" is waaay better than "Web eye"
(or will users of this technology gain a
reputation of being "shifty eyed" ?)
Eyes and the brain's perception system do some
funny things. Try playing Textmode Quake for,
say, half an hour...even just walking around a
level -- then stop and try reading something.
It's so trippy, I swear...your brain is trying
to translate the text into some kind of 3d image
for several minutes afterward.
It's a conspiracy! (Score:1)
1) Get everyone using 'harmless' eye tracking systems.
2) Replace the 'click here to subscribe to our $599.95/month service' links with 'blinkable' images.
3) Watch the cash roll in!
Be afraid.. be very afraid..
Re:Shades of 1984 (Score:1)
Who are the people who get in trouble with cameras? Ordinary Joe? Why would we care? The people who get in trouble with cameras are politicians and police. Would the people who beat up Rodney King have been convicted without a citizen's video tape evidence?
Re:Fantastic User Interface (Score:1)
And yes, this is great technology, but with quite a few limitations, which aren't all obvious. First and foremost is the problem that eye movements aren't 100% conciously controlled. Your eyes allways jitter slightly, and you have a tendency to track events outside the sceen with your eyes. The canonic illustration we use in discussions is, that you certaintly don't want the program to print your text, just because a bird flying close by your windows startled you, and made you look.
Second is the whole problem of when you "click". Dwell-time is quite popular, but has the drawback of not making you feel in controll, and leaving you all too often without a "safe harbour" on the screen. Using a "long blink" for clicking is a better option, but leaves you with another problem - distinguishing a shadow falling on the camera from a closed eye. Thus we often fall back on using a secondary device for clicking and doubleclicking.
Last is the whole issue of precision. Eye tracking today is rather unprecise, even under optimal conditions and with expensive "best of breed" equipment. As a rule of thumb, you shouldn't expect to be able to activate a button smaller than one square inch with any kind of precision, especially using dwell time for clicking.
So there you have it. Eye tracking certaintly is a usefull tool, but - for now - is rather far from the ultimate goal of direct mind interface to the computer. Actually it's a problem that eye controll sounds so fantastic, as it jacks the level of expectation from the users far too high for the state of the art. Right now you need specialized programs, and a lot of design effort to make the experience a good one - even under optimal conditions.
Just my 2 cents.
Re:Very cool possibilities for the disabled (Score:1)
Re:Quake :Eye targetting (Score:1)
--
Look at the babe! (Score:1)
There's an accident on the side of the road, and all the people slowing down to look at it would cause lots of other accidents....
You go crusing by the beach and cause a fender bender cause you can't keep your eyes off the hot chick in the bikini!
Just my concerns...
Jeremy
Glutious
It can replace the mouse (Score:1)
Cool: who is interested in me...? (Score:1)
I think this camera system is a killer thing, with breakthrough applications!
Re:Very cool possibilities for the disabled (Score:1)
The entire goal of their work was to provide ways for quadrapalegic (spelling?) patients to control a mouse and interact, particularly for those whose speech was damaged beyond speech recognition technology capability. I can only imagine how much better it works now with the additional computing cycles of modern processors.
Re:Quake :Eye targetting (Score:1)
Just what I need!
-Andy
Re:Shades of 1984 (Score:1)
But my perception of a 'Police State' is one of enforced curfews, Big Brother style red tape, etc. The UK is definitely not that bad.......yet
----------------------------
Re:Fantastic User Interface (Score:1)
In the case of a disabled person, perhaps one should try to take advantage of as many abilities as are remaining, and combine them to substitute for the missing ability. Thus, eye and tongue movements could substitute for a point and click device. I think there are certain things that eyes do very naturally, such pointing at interesting things. A "natural" person usually looks at what he finds interesting, and then "acts" on the things by using some other muscle. It is not natural to have a time-triggered click, because people normally look at a thing while deciding whether to do something with it. Maybe there is a breathing pattern that is naturally associated with performing an action on an object. I think it might be useful to observe everyday activity to see what gestures correspond to abstract concepts like "examine", "activate" etc. And then, one has to find which of those gestures are available to disabled people. The goal, I think, is to make them feel as though they weren't disabled, but rather were acting naturally.
By mimicking natural activity with some analogous user interface, I think the experience would be very comfortable and efficient.
Fantastic User Interface (Score:1)
I can also imagine how this could be amazingly useful for creative work. The simple version would be a paint program where you push buttons in order to control and spray colours at the place you're looking at. A cooler version would combine the visual mouse with keyboard commands in order to build 3-d worlds: you can look at the place where you want to build a structure, and press the appropriate keys. This would open up an amazing area for UI design.
Anyone know of good places to do this research? I'm looking to do a grad degree, and I think this might be an interestig project.
Re:sweeeeet (Score:1)
Re:Forget Amazon's one-click shopping (Score:1)
"One-blink-shopping" (TM, R, Patent pending)
"You blink it, you buy it!" (TM, R, Patent pending)
"Eye for an aye"(TM, R, Patent pending)
I hope there's a safety precaution for this one: (Score:1)
*swerve*
aaaaaaaaaaah!!!
*CRASH*
========================
63,000 bugs in the code, 63,000 bugs,
ya get 1 whacked with a service pack,
Re:consider this (Score:1)
Re:hmm (Score:1)
My mom is not a Karma whore!
Eyetrack (Score:1)
An alternative might be in using the head movement for the second step of the positioning. This two-step mechanism could be activated by a additional key (e.g. those ones on laptops beneath the space bar). Look here [agrl.ethz.ch] for further information about this idea.
Re:ERICA (Score:1)
Didn't Mcrosoft already do this? (Score:1)
A potential use for eyeball tracking (Score:1)
Re:Volvo are into this (Score:1)
Consider if it was used in conjunction with collision warning radar. The warning wouldn't have to be as obnoxious if the car knew you were looking directly at the object in question. This would definitely cut down on the number of cry-wolf situations.
Also, what about a rear view mirror that tracked a little. The mirror could adjust for blind spots just by looking near the edge of the mirror.
What about the extreme case of hooking it in with the airbag system. This way the car would be able to detect if you saw what was hitting you or not. If you were completely surprised by the collision the air bags could take into account that fact that your body would be a little more relaxed and deploy appropriately.
And finaly, what about something that made the dashboard more readable. When you look at the speed the numbers are displayed a little larger and brighter. Kinda like the Mac OS X menu bar.
Re:Very cool possibilities for the disabled (Score:1)
Although this may help a few of the disabled, quite a few people do not have the fine motor control over the motion of their head. I think this technology will be nice for some, and that is good, but there are still people out of reach.
There are a lot of people who do not have eyes to be able to make use of this technology. This is similar to the proposals of having retina scanners for ATM access.
It's a nice idea, and I think that the eye-scanning technology is cool, but I still think that the ultimate solution will be the brain/machine interface. Although waaaaay off in the future, it would truly allow all people access to computers and the future.
As an aside - coupling this with the enforced ads replacing pop-ups on webpages, marketers could truly tell whether or not people were really looking at their ads.
porn! (Score:1)
This would be great for dynamic porn sites that automatically adapt to viewer preferences.
The Eye is a BAD interface (Score:1)
It's evident that using your eyes is not the best way to scroll or zoom or aim at quake. Think about how much you move your eyes in front of the screen for a second. You would get very jerky movements on screen if the computer tried to adapt to your eyes all the time OR you would get delays before every action, if the computer tried to filter out rapid movements.
Think about quake for example. In quake you want to look at the center of the screen at all times. You don't want to be looking at the _sides_ of your screen every time you need to turn around. What if you need to turn around real fast? Should you look away from the screen altogehter then? Brilliant.
And what about scrolling. How many times in a day do you look at the bottom of the screen without wanting it to start scrolling? And if it did, would you ever have time to read the last sentence? The interface would be annoying as hell!
These techniques are clearly better suited for wireless devices and other apps. And perhaps most of all for voice-recognition, because about 30% of our interpretation of what people say comes from subconscious lip-reading. Try listening to a conversation in another room without looking at the speakers, and then try again with eye-contact. Even if you are not looking directly at the speakers lips while making eye-contact, you will get a much clearer perception of what they are saying. Because you are lip-reading and decoding facial expressions to interpret words and meaning.
To sum it up: The voice and the eyes are extremely overrated as controlling devices. Perhaps the biggest reason for this is you need both these 'devices' for other things, they are much too important to you to be used exclusively on your computer. You need to be able to look around freely without thinking about how your computer will react, and you need to be able to speak freely. By comparison, your hands are crude unsophisticated tools that aren't needed at all times.
NOOOOOOOOOO!!!! (Score:1)
Re:Shades of 1984 (Score:1)
While I was in college I studied with Daniel Dennet, an amazing philosopher who has done a bunch of work at MIT helping them with such projects as the ambitious Cog project [mit.edu]. One of the more amazing tidbits he passed on to us (the most amazing was the genetically evolving virtual gladiator robots who after a few thousand itterations really learned how to pummel eachother's brain's out) was a prototype of an eye tracking system being developed for security personel: the idea is that you can display only what is one the screen and nothing else so onlookers can't see the information. The principle this relies on is where the daner lies: people looking at the screen and having their eyes tracked thing the scrren is completely full, they don't know that only a small fraction of the information they think they see as a contiguous whole is being displayed at any one time.
Furthermore, if they are looking at a picture, the picture can change and they will not realize it has changed...their minds will actually "rewrite history" and they will be convince that that picture of the mona-lisa they are looking at was always frowning.
using this technology we will get some of the scariest adverisements we have every seen (where that babe changes imperceptible to fit where you're looking, so, somehow, she's always perfect and exactly what you want), and I don't want to think about what the more brilliant and savvy admen/psychologists/brainwashers of the future are going to think up.
But hey, as long as I'm not going to be able to tell, I guess I'll just sit back and enjoy.
Quake :Eye targetting (Score:1)
logical conclusion (Score:1)
My .02,
Get paid for watching banner ads (Score:1)
Not so new as it looks (Score:1)
With this disabled not able to type on a keyboard, were able to type letters and use a computer. It still works nowadays though it is much more refined.
Now it comes to the big market, we'll see where it leads to in several years...
Re:Existing technology. (Score:1)
I use eye-control in EOS 50E since 1997, although it is a bit rough as the camera can only choose between 3 fixed focusing points.
AFAIR, the latest EOS 30 has 12 focusing points that can be choosen either manually or using eye-control feature.
The problem with eye-control is that you should get used to it. Just like you would get used to dictation software. It is not just a matter of tweaking and training the system but also training yourself.
Yipes... (Score:1)
Why? Because computers don't come with 100% uptime guarantee's. Sure, that thing will work great for a certain amount of time, but like a home or office computer, it's going to go weird on you and or crash. And if I am assuming correctly, if this MAGIC computer system is used in automobiles to aid a driver in steering or moving that vehicle, then I am selling my car and getting a bike.. California freeways are already crazy enough.
Re:if you replace the mouse (Score:1)
Re:Shades of 1984 (Score:1)
Stores are already doing this. I work for a large retailer that I can't name cause I dont want to get fired. But our marketing department frequently uses security tapes to see who is buying what with what. Like peple who buy brown shorts like blue shirts and stuff. Its really no big deal.
if you replace the mouse (Score:1)
But then again, how to perform accurate drag-n-drop?
the shakes (Score:1)
Military Benifits (Score:1)
Re:Volvo are into this (Score:2)
Re:Shades of 1984 (Score:2)
hmmm (Score:2)
-------
hehe (Score:2)
Re:sweeeeet (Score:2)
Oh my god, no matter where you look... Clippy pops up!
- Muggins the Mad
Re:Knows what you want before you do. (Score:2)
The subject sat looking at a screen with a slide projected on it. They were given a button which advanced the slide, and told to press it when they felt like it - when they were bored by the image they were currently looking at. A set of electrodes measured various brain waves - there was an obvious signal before the button was pressed that was decribed as the onset potential: it was assumed to be related to the decision to change the slide.
The interesting thing happened when instead of using the subject's button-press to advance the slide, the experimenters secretly started using the onset-potential (plus a time delay) as the trigger instead.
When this happened, subjects reported that the slide moved on before they'd decided to press the button, and that the projecter seemed to know what they were about to do....
Freaky, and similar to your menu story. I collect this kind of thing, I would love a reference if you have one...
Re:Volvo are into this (Score:2)
IANAPE (i am not a pupil expert), but i think our buddies in law enforcement and our kind neighbors in the insurance companies would be interested if that level of detail were practical.
cars? let's get past the driver (Score:2)
they were able to make vehicle sims behave more or less like a flock of birds -- weaving this way or that, without coming into contact.
there was also some mention of tiny low power solar powered chips that you could simply toss along the roads and program with positional data.
than any car traveling the road knows just where it is located.
driving can be very monotonous/dangerous...especially long trips. i hope someone can move technology fwd enough that (as a start) vehicles would at least come to a controlled stop if the driver were incapacitated.
Your title contains the solution (Score:2)
"Shades." Wear sunglasses. A little problematic in dim environments, but I'm willing to risk fracturing a shinbone to stick it to Big Brother.
Two cents (Score:2)
I think its a nice idea but can see some downfalls in the ways of PUPILS being used as any kind of identification which should also be noted for those interested in Biometric security as well.
What will happen when say a person slightly blind using their products, has his pupils deteriorate are there any thoughts on the sensors and their reactions to this?
As for their emotion mouse I doubt it will give an accurate view of someone's psychological profile as there are heavy handed people, light handed people, etc. Will they have a certain buffer for values such as this or will they market it as a stand alone solution for determining this which is 'f(oo)ullproof'. What about persons with an abnormal perspiration problem will it flag them as a nervous wreck and more importantly will it clean itself after they've used that mouse (hey, I'm not sharing my mouse with a sweaty mo' fo now)
Seriously though many factors will make some of these things hard and though some may seem like a great idea I think many are jumping the gun into some sort of a Star Trekkie based environment filled with overhyped products.
Antioffline -- Putting the Hero in Heroin [antioffline.com]
Existing technology. (Score:2)
And here's something to think about. Every single photographer I know about switches this feature off after first five minutes of use.
--
I predict an upswing in the sales of mirror shades (Score:2)
Given biological variability, effects of some drugs on pupillary reactions (there are drugs that slow pupil contractions, but do not affect concentration or reaction times), different corneal shapes, etc. this sort of technology will have a stack of false positives and negatives plenty high. Is someone going to be arrested for DWI because they take high blood pressure medicine?
Even the effects of race will have to be taken into account. I can tell you that most "face parts isolator" software will not recognise most oriental's eyes.
As far as marketing goes, Yeah, I looked at it. What was my total reaction, though? Did I look at it because I liked it, or because cognitive dissonance told me that it didn't belong here, or because the packaging was so ugly I hated it? All the marketer gets is an eye time. Hope they have ESP to figure out what I was thinking during that period.
On the whole, though, I think you can pass me that pair of mirrored Serengettis.
The "Pupil Pistol" from Robotech--looks can kill! (Score:2)
The apps I thought of following watching that were similar to some mentioned here, including hands-free computing (I had never used a mouse, though, so I was thinking of a CLI based on a gaze selected alphabet. Arg.
Ah, speculation...
--
What if... (Score:2)
What would happen if the whole family sits down to watch TV with papa wanting football and mama a popular soap and junior cartoon?
ERICA (Score:2)
. It was developed at the University of Virginia, and I know that both Stephen Hawking and Christopher Reeve use it. It can track your eye movements, move the cursor on the screen, and detect when you want to click on something. I remember helping to test it a few years ago by sitting at a computer with the system installed and looking at a series of pictures. Some were nice things like kittens (aww, how cute, eye relaxes) and some were really graphic porn (yikes! eye contracts).
Re:Shades of 1984 (Score:3)
In fact, since the current government have come into power, the level of policing in the UK has diminished to the same sort of levels recorded back in the 1970's.
I for one (living in south east London) would feel a lot safer if there were more police cameras.
----------------------------
Very cool possibilities for the disabled (Score:3)
Knows what you want before you do. (Score:4)
It turned out that people tended to look up and down on a menu to choose an option, and their gaze would fall on the option that they'd eventually select long before the decision to select it was complete. This had the unnerving effect that users felt that the machine knew what they wanted before they did.
--
sweeeeet (Score:4)
With eye tracking, software can notice that the user is looking all over the screen, probably trying to find the right menu item or command. This is a signal to pop up help or (on Windows machines) advertise instruction manuals for sale at Amazon. If you know what you're doing, turn that feature off. If you don't, your software is a lot friendlier with it on.
Maybe no more scrolling? Your computer tracks how quickly you read and moves the text by at that rate. This would be a boon for people with weak hands for whatever reason.
And, of course, aiming in Quake will never be the same after the "eyes of death" patch.
Anyway, cool tech.
My mom is not a Karma whore!
Volvo are into this (Score:4)
One of these technologies is eye-tracking. A small sensor would be mounted in the ceiling above the driver's seat and track the movement of the head and in particular the pupils of the eyes. The details are sketchy, particularly withr regard to how this information would be used and as to what happens when the person is wearing glasses or corrective lenses.
I suppose in principle you could detect drowsiness, lack of concentration, etc. and that information may be useful to the driver there and then. The only problem is, if it's all going to a blackbox, insurance companies are going to want the information to work out as to how often you checked your mirrors, whether you constantly look at your passenger as you are talking to them, etc. and I'm not sure what the safety advantage is in doing this.
Watch out! (Score:4)
If they fit a M$ box with this, you can't even look at it anymore without crashing it...
Mmmm. So how is this new?Applications for this tech... (Score:4)
Then again, maybe I'm lazy beyond belief.
-r0bb
VR applcation (Score:4)
During my research we used similar eye-tracking device to help changing the view point of an observer in a VR environment. Our subject of testing all induced nausea and vomitting
We failed to get more healthy subject to continue our research, we couldn't solve the problem in stablizing fast eye movement for use in control device. I am really interested in knowing what technology has they deployed to make it useful.
Shades of 1984 (Score:5)
This kind of technology worries me. I mean, it's bad enough that places like England have been turned into virtual police states through the installation of vast numbers of CCTV cameras throughout urban areas, but what if these cameras could not only track where you go and what you do, but everything you even look at?!
Sure, this technology is far too primitive to deal with that kind of surveillance at the moment, but once the initial proof of concept is there, then advances come quickly, and in a few years time a camera may be able to track your eye movements from a hundred yards away.
This really sounds like a horrible application to me, but you can just bed that law enforcement agencies and intelligence agencies around the world would love to be able to install these devices in as many places as possible. And can you imagine what advertisers and market research people would pay for this data? Your every action could be profiled and filed for use in targetted marketing schemes based on what you look at in stores.
I'm not saying it'll happen, but it's still a damn scary idea.