Revolutionary: Wave of the Future

Going into the next generation, buying a remote pointer-less console may seem ... well, pointless. There are a lot of change-resistant "hard core" gamers out there pouting over the inevitable evolution of their controllers, but there's just no denying it anymore. Motion-sensing controllers are the wave of the future.
A few weekends ago I was setting up my new TV, connecting all my consoles, set top boxes, and my PC to it, moving from remote to remote and then to mouse and keyboard, when it dawned on me that Nintendo really hit the nail on the head with the Wii Remote. In the home theaters of the future, it's going to seem downright awkward to interact with your display by sliding a mouse across a surface, when it feels so much more natural and intuitive to instead point a remote at the screen. And awkward is just how I felt in that instance.
I've occasionally used my Wii Remote with GlovePIE to move the mouse cursor on my computer, but before the Wii debuted, the idea of moving a remote through the air to control your PC seemed almost silly. But Gyration was marketing an air mouse that did just that. Unfortunately, using just a gyroscope and accelerometer to track motion meant that there was no relative position data available. You had to click the trigger button to tell the mouse pointer to move.
Nintendo may have taken inspiration from Gyration, because as early as 2001, the two companies were working together to design a new gaming interface. Although our Wiimotes would ultimately be based on different sensor technologies, some of the money Nintendo invested in R&D with Gyration may have paid off in the development of the form factor and break-apart design. It looks like after a few more years of research, Gyration's rigid "side car" add-on concept had evolved into the far more flexible Nunchuk.
In 2007, Logitech, maker of numerous gaming, media, and productivity peripherals introduced the MX Air, which improves upon the gyroscopic air mouse by using a MEMS gyroscope similar to the one inside the MotionPlus, but with one axis less. To address the issue of having no reference point to move against, the MX Air has a button to recenter your movement. I've used this trick for a few GlovePIE scripts, and I have to say, using the Sensor Bar as a reference point beats the pants off it.
The Darwin by Motus Games, has frequently been rumored as Microsoft's answer to the Wiimote, despite Microsoft having never confirmed any association with Motus or development of a motion controller. Just one look and it's easy to see how those rumors spread, as the Darwin apparently shops at the same clothier as the Xbox 360. The supposed codename for Microsoft's motion controller is "Newton," presumably in reference to Sir Isaac Newton, whose Three Laws of Motion were the basis of scientific and technological advancement for centuries. And from the name association, we could also infer that such a device, imaginary as it may or may not be, would detect gravitational and/or inertial forces. The Darwin does that by using an accelerometer and gyroscope, giving it characteristics similar to a MotionPlus-equipped Wiimote.
Is the Darwin the fabled Newton? Maybe some day we'll find out. No demonstrations have shown the Darwin moving a cursor across the screen, or aiming a gun in a shooter, so it may need some supplementary technology to give it the complete controlling functionality of our Wiimotes. If there's one thing Microsoft wouldn't want to skimp on supporting, it's the shooters.
Although some suspect the Darwin could alternatively be under development for Sony (and a change of clothes adds credence to that rumor), there's another motion-sensing controller under development that has been associated with the PS3, perhaps only because of similar nomenclature. The TrueMotion technology being developed by Sixense, is actually far more interesting than Sony's SIXAXIS.
Sixense TrueMotion is probably the next best thing to a MotionPlus-equipped Wiimote. It's got relative positioning with a magnetic field emitter as your reference point. But instead of accelerometers or gyroscopes, the magnetic field emitter acts like a fully functioning "sensor bar" to pick up the varied motions and positioning of the controller.
It's like playing a theremin, but instead of music coming out as you move your hand through the X, Y, and Z axes of the magnetic field, those coordinates are transmitted to the computer and used to move a mouse pointer, aim a gun, or swing a racket.
Sixense could potentially offer more freedom than the Wiimote's Sensor Bar, because you don't have to point the controller directly at it to get relative positioning data. The limitations of using a magnetic field still remain to be seen.
The Wiimote has so many functions, any rival company attempting to emulate it faces a daunting task. If Sony and Microsoft want to upgrade their controllers to the new gen, they'll be challenged to design or license alternate technologies and build them into a uniquely styled remote of their own. As gaming consoles take over the home theater and change the way we interface with technology, we may begin to expect more from all of our other remotes.
Every other week, Mike Sylvester brings you REVOLUTIONARY, a look at the wide world of Wii possibilities.
From an accelerometer, to an infrared camera, to a speaker, the Wii Remote is so packed full of features and tech, it's hard to imagine what an upgrade would look like for the next generation. But Mike gave it a shot, and you can read all about it in Revolutionary: The Perfect Controller, part 2.
I've occasionally used my Wii Remote with GlovePIE to move the mouse cursor on my computer, but before the Wii debuted, the idea of moving a remote through the air to control your PC seemed almost silly. But Gyration was marketing an air mouse that did just that. Unfortunately, using just a gyroscope and accelerometer to track motion meant that there was no relative position data available. You had to click the trigger button to tell the mouse pointer to move.Nintendo may have taken inspiration from Gyration, because as early as 2001, the two companies were working together to design a new gaming interface. Although our Wiimotes would ultimately be based on different sensor technologies, some of the money Nintendo invested in R&D with Gyration may have paid off in the development of the form factor and break-apart design. It looks like after a few more years of research, Gyration's rigid "side car" add-on concept had evolved into the far more flexible Nunchuk.
In 2007, Logitech, maker of numerous gaming, media, and productivity peripherals introduced the MX Air, which improves upon the gyroscopic air mouse by using a MEMS gyroscope similar to the one inside the MotionPlus, but with one axis less. To address the issue of having no reference point to move against, the MX Air has a button to recenter your movement. I've used this trick for a few GlovePIE scripts, and I have to say, using the Sensor Bar as a reference point beats the pants off it.
Is the Darwin the fabled Newton? Maybe some day we'll find out. No demonstrations have shown the Darwin moving a cursor across the screen, or aiming a gun in a shooter, so it may need some supplementary technology to give it the complete controlling functionality of our Wiimotes. If there's one thing Microsoft wouldn't want to skimp on supporting, it's the shooters.
Sixense TrueMotion is probably the next best thing to a MotionPlus-equipped Wiimote. It's got relative positioning with a magnetic field emitter as your reference point. But instead of accelerometers or gyroscopes, the magnetic field emitter acts like a fully functioning "sensor bar" to pick up the varied motions and positioning of the controller.
It's like playing a theremin, but instead of music coming out as you move your hand through the X, Y, and Z axes of the magnetic field, those coordinates are transmitted to the computer and used to move a mouse pointer, aim a gun, or swing a racket.
From an accelerometer, to an infrared camera, to a speaker, the Wii Remote is so packed full of features and tech, it's hard to imagine what an upgrade would look like for the next generation. But Mike gave it a shot, and you can read all about it in Revolutionary: The Perfect Controller, part 2.










Reader Comments (Page 1 of 1)
Mr Khan @ Dec 4th 2008 3:59PM
It would make more sense in the future. A wii-remote in your fingers and a wireless keyboard on your lap which you use to run your all-in-one media device, which is probably built into your TV
I certainly have found a traditional mouse awkward after starting to use the touch-pad on my laptop, and a remote would only feel more natural for a non-portable device
Evan @ Dec 4th 2008 4:03PM
A hand held controller doesn't capture all your body movements. At most you could get a sword that moves 1:1 with the hand held controller. It doesn't provide enough information to display a 3D avatar that moves 1:1 with your body movements. It doesn't even capture ducking your head (boxing) or your posture (golf swing).
I think the real future is 3D hand and body tracking using TOF cameras - effectively radar with light that sense depth and 3D position within your room like this:
http://www.youtube.com/watch?v=OjxWjO3Ay-g
Daniel @ Dec 4th 2008 4:44PM
I think the WiiMote idea had the perfect amount of motion sensing without going overboard. Nintendo could easily have produced another powerglove and tried to sense individual finger movement, but instead they kept buttons and the analog stick.
There are a couple of things that probably should change in the future though. The first is the problematic sensor bar. Having a camera in every WiiMote might have made sense before gyroscopes were feasible, but with both accelerometers and gyroscopes, there is no need for that kind of positioning. I would argue that even the magnetic positioning mentioned in the article is unnecessary. People easily make due with the relative positioning of a mouse, so there is really no need for an absolute position system, just a sensitive enough relative system.
I don't even see how a smaller device than the WiiMote would be preferable. Thinner would be nice, but shorter would be a pain.
Another company may even go in a different direction with game immersion. LCD shutter-glasses would allow for full color 3D on standard television sets. Even eye-tracking may be cheap enough to consider. Maybe the next console will have an LCD display built in to its wireless controller, or possibly, display technology will allow for the next Xbox to be based on Microsoft's Surface technology (and you'll purchase a big-ass table instead of a console to connect to your television).
Evan @ Dec 4th 2008 5:02PM
The LCD screen in the controller has been done before. The Dreamcast had a B&W LCD screen. And a couple of GameCube games allowed you to use a GameBoy Advance as a controller with an LCD screen. Neither seemed compelling enough to repeat.
As for gyroscopes - they don't know where your tv is! You'd have to calibrate them so they know which direction your tv is! And they drift over time, you'd have to periodically re-calibrate them.
Mike Sylvester @ Dec 4th 2008 5:17PM
There are a lot of games that would do fine with just gyroscopes and accelerometers. You could say Sony was counting on that with the SIXAXIS. But for FPS, RTS, "light gun" shooters, and other types of games where you want to move an onscreen cursor or aim at the screen, the controller has to know where the screen is, or the game has to know where the controller is in relation to the screen. The Wiimote puts the Sensor Bar close to your TV, and the Sixense could be calibrated easily enough (say, by holding the controller directly in front of the center of the screen) to facilitate those types of applications.
A lot of movie makers want to see 3D displays become as common as color TV, but LCD shutter glasses wouldn't work with a lot of LCD TVs out there. LCD TVs have polarized layers that might conflict with the polarization layers in the glasses. You wouldn't see anything, let alone a 3D image. Also, you'd need a high refresh rate, both on the screen and the signal or flickering will make the technology about as successful as the Virtual Boy. We're getting 120Hz TVs, but not many can accept a signal at that high a rate. For best results, we'd also have to have games rendered at 120fps, and it's tough enough just trying to get games running at 60fps.
Daniel @ Dec 4th 2008 5:25PM
Evan:
"The LCD screen in the controller has been done before."
Yes, and I think it was never really given a chance. The Dreamcast VMU had too small and dark of a screen to be useful in regular gaming. The Gameboy Advance option required the customer to buy a separate (portable) console entirely. I think a bright, relatively large touchscreen on every controller would be a very powerful extension to multiplayer games.
"As for gyroscopes - they don't know where your tv is! You'd have to calibrate them so they know which direction your tv is!"
And a mouse doesn't know where your computer is, or where it is on the mousepad. What can you do to "recalibrate"? Lift it up! I think a touch sensor on the controller that knew when your thumb lifted off the main button would be enough to recalibrate back to a more comfortable position similarly to a mouse.
Matias @ Dec 4th 2008 4:50PM
Sooo, they first bash the wiimote saying that it's gimmicky and now they want one???? what a bunch of hypocrites
the other companies just want to make money out of nintendo's original ideas like they've been doing for the last 10 or so years.
nintendo have analog stick!! let's add one.
nintendo is 3D!! let's make games in 3D AND with fmv's (the only idea I didn't see copied from nintendo, and probably the worst one).
nintendo have motion controls!! let's make a new controller.
Ohhhh I forgot capitalism and money/power hungry companies. That's sadly how the world works.
Josh @ Dec 4th 2008 6:36PM
Show me all the blueprints, show me all the blueprints, show me all the blueprints...
nig @ Dec 10th 2008 10:56PM
for the field he seems hesitant to raise the controller any higher than his shoulder.
his golf stance and baseball stance both look unnatural.
perhaps the limitation of the magnetic field is height? or something like it?