Microsoft’s Project Natal – whether it proves to work for console gameplay or not – clearly represents a significant technical advance. What’s remarkable is the combination of 3D camera hardware with intelligent software for 3D sensing an intuitive interfaces. (And that’s without talking about the helpings of augmented reality and even voice recognition Microsoft has thrown in just for good measure.)

Of course, that makes it even more alarming to consider this technology might be stuck only on a single, closed game console. Even with Microsoft’s “community” efforts and freely-available XNA development tool, it’s just not very easy to play around with things on the Xbox 360 unless you’re a big developer. And non-game applications are off limits.

That makes a comment by Bill Gates to cnet somewhat more encouraging. Sure, Gates isn’t actually running the company any more, but these sorts of alternative interface discussions remain dear to his heart – and presumably Gates isn’t going to say something about Microsoft that’s entirely wrong, non-CEO as he may be.

Gates said: “I’d say a cool example of that, that you’ll see… in a little over a year, is this (depth) camera thing.” Gates said it was not just for games, “but for media consumption as a whole, and even if they connect it up to Windows PCs for interacting in terms of meetings, and collaboration, and communication.”

Gates said it is an example where the project started in Microsoft research but is now being commercialized by both the Xbox and Windows units. “Both the Xbox guys and the Windows guys latched onto that and now even since they latched onto it the idea of how it can be used in the office is getting much more concrete, and is pretty exciting.”

Gates: Natal to bring gesture recognition to Windows too
Via Ars Technica

That could mean ready access to the technology for artists and independent game designers – anyone with PCs. Incidentally, where Windows goes, other platforms follow, too. GPUs have to keep up with vision analysis, and lots of hardware cameras are needed? You can bet Linux and Mac hackers won’t be far behind.

It makes sense, too, because the basic set of technology worked just fine on Intel-powered Windows PCs in the form of 3DV Systems’ ZCam. Microsoft snatched up 3DV and absorbed its unique technology into the collective, with the patent portfolio along with it. You can still check out 3DV’s site:

http://www.3dvsystems.com/technology/tech.html

You’ll notice that Gates credits Microsoft Research and not 3DV and the ZCAM. Without actually knowing more specifics of Project Natal, though, that may be fair. In a VentureBeat story, Shane Kim of Microsoft argued that hardware is largely what was derived from the 3DV work. Certainly, it’s likely that some of the design and glue around the fundamental technology has come from Microsoft Research, and that with this many components, multiple research threads may be tied together in Natal.

Gates bashing aside, though, the one thing I will say for the industry titan is that he’s been utterly stoic in his optimistic embrace of alternative interfaces. There’s usually some litany of touch, pen/ink, gesture, voice, and vision.

Personally, I’m a bit puzzled by Microsoft’s take that the existing controller is the major obstacle to gaming. Ms. Pac-Man remains one of the most popular games of all time, crossing gender, social, and geographic barriers, and it used a joystick and buttons. The fact that Microsoft and Sony have controllers covered with buttons is by choice and by design, and doesn’t suggest that the only alternative is to eliminate hardware completely. But that said, maybe what’s needed is more perspective from outside mainstream gaming. If Microsoft could give its Project Natal to people other than A-list game companies, it sure couldn’t hurt.

  • http://kylemcdonald.net/ Kyle McDonald

    The second demo in the 3DV gallery is a video conferencing system, and most of the others are gaming applications. I'm guessing Bill was just recalling the demos he's seen rather than suggesting a vision of Natal as a "universal controller"… regardless, I'm still hoping it turns out that way. Best case scenario: it operates as a generic USB camera with DRGB encoded pixels (D for depth!) :)

    Regarding controllers, yes Ms. Pac-Man does use a physical interface, but it's just a button and joystick. And you don't really use the button. Compare this to the number of buttons and directional pads and joysticks on your average console controller, starting around third/fourth generation consoles.

    I think everyone was just surprised that the Wii managed to reduce the buttons involved while keeping people engaged. It helped people realize that more complex interaction isn't necessarily engaging, but interaction that takes advantage of our day-to-day intuition is engaging. From a distance, it almost looks like "fewer buttons is more engaging", but that's only because our day-to-day experience doesn't really involve button pushing.

  • Evan

    I think you'll get the option to play with a controller or not. Can you imagine keeping your arms up in racing game for more than 10 minutes? Or jumping every time you need to kick. By stereotype, gamers aren't the most active of people but even the healthiest of us doesn't want to hold our arms in the air for an indefinite amount of time.