Rocketpanda

So I seem to have become possessed by the alternative UI demons of late.

For some time now I’ve been following Johhny Chung Lee’s UI investigations into the potential of the wiimote among other things. The most accessible of these investgations for me was the wiimote whiteboard concept. If you’ve not read about it the premise is fairly simple. A wiimote is one of the coolest pieces of integrated tech on the market today. With three accelerometers, Bluetooth and an infra red (IR) camera that can track up to four points simultaneously it’s a steal of a device for £30, even without the Wii to go with it. With this cool device then, you can Bluetooth connect it to a pc and have access to the IR and accelerometer output. In the case of the wiimote whiteboard (available on Johnny’s site link above) the idea is to inverse what the wiimote’s normal use is and instead of waggling it in front of a stationary IR bar you use it as a stationary camera to track the movement of an IR source. In our case that IR source is a custom made pen that has a push button IR LED which the camera tracks and can emulate through the software as a mouse.

So knowing the concept I’ve been keen to try for some time but only recently have I acquired an IR pen and brought together all the constituent parts. After eBaying some IR pens, I borrowed the time of our IT department and our resident Wii and projector. A very short time later we had the wiimote whiteboard software set up with one wiimote tracked on the projection of the test laptop on a nicely blank wall. IR pen at the ready we went through the calibration process and fired up my colleague Gavin’s blog to try out his Silverlight painting test app.

The whole experience is really, really nice to use

It’s mostly pixel accurate if you’ve calibrated it well and for chunkier ui apps and drawing based tasks it is infinitely more usable than a mouse in a large-scale wall-presentation style environment.

There are a couple of small issues that the software can also help you get around. The wiimotebeing a camera in this instance means that the camera is looking at the surface you’re drawing. At some point you’re going to get in front of it meaning that it will stop drawing. Fortunately you can hook up more than one wiimote for redundancy which means if you get in the way of one wiimote the other is still tracking. We hooked up three and it makes a massive difference. I have to say though that the enhancement you get from connecting two is much bigger than it is for adding a third.

Our other issue was that as we were using a projector we were also walking in front of the display, so we want to try a rear projection set up which will eliminate this completely. Along the same line we could also use a rear projection setup for the wiimote though the surface we’d project on would need to allow th IR to show through.

All in all it works great and is really fast to set up. I bought a second hand wiimote on the weekend and hooked it up to my tv at home which took all of 10 minutes. If you try this out yourself please test it with Kloonigames’ Crayon Physics Deluxe demo, it’s a perfect example of what this tech does well and you won’t be disappointed.

After all the fun and excitement the last item we’re now interested in is as the wiimote can track up to four points at once it is possible for it to do multi touch as well. There is source code available and although it needs a bit more work to be a non developer project, believe me when I say it’s at the top of my list to get a multitouch wall surface created!

Happy wiimote whiteboarding!