I will start with a design I posted about back in May 2012. http://everythingworkflow.wordpress.com/2012/05/25/sixth-sense-hardware-plus-leap-good-stuff/  I am sticking with the name Single Cell, as it will grow into many variations as technologies and people move the goal post forward.

(Picture form last may when Leap was vaporware)

My device was meant to be OS agnostic.  It will be hardware driven, unlike Sixth Sense  which has a software shell. (If you haven’t seen this TED video on Sixth Sense, you need to.)http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html

I have Leap and Kinect working as a mouse and finally have been able to retire the GyroMouse (seen in use here in use:

)

Not much has really changed about the idea other than it’s a reality now and it works like I thought it would.

New Look:

Better view of camera position here:

Ill try to have the Leap and Kinect plugins out soon so you can load them as C# DLL’s.

So the point.  The camera is for any visual input needed.  I do OCR -> query and object recognition.  (You can use it for anything).

The projector is visual output,  no need to write software backwards, the screen shows on the wall what you would see on  a PC.

Leap is keyboard, Mouse and motion of hand (X Y Z) .

2 Mirrors if you have a front facing, 0 if side facing. Oh and You can now use side facing projectors. The two mirrors are from Home Depot Square telescoping utility mirror.  Should run under $10 each.

This means things are hardware driven as well.  No more color markers EVER..

Still looks like this on Windows 8 on a Dell with 2 GB of ram. Runs everything.

and

You can start coding against this device today because it runs on most OS’s .   I can verify Windows 7 and Windows 8 and can code against it in any language since your just writing an application.
Let me know what you think!

Mark – Augmented Developer

Share on Facebook