How to Make your own sixth sense Device

So you want to make your own Sixth Sense device. Now what?

SixthSense is a portable gestural interface that increases the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

    Hardware

    Software

    Links and Resources

    License Information

 Hardware 

Hardware Description SixthSense.Components

Camera

 The camera is the key input device SixthSense system. The chamber acts as a digital eye system. Basically, it captures the scene the user is looking. The video stream captured by the camera is passed to the mobile computing device that does the calculation of appropriate computer vision. The main camera functions can be enumerated as:

    Capture user hand movements and gestures (used in the reorganization of the gestures of users)

    Capture the scene on the forehead and the objects that the user is interacting with (used in the reorganization of the object and up)

    Take a picture of the scene in front when the user performs a "frame" gesture

    Capture the scene projections interface (used to correct the alignment, placement and appearance of the interface components projected)

Suggested Product: Logitech QuickCam Pro for NotebooksProjectorThe projector is the key output device SixthSense system. The projector increases visual surfaces, walls and physical objects the user is interacting with by projecting digital information and graphical user interfaces. The mobile computing device provides the projector with the content being shown. The projector unit used in the prototype runs on a rechargeable battery. The main functions of the projector can be listed as:

    Projects graphical user interface of the selected application on surfaces or walls in the front

    Increases physical objects the user to interact with projecting just in time and related information via the Internet

Suggested products: You can buy either laser (AAXA, Microvision) or LED (3M MPro110) projectors. 

Mirror   

The mirror reflects the projection coming from the projector and thus helps in projecting onto the desired locations on the walls or surfaces. The user can change the tilt of the mirror to change the location of the projection. For example, in applications where the user wants the projection to go in the ground instead of on the front surface, which can change the tilt of the mirror to change the projection. Thus, the mirror in SixthSense helps to overcome the limitation of space limited projection of the projector.Suggested product: Any 1 "X1" first surface mirror  

Microphone 

The microphone is an optional component of the SixthSense. Required when using media as a computer interface. When the user wants to use a sheet of paper into an interactive surface, he or she cut the microphone on the paper. The microphone connected in this way captures sound signals play the role user. This data is passed to the computing device for processing. Later, combined with the tracking information on the user's finger, the system is able to identify precise touch events on paper. Here, the audio signal captured by the microphone provides time information while the camera tracks. Enabled applications this technique has been explained above.Suggested Product: Logitech QuickCam Pro Microphone Notebook 

Mobile computing device

 The system uses a SixthSense mobile computing device in the user's pocket as the processing device. The software program that allows all the features of the system is running on the computing device. This device can be a mobile phone or small laptop. The camera, projector and microphone are connected to this device via a wired or wireless. The detail of the software program running on this device is provided in the following section. The mobile computing device is also connected to the Internet via the 3G network or a wireless connection.



Suggested product: any computer with Windows

Now that you have all these parts, you need a way to combine them. The use of Lego strips to form the base. The projector, camera and mirror assembly can be placed directly in the database. You can also use velcro to combine products.

 Software 

Information on how to configure the software to SixthSense.

Running the software component SixthSenseThe prototype system runs on the Windows platform and most of the code is written in C + + and C #. We will upload the new versions, as it is developing, which will also include a mobile version.NOTE: We are moving in the new code to Git this week. Meanwhile, you can download from the link below.WuW v0.1 beta 

Download

v1

How to run WUW_v0.1WUW_v0.1 is SixthSense beta code (Wear Ur World WuW means, a former project name). This version works with Windows. Make sure you have Visual Studio and Direct X installed. Extract and copy the files wuw_v0.1.zip anywhere on your computer. Open WUW01.sln (which is present in the "CODE") and click F5 to debug. If you successfully debug displays a black screen with a small square box on the right just hover your mouse around and find a list of options such as camera cards and Applications.Camera: you can choose which camera to use and configure the camera settings here. You may need to reflect the camera here using the camera settings. Also recommended is the use of fixed / manual white balance and exposure so that the camera image is stable and independent light.Tokens: This version of code uses the fingers of colors as markers. No more than 4 different colors to run most applications. We recommend using red, yellow, blue and green (or colors that are sufficiently different). We have also noticed that the matte tape / objects work best as they have less reflective changes. When you click Add marker ', the screen starts flashing and after 4-5 seconds stops with a still image so that you can add markers on hand as new markers. You can simply drag and select the color marker on the screen by the mouse cursor. Once you have the four markers (O, P, M and N) added the software starts tracking the four markers. You can set thresholds for monitoring improvement. You can save bookmarks and can be reused on subsequent executions, or you can add new bookmarks at all times.Applications: There are three ways to launch any application. Applications tab may allow you to choose the applications to load and run. You can also load applications 'Menu'. 'Menu' is activated in a gesture of Namaste. Once in the menu screen you can choose the application by hand, and then click (hand gesture Click works by moving the marker O and P hide the marker.
Links
Places to buy the components Sixth Sense.Suggestions Hardware ComponentsThese are the basic pieces that you should buy. You can choose any brand, and the following list are the elements that have worked well for us:

    Pico-projector
        Laser
            AAXA ~ $ 110
            Microvision ~ $ 200
        L.E.D
            3M MPro110 ~ $ 270
    Camera
        Logitech QuickCam Pro for Notebooks ~ $ 23
    Microphone
        Microphone Logitech QuickCam Pro for Notebooks ~ $ 23

    A set of mirrors
        Front mirror front is the best, 1 "X1" first surface mirror (this can be purchased from anywhere, ie Ebay)

    Laptop Computer: Any computer with Windows (that act as mobile computing device)
 LicensesLicense Information
a) the GPL version 3.0 - Any project that contains distributed within, or refers to any part of Sixth Sense source code must be released with source code under GPL version 3.0 or later.