Gesture-based Computing: Prepare for Judgement Day

esture Away

Gesture-based devices are becoming ubiquitous throughout society. On mobile devices, pinch-zooming on a map and swiping through a photo album have become pretty much second nature to many individuals, especially kids. I’ve recently started using custom gesture-based commands on my smartphone’s browser which will no doubt become more widespread.

Google Glasses Architect

With the advent of Google Glasses, location-based augmented reality takes on a whole new meaning. What if you could add custom gesture-based commands on top of the world seen through Google Glasses. This new product that combined augmented reality and gesture-based computing would be called Google Glasses Architect (GGA).

Learning Activity

With the current generation of students growing up in the fast-paced Internet age, going to artifact-based museums (while extremely educational) can be boring. Imagine if each student were equipped with a Google Glasses Architect (GGA). Instead of just viewing a Hawaiian holua sled behind an exhibit case, students would look at a 3-D model of the sled through their GGA. Furthermore, they would be able to use their gestures to manipulate the model in order to attempt to make it more aerodynamic. Students could then put line up their sleds side by side on a virtual hill and watch to see whose avatar went down the hill the fastest. Besides competition, the GGA could also foster collaboration. Students could view an adze or cordage, manipulate their own 3-D model of the artifacts, and then work together on building and binding a canoe.

Holistic Learning

Viewing the 3-D artifact models would give students exposure to Hawaiian history and culture. Modifying them would require them to have a good understanding of 3-D space and design, the engineering and architect tools of the trade. Having worked at the Bishop Museum for 5 years, the GGA would be great from both an educational and marketing perspective. Students could follow up and refine the models back in the classroom or at home. Moreover, all of the models that the students modified would be available on a central database (similar to Google Sketchup) so that they could be further refined by future classes... sort of like a Wikipedia of 3-D models.

Assessment

Students would be assessed on how well their modified artifacts combine ancient tradition with modern science. A perfect science and culture lesson. They would be assessed by their peers and the top models would be built and put on display at the museum.

Looks like GGA may be within the Horizon Report's 4-5 year horizon. Prepare for Judgement Day.

References

Bilton, N. (23 February 2012). Behind the Google Goggles, Virtual Reality. New York Times. Retrieved from http://www.nytimes.com/2012/02/23/technology/google-glasses-will-be-powered-by-android.html

Davies, C. (9 March 2012). Google Kinect-style Android motion tracking teased in patent app. Slash Gear. Retrieved from http://www.slashgear.com/google-kinect-style-android-motion-tracking-teased-in-patent-app-09217687/

Johnson, L., Adams, S., & Cummins, M. (2012). The NMC Horizon Report 2012: Higher Education Edition. Austin, TX: New Media Consortium.

Liu, R. (30 August 2011). Dolphin Browswer Heads to the iPhone. Slash Gear. Retrieved from http://www.slashgear.com/dolphin-browser-heads-to-the-iphone-30175123/

Miller, C. C. (1 September 2010). To Win Over Users, Gadgets Have to Be Touchable. New York Times. Retrieved from http://www.nytimes.com/2010/09/01/technology/01touch.html?_r=1