COMS E6176: User Interfaces for Mobile and Wearable Computing

Spring 2004, Th 12:35pm-2:25pm
825 SW Mudd

Prof. Steven Feiner 
feiner [at] cs.columbia.edu
212-939-7083

Reading Material

Applications

Exploring the benefits that mobile and wearable computing have to offer different domains.

Butz, A., Baus, J., and Krueger, A. Augmenting buildings with infrared information. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2000 (ISAR 2000), 93-96.
Feiner, S., MacIntyre, B., and Seligmann, D. Knowledge-based augmented reality. Communications of the ACM,, 36(7), July 1993, 52-62.
Ockerman, J.J. and Pritchett, A.R. Preliminary investigation of wearable computers for task guidance in aircraft inspection. Proc. IEEE Int. Symp. on Wearable Computers 1998 (ISWC 98), 33-40.
Zhang, X., Genc, Y., and Navab, N. Taking AR into large scale industrial environments: navigation and information access with mobile computers. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001 (ISAR 2001), 179-180.
Feiner, S., MacIntyre, B., Höllerer, T., and Webster, A. A touring machine: prototyping 3D mobile augmented reality systems for exploring the urban environment. Proc. IEEE Int. Symp. on Wearable Computers 1997 (ISWC 97), 74-81.
Rensing, N.M., Weststrate, E., Zavracky, P.M., Chandler, M., Nobel, K.R., Helfter, S., Kinsky, M., Gold, M., and Martin, B. Threat response: a compelling application for wearable computing. Proc. IEEE Int. Symp. on Wearable Computers 2002 (ISWC 2002), 152-153.
Brashear, H., Starner, T., Lukowicz, P., and Junker, H. Using multiple sensors for mobile sign language recognition. Proc. IEEE Int. Symp. on Wearable Computers 2003 (ISWC 2003), 45-52.
Mikkonen, J., Vanhala, J., Reho, A., and Impi, J. Reima Smart Shout concept and prototype. Proc. IEEE Int. Symp. on Wearable Computers 2001 (ISWC 2001), 174-175.
Jebara, T., Eyster, C., Weaver, J., Starner, T., and Pentland, A. Stochasticks: augmenting the billiards experience with probabilistic vision and wearable computers. Proc. IEEE Int. Symp. on Wearable Computers 1997 (ISWC 97), 138-145.
MacIntyre, B., Bolter, J.D., Moreno, E., and Hannigan, B. Augmented reality as a new media experience. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001 (ISAR 2001), 197-206.

Context

Making computing sensitive to the user's constantly changing environment.

Weiser M. The Computer for the 21st Century. Scientific American, 265(3), September 1992, 94-104.
Want, R., Schilit, B.N., Adams, N.I., Gold, R., Petersen, K., Goldberg, D., Ellis, J.R., and Weiser, M.. An overview of the PARCTAB ubiquitous computing experiment. IEEE Personal Communications, 2(6), December 1995, 28-43.
Hull, R., Neaves, P., and Bedford-Roberts, J. Towards situated computing. Proc. IEEE Int. Symp. on Wearable Computers 1997 (ISWC 97), 146-153
Pascoe, J. Adding generic contextual capabilities to wearable computers. Proc. IEEE Int. Symp. on Wearable Computers 1998 (ISWC 98), 92-99.
Cybertracker
Abowd, G., Atkeson, C., Hong, J., Long, S., Kooper, R., and Pinkerton, M. Cyberguide: A mobile context-aware tour guide. Wireless Networks, 3(5), October 1997, 421-433.
Jebara, T., Schiele, B., Oliver, N., and Pentland, S. DyPERS: Dynamic Personal Enhanced Reality System. Proc 1998 Image Understanding Workshop, Monterey CA, May 1998.
Golding, A.R. and Lesh, N. Indoor navigation using a diverse set of cheap, wearable sensors. Proc. IEEE Int. Symp. on Wearable Computers 1999 (ISWC 99), 29-36.
Choudhury, T. and Pentland, A. Sensing and modeling human networks using the sociometer. Proc. IEEE Int. Symp.on Wearable Computers 2003 (ISWC 03), 216-222.

The World as Web

Presenting information about the world, in the world. Applications to tourism and cultural heritage.

Spohrer, J. Information in places. IBM Systems Journal, 38(4), 1999, 602-628.
Rekimoto, J., Ayatsuka, Y., and Hayashi, K. Augment-able reality: situated communication through physical and digital spaces. Proc. IEEE Int. Symp. on Wearable Computers 1998 (ISWC 98), 68-75.
Feiner, S., MacIntyre, B., Haupt, M., and Solomon, E. Windows on the world: 2D windows for 3D augmented reality. Proc. UIST '93 (ACM Symp. on User Interface Software and Technology), Atlanta, GA, November 3-5, 1993, 145-155.
Höllerer, T., Feiner, S., and Pavlik, J. Situated documentaries: Embedding multimedia presentations in the real world. Proc. IEEE Int. Symp. on Wearable Computers 1999, 79-86.
Cheverst, K., Davies, N., Mitchell, K., and Friday, A. Experiences of developing and deploying a context-aware tourist guide: The GUIDE project, Proc. Mobicom 2000, 20-31.
Pospischil, G., Umlauft, M., and Michlmayr, E. Designing LoL@, a Mobile Tourist Guide for UMTS. Proc. Mobile HCI 2002, 140-154.

Displays: Visual, Audio, Haptic

Mobile and wearable display technologies for presenting things that we can see, hear, and feel.

Spitzer, M.B., Rensing, N.M., McClelland, R., and Aquilino, P. Eyeglass-based systems for wearable computing. Proc. IEEE Int. Symp. on Wearable Computers 1997, 48-51.
MicroOptical.
Kasai, I., Tanijiri, Y., Endo, T., and Ueda, H. A forgettable near eye display. Proc. IEEE Int. Symp. on Wearable Computers 2000, 115-118.
Kiyokawa, K., Kurata, Y., and Ohno, H. An optical see-through display for mutual occlusion of real and virtual environments. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2000, 60-67.
Hua, H., Gao, C., Brown, L.D., Ahuja, N., and Rolland, J.P. Using a head-mounted projective display in interactive augmented environments. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 217-223.
Mann, S. Telepointer: Hands-free completely self-contained wearable visual augmented reality without headwear and without any infrastructural reliance. Proc. IEEE Int. Symp. on Wearable Computers 2000, 177-178.

Mynatt, E., Back, M., Want, R., Baer, M., and Ellis, J. Designing audio aura. Proc. CHI '98, 566-573.
Sawhney, N. and Schmandt, C. Speaking and listening on the run: Design for wearable audio computing. Proc. IEEE Int. Symp. on Wearable Computers 1998, 108-115.

Tan, H.Z. and Pentland, A. Tactual displays for wearable computing. Proc. IEEE Int. Symp. on Wearable Computers 1997, 84-89.
Gemperle, F., Ota, N., and Siewiorek, D. Design of a wearable tactile display. Proc. IEEE Int. Symp. on Wearable Computers 2001, 5-12.
Maeda, T., Ando, H., Sugimoto, M., Watanabe, J., and Miki, T. Wearable robotics as a behavioral interface---the study of the parasitic humanoid. Proc. IEEE Int. Symp. on Wearable Computers 2002, 145-151.

Input Devices

Mobile and wearable devices for entering text, selecting, and gesturing

Kolsch, M. and Turk, M. Keyboards without Keyboards: A Survey of Virtual Keyboard Implementations, Proc. Sensing and Input for Media-centric Systems (SIMS 02)
Howard, B. and Howard, S.. Lightglove: wrist-worn virtual typing and pointing. Proc. Int. Symp. on Wearable Computers 2001 (ISWC 2001), 172-173
Rosenberg, R. and Slater, M. The chording glove: a glove-based text input device. IEEE Trans. on Systems, Man and Cybernetics, Part C 29(2), May 1999, 186-191
Vardy, A., Robinson, J., and Li-Te Cheng. The WristCam as input device. Proc. Int. Symp. on Wearable Computers 1999 (ISWC 99), 199-202
Calhoun, G.L. and McMillan, G.R. Hands-free input devices for wearable computers. Proc. Symp. on Human Interaction with Complex Systems 1998, 118-123.
Sturman, D.J. and Zeltzer, D. A survey of glove-based input. IEEE Computer Graphics and Applications, 14(1), January 1994, 30-39.
Amento, B., Hill, W., and Terveen, L. The Sound of One Hand: A Wrist-mounted Bio-acoustic Fingertip Gesture Interface. Adjunct Proceedings of CHI 2002, (Minneapolis MN, April 2002), ACM Press, 724-725.

Body-worn Sensors and Affective Computing

Wearable sensors that can monitor the world or the user; and methods to sense, recognize, respond to, and affect the user's emotions.

Lind, E., Eisler, R., Burghart, G., Jayaraman, S., Park, S., Rajamanickam, R., and McKee, T. A sensate liner for personnel monitoring applications. Proc. IEEE Int. Symp. on Wearable Computers 1997, 98-105.
Picard, R.W. and Healey, J. Affective wearables. Proc. IEEE Int. Symp. on Wearable Computers 1997, 90-97.
Healey, J. and Picard, R.W. StartleCam: A cybernetic wearable camera. Proc. IEEE Int. Symp. on Wearable Computers 1998, 42-49.
Picard, R. Toward computers that recognize and respond to user emotion. IBM Systems Journal, 39(3&4), 2000, 705-719.
BodyMedia Body Monitoring Technologies.
Kern, N., Schiele, B., Junker, H., Lukowicz, P., and Troester, G. Wearable sensing to annotate meeting recordings. Proc. IEEE Int. Symp. on Wearable Computers 2002, 186-193.
Hoff, B. and Azuma, R. Autocalibration of an electronic compass in an outdoor augmented reality system. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2000, 159-164.
Priyantha, N., Miu, A., Balakrishnan, H., and Teller, S. The cricket compass for context-aware mobile applications Proc. Mobicom 2001, 1-14.
Symbol SRS-1 Wearable Ring Scanner.
Ekahau WiFi position tracking

Assistive User Interfaces

Mobile and wearable computing for persons with disabilities.

Loomis, J., Golledge, R., and Klatzky, R. Navigation system for the blind: Auditory display modes and guidance. Presence: Teleoperators and Virtual Environments, 7(2), April 1998, 193-203.
Starner, T., Weaver, J., and Pentland, A. A wearable computer based American sign language recognizer. Proc. IEEE Int. Symp. on Wearable Computers 1997, 130-137.

Collaboration

Mobile and wearable support for users working together, co-located or apart.

Butz, A.. Höllerer, T., Feiner, S.; MacIntyre, B., and Beshers, C. Enveloping users and computers in a collaborative 3D augmented reality. Proc. IEEE and ACM Int. Workshop on Augmented Reality 1999, 35-44.
Kiyokawa, K., Billinghurst, M., Hayes, S.E., Gupta, A., Sannohe, Y., and Kato, H. Communication behaviors of co-located users in collaborative AR interfaces. Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality 2002, 139-148.
Billinghurst, M., Bowskill, J., Jessop, M., and Morphett, J. A wearable spatial conferencing space. Proc. IEEE Int. Symp. on Wearable Computers 1998, 76-83.
Kortuem, G., Schneider, J., Suruda, J., Fickas, S., and Segall, Z. When cyborgs meet: Building communities of cooperating wearable agents. Proc. IEEE Int. Symp. on Wearable Computers 1999, 124-132
Billinghurst, M., Bee, S., Bowskill, J., and Kato, H. Asymmetries in collaborative wearable interfaces. Proc. IEEE Int. Symp. on Wearable Computers 1999, 133-140.
Weilenmann, A. and Holmquist, L.E. Hummingbirds go skiing: Using wearable computers to support social interaction. Proc. IEEE Int. Symp. on Wearable Computers 1999, 191-192.
Hestnes, B., Heiestad, S., Brooks, P., and Drageset, L. Real situations of wearable computers used for video conferencing and for terminal and network design. Proc. IEEE Int. Symp. on Wearable Computers 2001, 85-93.

Privacy and Social Consequences

The social consequences of ubiquitous mobile and wearable technologies, including effects on privacy.

Feiner, S. The importance of being mobile: Some social consequences of wearable augmented reality systems. Proc. IEEE and ACM Int. Workshop on Augmented Reality 1999, 145-148.
Rhodes, B.J., Minar, N., and Weaver, J. Wearable computing meets ubiquitous computing: Reaping the best of both worlds. Proc. IEEE Int. Symp. on Wearable Computers 1999, 141-149.
Harper, R. Why do people wear active badges? Xerox XRCE TR EPC-1993-120, 1993.

Augmented Reality

Overlaying the real world with virtual material for mobile users.

Feiner, S. Augmented reality: A new way of seeing. Scientific American, 286(4), April 2002, 34-41.
Azuma, R. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4), August 1997, 355-385.
Satoh, K., Anabuki, M., Yamamoto, H., and Tamura, H. A hybrid registration method for outdoor augmented reality. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 67-76.
Newman, J., Ingram, D., and Hopper, A. Augmented reality in a wide area sentient environment. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 77-86.
Pasman, W. and Jansen, F.W. Distributed low-latency rendering for mobile AR. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 107-113.
Reitmayr, G. and Schmalstieg, D. Mobile collaborative augmented reality. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 114-123.
Piekarski, W. and Thomas, B.H. Tinmith-evo5---An architecture for supporting mobile augmented reality environments. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 177-178.
Geiger, C., Kleinnjohann, B., Reimann, C., and Stichling, D. Mobile AR4ALL. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2001, 181-182.
MacIntyre, B. and Machado Coelho, E. Adapting to dynamic registration errors using level of error (LOE) filtering. Proc. IEEE and ACM Int. Symp. on Augmented Reality 2000, 85-88.
Furmanski, C., Azuma, R., and Daily, M. Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information. Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality 2002, 215-224.