Humans experience the world with all their senses, including vision, touch, and hearing. I will describe recent progress in my group towards constructing multisensory animations with integrated graphics, haptics, and sounds. The animations are based on interactive simulation of physically based models, and provide the immediacy of interacting with the real world. I will describe how we can construct mathematical models suitable for multisensory simulation, and reality based modeling using the UBC Active Measurement Facility (ACME) and the new Rutgers Haptic, Auditory, and Visual Environment.

Bio:

Dinesh K. Pai is a Professor in the Department of Computer Science at Rutgers, the State University of NJ. He is also a Professor at the University of British Columbia and a fellow of the BC Advanced Systems Institute. He received his Ph.D. from Cornell University, Ithaca, NY. His research interests span the areas of graphics, robotics, and multisensory human-computer interaction. One current research focus is reality-based modeling, i.e., building multisensory computational models of the physical world from measurements. This includes a recent thrust in reconstruction from medical ultrasound images. Another focus is fast simulation with integrated sound, haptics, and graphics, especially simulation of contact.