Smart interactive windows for a richer experience on the road

General Motors Research and Development (GM R&D) put that challenge before researchers and students from the FUTURE LAB at Bezalel Academy of Art and Design in Israel. The task was to conceptualise new ways to help rear seat passengers, particularly children, have a richer experience on the road.

The Windows of Opportunity (WOO) project was inspired by psychological studies indicating car passengers often feel disconnected from their environment. GM asked the Bezalel students to turn car windows into interactive displays capable of stimulating awareness, nurturing curiosity and encouraging a stronger connection with the world outside the vehicle.

"Traditionally, the use of interactive displays in cars has been limited to the driver and front passenger, but we see an opportunity to provide a technology interface designed specifically for rear seat passengers," said Tom Seder, GM R&D lab group manager for human-machine interface.

"Advanced windows that are capable of responding to vehicle speed and location could augment real world views with interactive enhancements to provide entertainment and educational value."

Share music with other cars on the road

Since GM has no immediate plans to put interactive display windows into production vehicles, the R&D team gave free reign to the Bezalel students to create applications without concern whether they could be mass produced. Bezalel is Israel's oldest institute of higher education and one of the more prestigious schools of its kind in the world.

The apps include Otto, an animated character projected over passing scenery that responds to real-time car performance, weather and landscape. With Otto, passengers can learn about their environment in fun, playful ways. Foofu is an app that allows passengers to create, explore and discover through finger drawing on window steam, while Spindow provides its users a peek into other users' windows around the globe in real time. Pond is an app that allows passengers to stream and share music with other cars on the road, downloads favourite tracks and share messages with other passengers on the road.

To demonstrate these apps, the students produced a full scale functional prototype of a rear passenger seat and side window. The students used motion and optical sensor technology developed by EyeClick to turn standard window glass into a multi-touch and gesture sensitive surface.

If such interactive windows were put into automotive production they likely would use electronically charged 'smart glass' technology, which is capable of variable states of translucence and transparency, and can reflect projected images. Smart glass is increasingly used in architectural and display applications, but outside of movies like Mission Impossible: Ghost Protocol is rarely seen in cars.