Multimodal Intuitive Building Controls

With the Internet of Things expanding into our homes and offices, we can expect fixtures in buildings to become more interconnected and more numerous as part of an increasingly complex and powerful integrated smart environment. However, this raises new challenges in the area of usability since today’s rooms are already cluttered with multiple user interfaces in the form of buttons and remote controls. In the future, as more technology is embedded into buildings, users must have the opportunity to choose and to combine a heterogeneous set of devices and modalities. Multimodal User Interaction technology aims at creating natural and intuitively usable interfaces, allowing a user to interact with systems in a way similar to human-to-human communication. The combination of modalities like gestures, speech and gaze-tracking provides occupants with an integrated and intuitive interface for diverse addressable fixtures in buildings.

This video describes MIBO – a framework to enable and define multimodal intuitive building controls. It supports the integration and combination of multiple interaction modalities, e.g., gesture recognition, speech recognition, eye-tracking but also traditional button controls and performs the multimodal fusion. The framework has been applied in a number of real-world applications, shown in the video.

iOS Praktikum 2015 - Client Acceptance Test

This course has been realized in cooperation with Allianz, T-Systems, wirecard, Audi, Quartett Mobile, BMW, Bokowky+Laymann, Bayerischer Rundfunk, Siemens, Lufthansa and NTT Data.

The objective of the project course was the development of applications for mobile devices. Students became familiar with tools and methods required to develop applications for the iPhone and iPad. In addition to software engineering activities such as object oriented analysis, system design, the students also learned about user interface design, usability engineering and video-based requirements engineering. Release management was done with continuous integration and continuous delivery tools that allowed to send announcement of availability of the apps to the customers. Overall more than 100 students were involved. Each of the industrial partners provided a problem statement to be solved by the teams of 6-8 students. Students got real team and project experience while actually using real data and working tightly together with their client. This video shows the presentation of the T-Systems team during the client acceptance test at the end of the semester.

For more details about the course and more videos of the final presentations, please visit the iOS Praktikum 2015 results page! The video of each presentation can be found in our Youtube Channel.

iOS Praktikum WS14/15 - Client Acceptance Test

This course has been realized in cooperation with T-Systems, Siemens, Innoactive, Hochschule Weihenstephan, Praxis for Sporttraumalogie, incapptic, BMW, B/S/H/ and Allianz.

The objective of the project course was the development of applications for mobile devices. Students became familiar with tools and methods required to develop applications for the iPhone and iPad. In addition to software engineering activities such as object oriented analysis, system design, the students also learned about user interface design, usability engineering and video-based requirements engineering. Release management was done with continuous integration and continuous delivery tools that allowed to send announcement of availability of the apps to the customers. Overall more than 100 students were involved. Each of the industrial partners provided a problem statement to be solved by the teams of 6-8 students. Students got real team and project experience while actually using real data and working tightly together with their client. This video shows the presentation of the T-Systems team during the client acceptance test at the end of the semester.

For more details about the course and more videos of the final presentations, please visit the iOS Praktikum WS14/15 results page! The video of each presentation can be found in our Youtube Channel.

iOS Praktikum 2014 - Client Acceptance Test

This course has been realized in cooperation with adesso, NTT Data, equinux, BMW, T-Systems, Boinx, Siemens IT, Carnegie Mellon University, Siemens PSE, B/S/H/ and Praxis for Sporttraumalogie.

The objective of the project course was the development of applications for mobile devices. Students became familiar with tools and methods required to develop applications for the iPhone and iPad. In addition to software engineering activities such as object oriented analysis, system design, the students also learned about user interface design, usability engineering and video-based requirements engineering. Release management was done with continuous integration and continuous delivery tools that allowed to send announcement of availability of the apps to the customers. Overall more than 100 students were involved. Each of the industrial partners provided a problem statement to be solved by the teams of 6-8 students. Students got real team and project experience while actually using real data and working tightly together with their client. This video shows the presentation of the adesso team during the client acceptance test at the end of the semester.

For more details about the course and more videos of the final presentations, please visit the iOS Praktikum 2014 results page! The video of each presentation can be found in our Youtube Channel.

iOS Praktikum 2013 - Client Acceptance Test

This course has been realized in cooperation with Siemens, B/S/H/, NTT Data, Maiborn Wolff et. al. & FTI, Adesso, Bokowski+Laymann, Audi, Linova, Jaimie Jacobs and Kisi.

The objective of the project course was the development of applications for mobile devices. Students became familiar with tools and methods required to develop applications for the iPhone and iPad. In addition to software engineering activities such as object oriented analysis, system design, the students also learned about user interface design, usability engineering and video-based requirements engineering. Release management was done with continuous integration and continuous delivery tools that allowed to send announcement of availability of the apps to the customers. Overall more than 100 students were involved. Each of the industrial partners provided a problem statement to be solved by the teams of 6-8 students. Students got real team and project experience while actually using real data and working tightly together with their client. This video shows the presentation of the Siemens team during the client acceptance test at the end of the semester. For more details about the course and more videos of the final presentations, please visit the iOS Praktikum 2013 project page!

iOS Praktikum 2012 - Customer Acceptance Test

This course was done in cooperation with 11 companies: actiworks, Audi, B! Food, Bokowski&Laymann, B/S/H, equinux, Graupner, MaibornWolff et. al., Siemens and Simon Pierro.

The objective of the project course was the development of applications for smart phone and tablet computers. The students became familiar with tools and methods required to develop applications for the iPhone and iPad. In addition to software engineering activities such as object oriented analysis, system design, the students also learned about user interface design and usability engineering. Release management was done with continuous integration and continuous delivery tools that allowed to send announcement of availability of the apps to the customers. Overall more than 120 people were involved. Each of the industrial partners provided a problem statement to be solved by the teams of 6-8 students. Students got real team and project experience while actually using real data and working tightly together with their client. This video shows the client acceptance test presentation at the end of the semester. For more details visit the iOS Praktikum 2012 Homepage.

JASS 2012

In the course "Usability Engineering and Ubiquitous Computing" of JASS 2012, 6 German students from Technische Universität München and 7 Russian students from St. Petersburg Academic University organized in 3 interdisciplinary teams, developed 3 iOS applications iTravel, iTranslate and BumpWatch in a week.

For more details, visit the JASS 2012 course homepage.

Home Gestures - The intuitive control of smart home and office environments (2011)

This movie presents an approach to individually controlling home and office fixtures such as lights, window blinds, cooling and ventilation units with an ‘intuitive gesture-based controller’ using a smart phone. The implementation of the gesture controls is based on the magnetometer, gyroscope and accelerometer built into the most recent smart phones. The user simply points to target objects and completes specific gestures. For example, pointing to the top of a window and completing a "down"-gesture is interpreted as a command to lower the blinds at the window. Pointing the device to a light fixture and doing an "up"-gesture raises the light levels. In combination with addressable fixtures and wireless infrastructures, this phone controller reveals how a wide variety of fixtures in a building can be intuitively controlled by pointing, using only a single button and gesturing.

Publication:
Sebastian Peters, Vivian Loftness, Volker Hartkopf
The intuitive control of smart home and office environments
Proceedings of the 10th SIGPLAN symposium on New ideas, new paradigms, and reflections on programming and software, 2011

DOLLI2 - Project Presentation (2008)

The goal of this project was the development of a tracking and service system in cooperation with the munich airport. This video presents the goals that were reached as well as how the course was organized.

Publication:
Bernd Bruegge, Oliver Creighton, Maximilian Reiss, Harald Stangl
Applying a Video-based Requirements Engineering Technique to an Airport Scenario
Third International Workshop on Multimedia and Enjoyable Requirements Engineering - Beyond Mere Descriptions and with More Fun and Games, pp.9-11, 2008.

DOLLI - Teaching Innovation (2007)

This project was done in cooperation with the Munich Airport. The development took place in the winter semester 2007 with 45 students in a project course at Chair of Applied Software Engineering, Technische Universität München. The goal of this project was the development of a tracking and service system in cooperation with the Munich airport.

This video shows the development of a visualization system for tracking dollies, tow-bars, luggage, etc. and remote maintenance. We show the development process, the meeting management procedures, the student presentations and a technique called software cinema for visualizing requirements.

Publication:
Bernd Bruegge, Harald Stangl, Maximilian Reiss
An experiment in teaching innovation in software engineering: video presentation
In OOPSLA Companion to the 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications, pp 807-810, 2008.

Virtual Symphony Orchestra (2005)

This project was done in cooperation with Bavarian Symphony Orchestra with Mariss Jansons as patron.
The development took place in the winter semester 2005 with 30 students in a project course at Chair of Applied Software Engineering, Technische Universität München.

This video shows the capability of a  virtual conductor system teaching children how to conduct music with virtual Symphony  Orchestra.

Publication:
Bernd Bruegge, Christoph Teschner, Peter Lachenmaier, Eva Fenzl, Dominik Schmidt, Simon Bierbaum.
Pinocchio: conducting a virtual symphony orchestra
In Proceedings of the International Conference on Advances in Computer Entertainment Technology, ACM New York, USA, pp 294-295, 2007.

Personal Yoga Instructor (2004)

This project was done in cooperation with Vodafone. The development took place with 14 students participating Ferienakademie Sarntal/Südtirol from 19. Sep to 1. Oct in 2004.

This video shows a visionary scenario of a Yoga student repeating exercises at home with advice from a personal Yoga instructor which she received at the gym.

Handy Credit (2003)

This project was done in cooperation with Accenture as client.

The development took place in the 2003 with 10 students in a project course at Chair of Applied Software Engineering, Technische Universität München.

ARENA (2002)

With the arrival of the global broadband network infrastructure, new game concepts are possible and resulted in the creation of a wealth of Multiplayer Online Games (MOGs), for example, Quake, CounterStrike, Ultima Online, EverQuest, or WarCraft. But after the broadcasting infrastructure of radio and television was supplemented by two-way network connections, another use of the technology was enabled: peer-to-peer (P2P) networks. Thus far they are mainly used for one-on-one messaging or simple file exchange. The newly available FRAG framework manages peer-to-peer communication, distributed object synchronization and message transport for object-based 2D or 3D game worlds.