Immersive Media

Awesome teams creating awesome products guided by awesome experts

Minor Immersive Media

Within the minor Immersive Media you will work for 5 months to attain in-depth knowledge on topics from the creative industries. You will do this by joining one of the available projects submitted by experts from their respective fields. The projects are interdisciplinary and require commitment, expertise, team spirit and a profound curiosity in design and technology.

Applying

You can then subscribe to the minor through this link.

Projects

Below you will find a list of project in which you can participate. Given your preference we will place you in one of the project groups at the start of the minor in February.

Please note that we currently are working on finalizing three more projects. Check this website regularly for updates or subscribe to the minor above to receive an email when a new project is added.

1. Hyper reality experience – Theme park adventures in virtual reality
2. Healthy cities game – Web based sim city game about healthy environments
3. Project One – Gamification of crowd control in virtual reality
4. Orchestra VR – Creating music in virtual reality
5. Real-time cloth simulation for virtual draping
6. Real sized virtual avatars trough machine learning

Project: Hyper reality experience – Theme park adventures in virtual reality

Maximum students: 8

In collaboration with MADlab (studio MAD) you will be creating a new concept and prototype for a soon to be opened hyper virtual reality experience. The concept should be build on an existing room lay-out taking into account existing props and technologies on site.

What is a hyper reality:
Hyper Reality is a new form of Virtual Reality where you do not only see and hear the virtual world, but where you can also feel it. In the experience you will enter a virtual world that is mapped onto a real world environment such that everything you see can also be felt. If you enter the experience with a group you will see the other users as a character in the virtual world trough the use of motion capture. To create a deep immersive feeling a hyper reality experience uses effects like heat, vibrations, wind, etc to suggest that you have stepped into a world where everything is possible. When doing a hyper reality experience you should feel like a superhero in your own movie!

The prototype should meet the following criteria:

Deliverables:

Links:

Topics: Virtual reality, Unity, Gaming, Storytelling, Concepting, Programming, Concept art, 3D modelling.

 

Project: Healthy cities game – Web based sim city game about healthy environments

Maximum students: 8

Rationale:
Cities will shape the health and wellbeing of populations in the 21st century. In 2017, over half the global population live in urban environments, experiencing an increased exposure to unhealthy diets, sedentary lifestyles, air pollution, and limited green spaces. We want to draw people’s attention to the risk factors that they can see, hear, smell, touch, and most importantly, act upon, in an attempt to make NCDs a tangible and positive issue to tackle. The mass migration of young people into urban places and spaces across the globe renders this issue highly relevant to the millennial population, and provides future change-makers with an unprecedented opportunity to build a healthy future.

Project description:
For NCDFREE and under guidance off (…) you will create a web based game about the effect of urban environments on people health. This game should cater to the target audience of NCDFREE and include a social elements that helps spread to message. The game should be played on a NCDFREE campaign website and should challenge and surprise players with multi-layered, in-depth gameplay.

Target audience:

Key features:

Deliverables:

Links:

Topics: Concept art, Game design, Web Technology, Storytelling, Marketing

Project: Project One – Gamification of crowd control in VR

Maximum students: 6

Crowd control is an everyday societal topic. Managing large crowds of people in concert halls, football stadiums, airports, social events and city centers becomes ever more import. Not only to disperse the load of certain areas and facilities, but also for security in case of emergencies or attacks.

New technologies enable the possibilities to track people based on their phones, control responsive display’s and hologram for interacting with people, enable social queues (change of lights, audio for example) and even initiate ground or airborne robotic devices to aid the rescue.

With the future focusing on smart cities and combining a multiple array of technologies, the UTwente’s Tech4People BMS LAB and Saxion join forces to setup a unique project: Project ONE.

The main purpose of this project is to build a full-scale demonstrator in for a crowd control platform in VR, which can be launched during e.g. the CuriousU summer school project (+/- 300 students) within a selected area on the UTwente campus.

Within this project CMGT students will be working on creating the virtual reality application that allows the visualization of crowds and the control of real world units like drones, holographic displays and lights.

Example of interactions between the virtual and real world:

During this project you will work with students from Saxion HBO-ICT (computer science) and students/researchers from the University of Twente.

Deliverables:

Topics: Virtual reality, 3D modelling, Gamification, Robotics, Drones, Programming, Inter-disciplinary

Project: Orchestra VR – Creating music in virtual reality

Maximum students: 8

Creating music can be one of the most fulfilling experiences people can experience. However learning how to play music can be a time consuming and difficult tasks. In order to share with everyone the beauty of creating music The Virtual Dutch Men together with Sense Glove and Enliven 3D challenge you to create a VR application doing just that.

In the prototype you should combine the Sense Glove haptic feedback gloves with the Enliven 3D motion capture system for the creation of a beautiful visual and audial experience. User should be able to play several instruments where the created music interacts with the world. The game should be easy to play but hard to master and incorporate at story telling element. In the project you will be working directly under the guidance of The Virtual Dutch Men with cooperation from Enliven and Sense Glove.

The prototype should meet the following criteria:

Deliverables:

Links:

Topics: Virtual reality, Unity, Gaming, Storytelling, Concepting, Programming, Concept art, 3D modeling, Motion capture, Haptic feedback.

Project: Real-time cloth simulation for virtual draping

Maximum students: 4

Realistic virtual clothing has always been a very hard computer graphics problem due to its computational difficulty. However given to increasing demand for high-end visuals in games and other application realistic cloth simulation is a interesting topic to explore.

In close collaboration with the Saxion chair of Ambient Intelligence and the company Emaldo you will be researching and creating a library for virtual draping by using NVIDIA FleX. The library should be used for realistic cloth simulation on 3D characters for gaming and non-gaming applications. Your work will consist of finding the right method for the simulation, taking into account the various material properties. Secondly you will have to create a prototype application that shows the possibilities of the technology.

Deliverables:

Topics: Physics, OpenGL, Real Time Dynamics, Math, Programming, Computer Graphics, Gaming.

Project: Real sized virtual avatars trough machine learning

Maximum students: 4

With the rise of VR and AR as social platform 3d avatars will increasingly become an extension of ourselves in the virtual world. For this reason a realistic 3D topology of our bodies would be very helpful. For this reason you will look into a possible solution to this problem by investigating how artificial intelligence can be used to determine someone’s measurements, based on just a picture of themselves. In the project you will be working with Saxion chair of Ambient Intelligence and students from different Saxion study programs.

What is Artificial Intelligence
Artificial intelligence revolves around studying and creating systems that can think, are autonomous or can learn from their experience. The field of machine learning and, more recently, deep learning, studies an implementation of this. Based on big data, deep learning algorithms can learn to be used for multiple applications, such as speech recognition, using audio, like Apple’s Siri; self-driving cars, using infra-red sensor data and video data; and playing games, such as Go, Starcraft II, and Dota 2.

In this project, you will develop software (possibly an app) that allows users to take a picture of themselves and determine their measurements. Underlying this software should be a machine learning approach which is trained on an available data set of 3-dimensional scans, 2-dimensional photos and exact body measurements of a few thousand people. How do you design and implement a system that, on the one hand, can be trained and, on the other hand, can be easily used by the average person? Besides this approach, people could also ‘correct’ the software by entering their regular size, to give the software more data to train on and adapt its recommendations.

This project allows you to get hands-on experience with the recent trend of deep learning and use it directly in a national research project with over 20 business partners interested in new technology for fitting fashion.

Deliverables:

Topics: 3D topology, machine learning, deep learning, math, programming