Extended Reality (XR) encapsulates various immersive technologies that can merge the physical and virtual worlds, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). This course is an introduction to the fundamental techniques and practical applications of Extended Reality. We will cover several topics: concepts in XR, human perception, immersion and presence, virtual world modelling, real-time simulation, input and output devices, 3D user interaction, design principles for XR, and case studies. These topics will be explored via a combination of lectures, individual assignments and a group project to develop an XR application. Students should be comfortable with programming for the front and back end. They should be familiar with Unity to complete the project and assignments.
50.001 Information Systems & Programming or demonstrable experience and knowledge in object-oriented programming.
- Define and explain the fundamental concepts in Extended Reality (VR / AR / MR).
- Establish and analyse requirements for building an XR system to achieve the goal of immersion and enriched experiences.
- Understand the fundamental hardware and software techniques in XR.
- Understand the user interaction and interface design principles for XR.
- Create and display digital content and design interaction for XR systems.
- Develop an XR prototype that addresses an interesting and/or important real problem that involves people.
- Analyze the technical feasibility of XR projects and identify the challenges.
By the end of this course, students should be able to:
- Define and explain principles in design and realization of XR systems.
- Explain the advantages, disadvantages, and limitations of using VR, AR, or MR systems.
- Model and create virtual worlds for XR.
- Design user interface for interacting with the virtual worlds in XR.
- Choose suitable input and output devices for building an XR system.
- Develop an XR prototype that addresses an interesting and/or important real problem.
- XR concept
- Relation and difference between VR, AR and MR
- XR system
- Human perception
- Immersion in XR
- Virtual worlds
- 3D modeling and rendering
- Input devices
- Output devices
- Latency in VR
- User Interface Design
Recommended Texts and Readings
Ralf Doerner et al., 2022. Virtual and Augmented Reality (VR/AR): Foundations and Methods of Extended Realities (XR).
Prof Peng Song, Prof Kenny Choo