Faculty of Information Technology and Communication Sciences
Language of instruction
Technology and Natural Sciences
Mode of study
3D and Virtual Reality, 5 cr
Language of instruction: English
The course targets new and emerging technologies for 3D visual scene modelling, capture, processing and visualization as well as their use in applications such as 3D video and virtual reality. The course will provide in-depth knowledge about the creation, processing, delivery and visualization of 3D moving scenes. After the course, the students will know the basics of 3D computer graphics and binocular vision, and how those basics are taken into account while capturing and processing 3D video. The students will be able to design application-specific multi-camera and multi-sensor capture systems and 3D graphics visualization tools. They will know the principles and the state-of-the-art techniques for compression and transmission of multi-modal signals used for conveying 3D visual information. The students will know the state-of-the-art and emerging visualization techniques, such as auto-stereoscopic, light-field, holographic, head-mounted and haptic-augmented displays. The students will have knowledge about typical visual artifacts appearing during the stage of 3D content creation, compression and transmission and about the advanced signal processing methods which can tackle those artifacts. 3D tracking sensors: mechanical, optical, magnetic, audio, etc. will be overviewed and basics of augmented and virtual reality will be presented.
Geometric data types. Linear and affine transformations.
Cameras and rasterization. Depth. Verteces and pixels. Color. Raytracing.
Binocular vision; perception of depth. 3D visual cues.
3D scene capture: multi-camera, multi-sensor approaches.
3D scene representation formats: multi-view + multi-depth; layered depth; epipolar image; point-clouds and meshes. Copression of 3D imagery.
Immersive displays: 3D, light field VR and AR displays.
3D tracking sensors: mechanical, optical, magnetic, audio. Motion capture.
Transform matrices. Rotations and translations. Frames.
Materials and texture mapping.Geometrical models.
Vergence and accommodation conflict. Focus cues.
Calibration and rectification of multi-camera setting with different topologies. Depth estimation.
Format conversion methods. Multi-modal 3D scene compression.
Sampling and reconstruction. Animation.
Visual processing paths
Capture-specific 3D visual artifacts
Representation-specific and compression-specific 3D visual artifacts.
Quality measurements for 3D displays.
25.10.2022 09:00 - 12:00, TAU Sähkötalo SA203 S2 auditorio (90) 08.11.2022 09:00 - 12:00, TAU Sähkötalo SA203 S2 auditorio (90) 15.11.2022 09:00 - 12:00, TAU Sähkötalo SA203 S2 auditorio (90) 22.11.2022 09:00 - 12:00, TAU Sähkötalo SA203 S2 auditorio (90) 29.11.2022 09:00 - 12:00, TAU Sähkötalo SA203 S2 auditorio (90)
Either SGN-12000, SGN-12001, SGN-12006 or SGN-12007 is a prerequisite.
Name: Introduction to Image and Video Processing
ECTS credits: 5
General scale, 0-5
Contact information Email: open.studies.tau [at] tuni.fi Phone: 0294 520 200