Teaching

HS14: Multimedia Systems (BINF31bb, part of BINF3101)

Organisation

Lecturer: Prof. Dr. Renato Pajarola
Assistents: Michailidis Georgios-Tsampikos
Time: Lecture: Thursday 14-15:45, Exercises: Monday 16-18
Room: Binzmühlestrasse: BIN TBA, (BIN 0.B.04 Exercises)
Language: English
Exercises: The exercises are biweekly and start in the 2nd semester week (on Monday, 22.09.).
OLAT: Olat course link
Course Catalogue: Catalogue course link

Overview

Multimedia and visual data processing is central to todays information technology world. In this lecture the fundamental concepts of multimedia data such aus audio, image, video and 3D graphics data representation, processing and display will be presented. Additionally, the basic principles of interactive data visualization will be introduced. Lectures include theoretical concepts and additional practical exercises.

The lecture is targeted to students with an assessment level BSc in computer science or similar basic knowledge of computer science, programming, data structures and algorithms. It is recommended for the BSc students in the 5th or possibly 3rd semester.

The exercises will be done in Java/Javascript languages using the Processing Development Environment (PDE). They will include the development of programs (or parts of them) either for embedding them as web content in a webpage or as pure Java programs. Based on the PDE, for the exercise's programs development, additional Java image and audio libraries, as well as basic Java core libraries, will be used. Introduction material and example codes for Java/Javascript programming and the additional image/audio libraries will be provided during the courses.

Content

Foundations of multimedia data representation and processing such as digital signal representation, color theory, image and video processing as well as data visualization. A topic overview and corresponding relevant literature is given in this document:

Tentative Lecture Topic Outline (PDF, 84 KB)

  • Sampling and Digitalization
  • Audio
  • Color and Images
  • Image Processing
  • 3D Graphics
  • Interactive Data Visualization
  • Data Compression

Course Electronic Mail

It is a standing assignment that each course participant has verified that his email contact information has been deposited with the teaching assistant. The class mailing list will be used for official announcements such as class deadlines or distribution of homeworks. Register here via the OLAT course link (see top of page).

Literature

  1. Fundamentals of Multimedia by Li and Drew, 2004, Pearson Prentice Hall, ISBN 013127256X.
  2. Digital Image Processing by Gonzales and Woods, 2001, Prentice Hall.
  3. Mathematical Principles for Scientific Computing and Visualization by Farin and Hansford, 2008, AK Peters.
  4. Interactive Data Visualization: Foundations, Techniques and Aplications by Ward, Grinstein and Keim, 2010, AK Peters.
  5. Mathematics for Multimedia by Wicherhauser, 2004, Elsevier Academic, ISBN 0-12-748451-1.
  6. Digital Multimedia 2nd Edition by Chapman and Champan, 2004, Wiley, ISBN 0-470-85890-7.
  7. Learning Processing: A Beginner's Guide to Programming Images, Animation, and Interaction, 2008, Morgan Kaufmann Series in Computer Graphics, ISBN 0123736021.
  8. Getting Started with Processing, 2010, Maker Media Inc., ISBN 144937980X.

As a standing homework assignment you are expected to review the corresponding book chapters after the lectures.

Completion Requirements

Reading

As a standing homework assignment you are expected to read the corresponding book chapters before the lectures and to review the material thoroughly after the lectures covering them.

Homework

To take part in the final written exam, students must have completed a minimum number of homework assignments. The programming projects must be submitted in the appropriate compatible source code as indicated in the exercise requirements (that compiles and run under Linux/Mac OS X) to the assistant leading the exercises.

Exam

The lecture will be completed with a written exam at the end of the semester. The exam is scheduled according to the standard UZH/OEC/IFI regulations. See also the course catalogue link at the top of the page.

Lecture outline, Exercises and Documentation

(tentative schedule - subject to changes)

Schedule Topics Slides Exercises
Week 1 Sampling All slides and exercises can be found on OLAT.
Week 2 Audio
Week 3 Color
Week 4 Images
Week 5
Week 6 Image Processing
Week 7
Week 8
Week 9 Video
Week 10 3D Graphics
Week 11 Data Visualization
Week 12
Week 13 Image Compression
Week 14 Video Compression

Additional Material

  • Processing Developement Environment (PDE) homepage.