Multimedia and Application (BIT429CO)
Multimedia data representations — audio/MIDI, image processing, video encoding, compression (JPEG/MPEG), real-time OS scheduling, and network streaming.
Unit 1: Multimedia Systems3 hrs
- Multimedia aspects and definitions, key elements of multimedia systems
- Continuous vs discrete media streams, characterization of multimedia systems
Unit 2: Sound and Audio4 hrs
- Physics of sound, sampling rate, quantization, and signal-to-quantization-noise ratio (SQNR)
- Audio file formats: WAV, MP3, AAC, FLAC
- MIDI protocol: messages, devices, synthesizers, and comparison with digital audio
- Speech processing: speech synthesis and recognition principles
Unit 3: Images and Graphics4 hrs
- Raster vs vector graphics representations
- Color models: RGB, CMYK, HSV, YUV, and color palettes
- Image file formats: BMP, GIF, PNG, TIFF, JPEG
- Basic image processing: spatial filtering, enhancement, and histogram equalization
Unit 4: Video and Animation4 hrs
- Television and video signals: Component, Composite, S-Video
- Analog broadcast standards (NTSC, PAL, SECAM) and digital video standards (HDTV, 4K)
- Principles of computer animation: keyframing, kinematics, morphing, and rendering
Unit 5: Data Compression6 hrs
- Lossless vs lossy compression fundamentals
- Entropy encoding: Run-length encoding (RLE), Huffman coding, Arithmetic coding, LZW
- Image compression: JPEG standard (DCT, quantization, entropy coding)
- Video compression: MPEG standards (I, P, B frames, motion estimation) and H.261/H.264
Unit 6: Optical Storage Media4 hrs
- Optical recording technology and track geometry
- CD-ROM, CD-R, CD-RW standards and logical formats (ISO 9660)
- DVD technology, DVD-Video, and Blu-Ray disc physical and logical specifications
Unit 7: Multimedia Operating Systems4 hrs
- Real-time processing requirements for continuous media
- Real-time scheduling algorithms: Earliest Deadline First (EDF) and Rate Monotonic (RM)
- Resource management, buffer management, and memory allocation in multimedia OS
Unit 8: Multimedia Communication Systems4 hrs
- Quality of Service (QoS) parameters: bandwidth, latency, jitter, packet loss rate
- Protocols for real-time transport: RTP, RTCP, RTSP, and RSVP
- Streaming media architectures, adaptive bitrate streaming (HLS, DASH), and CDN distribution
Unit 9: Documentation, Hypertext and MHEG4 hrs
- Hypertext and hypermedia concepts, nodes and links
- Document architecture standards: SGML, ODA (Open Document Architecture)
- MHEG (Multimedia and Hypermedia Information Coding Expert Group) standards
Unit 10: Synchronization4 hrs
- Notion of synchronization: intra-media vs inter-media synchronization
- Lip-sync synchronization requirements and skew limits
- Synchronization reference models and specification methods (interval-based, timeline-based)
Unit 11: Abstraction of Programming & Toolkits2 hrs
- Higher-level programming abstractions for multimedia objects
- Media frameworks and toolkits (DirectShow, GStreamer, QuickTime, WebRTC APIs)
Unit 12: Multimedia Applications2 hrs
- Video on Demand (VoD) system architectures and server scheduling
- Interactive video conferencing architectures and collaborative virtual environments
Reference books
- Steinmetz, Ralf and Klara Nahrstedt, Multimedia: Computing, Communications & Applications, Pearson Education.
- Li, Ze-Nian, Mark S. Drew, and Jiangchuan Liu, Fundamentals of Multimedia, Springer.
- Buford, John F. Koegel, Multimedia Systems, Addison-Wesley.
- Vaughan, Tay, Multimedia: Making It Work, McGraw-Hill Education.