MIC0012 | Audio-video Communication in High-speed Networks |
Teaching Staff in Charge |
Lect. STERCA Adrian Ioan, Ph.D., forestcs.ubbcluj.ro |
Aims |
The goal of this course is getting the student acquainted with concepts and technologies used in audio-video communication in analog networks, satellite or terrestrial, and most importantly in digital $best-effort$ networks based on IP (e.g. the Internet). During the semester students will study: audio-video codecs and digital formats, audio-video streaming fundamentals in the Internet (signaling and streaming protocols, flux control) and the basics of audio-video satellite communication. |
Content |
1. Introduction.
1.1 Introduction to multimedia 1.2 Color spaces 1.3 Analog representation of audio and video signals 1.4 Digital image representation. The JPEG standard 1.5 Digital representation of audio signals 2. Audio-video formats (containers) and codecs 2.1 AV containers: .avi, .ogg, .mp4, .vob, .3gp, .mkv 2.2 MPEG-1,2,4 2.3 H.264/MPEG-4 AVC 3. Streaming and signaling protocols 3.1 RTP/RTCP – Real Time Protocol 3.2 RTSP – Real Time Streaming Protocol 3.3 SDP – Session Description Protocol 3.4 SIP – Session Initiation Protocol 4. Congestion control algorithms for audio-video applications in best-effort networks 4.1 TCP AIMD (Additive Increase Multiplicative Decrease) 4.2 DCCP – Datagram Congestion Control Protocol 4.3 TFRC – TCP-Friendly Rate Control 4.4 UTFRC – Utility-driven TCP-Friendly Rate Control 5. Voice over IP 6. udio-video communication in satellite networks 6.1 Satellite communication 6.2 Frequency bands 6.3 DBS – Direct Broadcast Satellite (Direct-To-Home) 6.4 DVB standards: DVB-S (satellite), DVB-T (terrestrial), DVB-C (cable) 7. The FFMpeg library 7.1 libavcodec 7.2 libavformat 7.3 libswscale 7.4 libavfilter 8. Multimedia QoS in Internet 8.1 QoS terminology 8.2 QoS requirements in best-effort networks 9. P2P TV 9.1 Peer-2-Peer networks 9.2 DHT – Distributed Hash Tables 9.3 Applications |
References |
1.Al Bovik, The Essential Guide to Video Processing, Academic Press, Elsevier, 2009.
2.L. Hanzo, P. Cherriman, J. Streit, Video Compression and Communications. From Basics to H.261, H.263, H.264, MPEG4 for DVB and HSDPA-Style Adaptive Turbo-Transceivers, Wiley & IEEE Press, 2007. 3.A. Sterca, Congestion Control for Streaming Protocols, PhD Thesis, 2008. 4.Iain Richardson, Video Codec Design, Wiley, 2002. 5.Iain Richardson, H.264 and MPEG-4 Video Compression, Wiley, 2003. 6.Colin Perkins, RTP – Audio and Video for the Internet, Addison-Wesley, 2003. |
Assessment |
During the semester, students will have to implement a medium-complexity software from the multimedia (audio-video) field based on the FFMPEG library. E.g.: audio-video player enhanced with several output filters and surfaces, simple audio or video codec, video surveillance system etc. Also the student will have to write a report related to the topics of his software project aforementioned.
The final grade will be: 60% the project grade + 40% the report grade The course requirements will be available at: http://www.cs.ubbcluj.ro/~forest/cav |
Links: | Syllabus for all subjects Romanian version for this subject Rtf format for this subject |