Subject description - AD2B31SMS

Summary of Study | Summary of Branches | All Subject Groups | All Subjects | List of Roles | Explanatory Notes               Instructions
AD2B31SMS Multimedia signal synthesis Extent of teaching:14KP+6KC
Guarantors:  Roles:PO,V Language of
teaching:
CS
Teachers:  Completion:Z,ZK
Responsible Department:13131 Credits:6 Semester:Z

Anotation:

This course introduces the fundamentals of sound synthesis algorithms (everyday, music and speech), digital audio effects and sonification. Multimedia synthetic signals are used in modern digital systems, virtual reality systems, computer animations, games and film. Understanding of theoretical concepts will be consolidated through practical programming assignments in Matlab.

Study targets:

Cílem studia je získání teoretických základů a praktického osvojení základních metod číslicové syntézy multimediálních signálů.

Course outlines:

1. Introduction to digital audio signal synthesis; musical scale generator
2. Wavetable synthesis; time expansion and compression, time envelopes
3. Concatenative and granular synthesis; parameters, synchronous and asynchronous
4. Additive synthesis and spectral modelling; periodical nonharmonic signals
5. Phase vocoder; signal modification in frequency domain
6. Subtractive synthesis; excitation sources, simple filters, equalizers, color noise
7. Formant synthesis; Klatt synthesizer, cascade and parallel configuration, FOF
8. Linear prediction; cross synthesis speech and music, non-speech sound modelling
9. Modulation synthesis; AM, tremolo, FM, vibrato, alarm, everyday sounds and tools
10. Nonlinear and waveshaping synthesis; Chebyshev polynomials, limiters, distortion
11. Delay effects; echo, reverb, comb and all-pass filters
12. Spatial effects; Doppler effect, panning, hall, Schroeder?s reverb
13. Introduction to physical modelling; digital waveguides, Karplus-Strong algorithm
14. Sonification of biological signals (ECG, EMG, EEG, FCG, EOG), applications

Exercises outline:

1. Musical scale, Morse code; aliasing, quantization and compression simulation
2. Time and frequency scale modification, clarinet and banjo wavetable synthesis
3. Concatenative speech synthesis, "sci-fi" sound synthesis
4. Birdcall, brass, bells, gongs, cymbals, banjo, cllarinet and phone synthesis
5. Length changes of audio signals, pitch shift, noise enhancement
6. Synthesis of percussion, plane, wind, waves, violin, steps , consonant "s"
7. Formant synthesis of vowels, music instrument and animal voice
8. Speech, guitar, piano and hammer resynthesis; "cross" synthesis music and speech
9. Vibrato, tremolo, coins, bubles, alarms, klepání, dřevo, klarinet, žestě, zvony
10. Application of waveshaping to plucked string instruments, percussion and speech
11. Digital reverb implementation (cellar, shover, cathedral)
12. Spatial effects in sérech and music
13. Guitar, harp, piano and drums synthesis
14. Sonification of EEG, ECG, FCG, EMG

Literature:

Miranda, E.R.: Computer Sound Design, ISBN 0-240-51693-1, Focal Press, Oxford, 2002 Zölzer, U.: DAFX - Digital Audio Effects, ISBN: 0-471-49078-4, John Wiley & Sons, 2002

Requirements:

Podmínkou udělení zápočtu je vypracování vybrané úlohy v MATLABu.

Webpage:

http://sami.fel.cvut.cz/sms/

Keywords:

Sound syntesis

Subject is included into these academic programs:

Program Branch Role Recommended semester
BKOI1 Computer Systems V 5
BKOI_BO Common courses V 5
BKOI3 Software Systems V 5
BKOI2 Computer and Information Science V 5
BKKME2 Multimedia Technology PO 5
BKEEM1 Applied Electrical Engineering V 5
BKEEM_BO Common courses V 5
BKEEM2 Electrical Engineering and Management V 5
BKKYR1 Robotics V 5
BKKYR_BO Common courses V 5
BKKYR3 Systems and Control V 5
BKKYR2 Sensors and Instrumentation V 5
BIS(ECTS)-D Intelligent Systems V 5
BKSTMWM Web and Multimedia V 5
BKSTMSI Software Engineering V 5
BKSTMMI Manager Informatics V 5
BKSTMIS Intelligent Systems V 5
BKSTM_BO Common courses V 5
BSI(ECTS)-D Software Engineering V 5
BWM(ECTS)-D Web and Multimedia V 5
BMI(ECTS)-D Manager Informatics V 5


Page updated 6.12.2019 17:52:32, semester: Z,L/2020-1, L/2018-9, Z,L/2019-20, Send comments about the content to the Administrators of the Academic Programs Proposal and Realization: I. Halaška (K336), J. Novák (K336)