Digital Interactive Sound & Intermedia Studio
Virginia TechCollege of Liberal Arts and Human SciencesSchool of Performing ArtsICATCHCI

"And so the arts are encroaching upon one another, and from a proper use of this encroachment will rise the art that is truly monumental."
--Wassily Kandinsky

IMPORTANT! Please note that the syllabus is subject to change. Should such a change occur, it will be announced in the Latest Updates section and/or the course mailing list. For this reason, you are strongly encouraged to check this site frequently for changes. Last Updated

Computer Music & Multimedia Design Syllabus (MUS3066, MUS5984 graduate course)
Time: T R 11:00 AM - 12:15 PM
Classroom: DISIS
Instructor: Dr. Ivica Ico Bukvic
Office: Henderson 313
Office Hours: By appointment only
Instructor Email: ico_AT_vt_DOT_edu
Course Mailing List: MUS3066_15473@listserv.vt.edu

Latest Updates
01/28/15 -- Added mailing list info.
01/19/15 -- Syllabus posted online.

Course Objectives
We live in a digital age. Our sensory mechanisms perceive their respective inputs as seemingly disparate modalities. Yet, the same modalities when perceived by computer become an indistinguishable fabric of zeros and ones giving us unique opportunities for seamless mapping of such modalities across the different domains.

In this course we will explore interactivity and its ability to bridge different modalities. We will study real-time digital signal processing techniques with particular focus on sound and visuals, seek deeper understanding of algorithmic approach to content creation and manipulation, interactivity, as well as introduction to video and 3D content design and integration utilizing Cycling 74's Max/MSP/Jitter and pd-l2ork visual rapid prototyping programming environments specifically designed to provide easier access to non-programmers and yet do so without sacrificing the depth or flexibility of traditional programming environments. By the end of the spring semester, participating students will attain a solid foundation in utilizing Max/MSP/Jitter and pd-l2ork for various multimedia-oriented tasks, including interactive multimedia composition, installation art, gaming, as well as the design and development of interactive embedded systems using Raspberry Pi and Arduino.

Course Overview
The goal of this course is to teach you how to use Max/MSP/Jitter and pd-l2ork software for creative and/or production purposes. In this semester we will focus on the following components:

•  Digital Signal Processing
       Synthesis
       Real-time input
       FFT-based signal processing
       Advanced interaction techniques
•  Intro to Jitter
       Video
       3D Content
       Cross-pollinating aural and visual
•  Hyperinstrument design and performance
       Interacting with ubiquitous technologies
       Kinect, Leap Motion, cameras, etc.
•  Aesthetics of interactive multimedia art
       Preformance-based
       Installations
Embedded real-time systems
       Raspberry Pi
       Arduino

As the semester progresses, we will continue our shift away from "technical" and towards "creative," spending more and more time on discussion, listening, structure and analysis, as well as practical uses of the newly acquired knowledge.

Evaluation and Grading
Students will be graded based upon the following criteria:

•  Assignments   40%
•  Final Project   50%
•  Homework/Participation   10%

Your grade will consist solely of creative assignments utilizing various software. There will be three smaller assignments (exercises), and a final project. Apart from the technical aspect, the final project will contain a strong creative component. There will be also homework assigned as needed, usually on a weekly basis. Its purpose will be to encourage students to use software consistently. Max/MSP/Jitter and pd-l2ork, just like any other language is best learned through use.

IMPORTANT! All graded late assignments will be assessed 10% grade penalty for every day they are late (e.g. an assignment that is 2 days late will be assessed a 20% grade penalty). Please note this penalty will be assessed per each calendar day, not per each class the assignment is late.

Course Materials
•  Max/MSP/Jitter (Mac/Winows)
•  pd-l2ork (currently Linux only)
•  Supporting software documentation

Please note that you will not be required to purchase any software for this class as all of the aforesaid software will be available on the workstations in the new studio. Furthermore, pd-l2ork is completely free software. Should you decide, however, to purchase your own personal copy, please talk to me prior to doing so as multiple licenses purchased simultaneously (i.e. by more than one student) may generate significant discounts.

Requirements
•  Internet access
•  A Valid VT Email Account

IMPORTANT! Please note that some of the software used in this class may be available as demo that will expire after a preset amount of time. Once such software expires, it will become either partially functional or inaccessible. Either way, it will be student's responsibility to keep track of this particular issue and as such, this limitation will not be viewed as a valid excuse for belated submission of assignments.

Accommodations
Any student who feels that he or she may need an accommodation because of a disability (learning disability, attention deficit disorder, psychological, physical, etc.) please make an appointment to see me as soon as possible.

Course Calendar
Below are important dates which are to be noted on your calendars:

•  Individual assignment due dates will be communicated via the class mailing list
May 4, Final Projects Showcase (details will be communicated via the class mailing list)

Please make note of the calendar with important dates listed on the registrar's webiste and plan accordingly. The registrar's calendar can be found here.

Assignments
All assignments will be communicated via the class mailing list.

Files
All relevant materials will be emailed through the class mailing list.