Music Visualiser Project

Student Name1: Aayush Gaur
Student Number1: C20396243

Student Name2: Ayan Abedin
Student Number2: D19125792

Student Name3: Raghav Bansal
Student Number3: D20123625

Student Name4: Khushboo Jayan
Student Number4: D20123668

Instructions

• Fork this repository.
• Clone it on your PC.
• Run the main.java file in the ie.tudublin package.
• You can switch between different visualisations using 0-6 keys.
• Pressing Space will restart the song
• Note: if the waterRipple (case 6) is too slow to render remove SPAN from fullscreen(P3D, SPAN) in visualiser.java.

Description of the assignment

This project uses .java files and processing to add an animated component to the audio file for visualization. It uses the beats, and frequency of the audio file to change the sketch and color effect.

How it works

The main function calls the visualiser.java class. Visualiser.java is the driver file for this project. It creates an object for each individual .java file. The render function of an object is called for the respective key pressed.

circle_obj = new circle(this);
musicViz_obj = new MusicViz(this);
oscilloscope_obj = new Oscilloscope(this);
luyu_obj = new LuYu(this);
circle_effect_obj = new circle_effect(this);
mesh_line_obj = new Mesh_Line(this);
waterRipple_obj = new waterRipple(this);

Our program works on the cases. We change between the cases manually using keys from 0-6. We used the fading effect to avoid any distortion and making the transitions smooth. This visualiser uses the concepts of polymorphism by classifying seven different classes and then creating an object of each individual class in the visualiser.java class and inistialises in setup and lastly, calling the render function that will then draw the expected sketch. Inside each individual class we again create a visualiser object that we later use in render function. Inheritence is used to call functions like startMinim() and other functions from the Visual class.

Some of the classes use a beatDetector to change visuals according to the beats. Lerped buffer is also used to get the spectrum to change according to the amplitudes of the song.

What we are most proud of in the assignment

We are proud of the overall project it was a bit challenging however, we had fun acquiring new processing and java skills. The challenges we overcame in the descending order are as follows:

• Water ripple effect - This was the most challenging part of the assignment was creating the ripple effect. Firstly we had to create the effect that we did using mousePressed() function later added the fading effect to it. Secondly, we made the effect automated and added to a background song. Lastly, the most crucial part was to create each water drop effect that can respond to the beat of the sound because multiple ripple effect were being drawn to the same beat as a result of multiple instruments being played at the same time.
• Transition between each case was done smoothly by using a fading effect. This was done by using a rectangle with an alpha fill value.

fill(0, 20);
noStroke();
rect(0, 0, pa.width, pa.height);

• Continuous change in colors in circle.java. This creates a vibrant RGB color palette.
• Creating the octopus effect using circles for LUYU.java.
• For oscilloscope.java create two distinct lines which represents the frequency band of the song and in addition to creation of two concentric circles that change their radii on the amplitude and frequency as well.
• Strings vibrating with the music, in every effect there is unique motion and transition.
• Our song is from the Assassins Creed Video games. So, we wanted to add blur background images after spending some time on implementing that part we observed that if we add background image there is a lag for drawing the sketch. As a result, we did not use background images for our Project. We learnt a lot about pixels and image processing. Our images are saved in Data folder as well as we have a java file that uses the pixel brightness effect to create an outline effect. Please checkout some cool images for assassins creed as well the the code it MusicViz.java file in 'Khushboo' and 'AyanAudio branch'.

Emphasis

Our motto for this project was to create something unique as a result we decided to develop the visualisation and transition on beats instead of creating the sketch and adding the music just as aa background. The color and effect changes on beats in addition to vibrant color patterns. We had an idea of transition effect that will change with every bit. Everytime when beats drops and then it goes up, we see a new effect in that effect, with a differeent color.

Project management

• We all work part-time jobs hence it was a bit difficult to get together at the same time hence we devoted the weekend nights as well as few weekdays nights for OOP project. Our study sessions streached for 10 hours till 6:00 or 7:00 am.
• We used ONENOTE to brainstorm ideas and were able to come up with different cases to be implemented in java.

Youtube video: