Download - SSIP tools intro
![Page 1: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/1.jpg)
SSIP tools intro
Automatic Music Transcription & Traditional Instrument - Sopele
![Page 2: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/2.jpg)
Today’s goals
1. How AI can be used in Music
2. Learn a little bit about this region’s cultural heritage
3. Learn how to use Google Colab
![Page 3: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/3.jpg)
What is AMT?● Automatic Music Transcription
![Page 4: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/4.jpg)
Tone structure intro
![Page 5: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/5.jpg)
Frequency domain
![Page 6: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/6.jpg)
Time-frequency
![Page 7: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/7.jpg)
Sopele
● Descendant of the shawn which was very popular during medieval and renaissance period
● Shawn’s descendants are now found in Swiss Alps, Italian Apennines and in western Croatia
● Traditional hand-made woodwind instrument
● Piercing sound
● Always played in pair
![Page 8: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/8.jpg)
Istrian scale
● Hexatonic scale
● Small Sopila is a top voice and Great sopila is a low voice
![Page 9: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/9.jpg)
Specific instrument features
● Each Sopela can produce only six distinct tones
● 12 distinct tones in monophonic settings
● 12 + 36 non-permutative combinations = 49 combinations in polyphonic settings
● Handmade
● Sound characteristics depend on performer's ability to blow air
![Page 10: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/10.jpg)
Demo time
● Short song “Bela nedeja” (eng. “White Sunday”)○ “Bela nedeja” = traditional fair in the town of Kastav
● Adrian Filčić - great sopela
![Page 11: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/11.jpg)
Tone in frequency domain
Small tone 0 Great tone 0
![Page 12: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/12.jpg)
Results
![Page 13: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/13.jpg)
Whole process
*For more info read a full article: https://doi.org/10.1016/j.patrec.2019.09.024
![Page 14: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/14.jpg)
Google colab
● Free (Google account needed)● Colab resources are not guaranteed and not unlimited -> save locally or in the cloud what
is essential● Colab is based on open source project - Jupyter● Colab notebooks are stored on Google Drive● Offers GPU support -> only one notebook at the time
Let’s dive into it...
![Page 15: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/15.jpg)
Colab notebooks
1. Sopela example
● https://github.com/askoki/ssip/blob/main/SSIP_2021_sopele_get_started.ipynb
2. CNN - TF2
● https://github.com/tensorflow/docs/blob/master/site/en/tutorials/images/cnn.ipynb
![Page 16: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/16.jpg)
Import notebook from GitHub
1. Navigate to File→Open notebook or
https://colab.research.google.com/
2. Click on GitHub tab
3. Paste GitHub repository url
![Page 17: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/17.jpg)
Enable GPU
1. Navigate to Edit→Notebook Settings
2. Select GPU from the Hardware Accelerator
drop-down
![Page 18: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/18.jpg)
Projects - website
● Static website in .zip format
● https://html.com/resources/free-html-templates/
● Index.html / index.php as main site
![Page 19: SSIP tools intro](https://reader030.vdocument.in/reader030/viewer/2022020623/61f08b3f1e565034d362b1bf/html5/thumbnails/19.jpg)
Key takeaways
✅ Setting up Google Colab
✅ What is AMT?
✅ Is Sopela’s sound quiet and gentle?
✅ Structure for final project website