About the project
This is a robotic platform for developing an intelligent system for playing the drum. The project involves the mechanical design of the robotic arm, prototyping, control, and artificial intelligence used for learning drumming tasks.
The name of ZRob is inspired by the word "Zaraab" in Persian which literally means something that produces rhythm and beats.
Mechanics
All the body parts are designed and 3D-printed using state-of-the-art prototyping tools. The robot grippers contain passive springs for exploiting the natural dynamics of the drum membrane and the drum stick. One aim of the project is to explore different mechanical characteristics of the robot body such as stiffness of the gripper.
Control
The robots use quasi-direct drive servo motors, capable of torque adjustment with internal position, velocity and torque control modes. The control problem of the robots involves trajectory planning, sound-motion mapping, stable frequency and amplitude range of motion, and frequency adaptation.
AI
The primary purpose of the intelligent algorithm of the robotic system is to learn musical patterns and creative behaviour in drumming. The main approach for this purpose is Reinforcement Learning which makes the system capable of interacting with the environment.
Purpose
The aim of the project is to develop a robotic system that can learn drumming tasks through interaction with the environment. The interaction is based on adaptation to different physical constraints in the robot body and the dynamical behaviour of the environment. Some practical challenges involve synchronisation, motor learning, sound-motion mapping, and real-time training.
Main Approaches
- Analysis by Synthesis
- Reinforcement Learning
- Curiosity-based Learning
- Intrinsic Motivation
-
Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2024). Embodied intelligence for drumming; a reinforcement learning approach to drumming robots. Frontiers in Robotics and AI. ISSN 2296-9144. 11. doi: 10.3389/frobt.2024.1450097.
-
Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2023). Exploring Emerging Drumming Patterns in a Chaotic Dynamical System using ZRob. In Ortiz, Miguel & Marquez-Borbon, Adnan (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. Universidad Autónoma Metropolitana. ISSN 2220-4792. Full text in Research Archive
-
Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2022). A Robotic Drummer with a Flexible Joint: the Effect of Passive Impedance on Drumming. In Michon, Romain; Pottier, Laurent & Orlarey, Yann (Ed.), Proceedings of the 19th Sound and Music Computing Conference. SMC Network. ISSN 9782958412609. p. 232–237. doi: 10.5281/zenodo.6797833. Full text in Research Archive
-
Karbasi, Seyed Mojtaba; God?y, Rolf Inge; Jensenius, Alexander Refsum & T?rresen, Jim (2021). A Learning Method for Stiffness Control of a Drum Robot for Rebounding Double Strokes. In Zhang, Dan (Eds.), 2021 7th International Conference on Mechatronics and Robotics Engineering (ICMRE). IEEE. ISSN 978-0-7381-3205-1. p. 54–58. doi: 10.1109/ICMRE51691.2021.9384843. Full text in Research Archive
-
Karbasi, Seyed Mojtaba; Haug, Halvor Sogn; Kvalsund, Mia-Katrin; Krzyzaniak, Michael Joseph & T?rresen, Jim (2021). A Generative Model for Creating Musical Rhythms with Deep Reinforcement Learning. In Gioti, Artemi-Maria (Eds.), The Proceedings of 2nd Conference on AI Music Creativity. Proceedings of Joint Conference on AI Music Creativity (CSMC + MuMe). ISSN 978-3-200-08272-4. doi: 10.5281/zenodo.5137900. Full text in Research Archive