Seasons Of Code

Audio controlled drone    • Rishabh Khantwal   

WnCC - Seasons of Code

Seasons of Code is a programme launched by WnCC along the lines of the Google Summer of Code. It provides one with an opprtunity to learn and participate in a variety of interesting projects under the mentorship of the very best in our institute.

List of Running Projects

Audio controlled drone

Audio controlled drone

The project will aim more towards Machine learning on the Audio dataset, and the drone would only be used as an application.

No. of mentees: 2-3

Description: Work would start by getting familiar with Px4, Gazebo, and ROS. Students will prepare the audio dataset consisting of 10 most used commands for controlling the drone, such as “take-off,” “hover,” and “land.” The main task would be to implement the most common and effective CNN architectures for audio classification. The model would be continuously tested using a proper validation set. The project could be extended to one of the problems depending on the pace of the project, 1) Getting high accuracy on multiple Indian accents 2) Giving custom commands to drone ( Move up with Medium speed)

The mentees should have previous working experience on any deep learning project. The proposal should contain titles of all the machine learning courses or projects you have done before.

Tentative Project Timeline

Week Number Tasks to be Completed
Week 1 Basic of gazebo, dataset preparation
Week 2 Audio data analysis
Week 3 CNN and RNN based Model testing
Week 4 Testing on drone and making proper documentation
Week 5-6 Working on one of extra problems


Checkpoint Number Progress
1 Running Gazebo
2 Running px4
3 Dataset preparation
4 Model Testing
5 Documentation