WnCC - Seasons of Code
Seasons of Code is a programme launched by WnCC along the lines of the Google Summer of Code. It provides one with an opprtunity to learn and participate in a variety of interesting projects under the mentorship of the very best in our institute.
List of Running Projects
- Browser Based PDF manager
- Resume Script Generator
- Physicc : A Simple Physics Engine
- Image Colorization
- Language Model Based Syntax Autocompletion in a Text Editor
- Computer vision based web app
- Cribbit Cribbit (Open for PGs Only)
- Techster Texter
- Language Detection
- Book Tracker
- ResoBin - Not the bin we deserve but the bin we need!
- Agree to disagree
- Watson (World's smartest assistant in your pocket)
- Meta Learning - Learning to Learn
- Break free of the matrix, by building one!
- Procedurally Generated Infinite Open World
- Introduction to App Development
- PAC MAN
- Introduction to Web Development
- Goal ICPC
- Traffic congestion modelling and rendering
- Tools for Data Science
- Machine Learning Based Metropolitan Air Pollution Estimation
- Audio controlled drone
- NLPlay with Transformers
- DIY FaceApp
- A Deep Dive into CNNs
- Competitive Coding
- Snake AI
- Facial Recognition App
- Gaming meets AI !!!
- R(ea)L Trader
- Computational Geometry
- Deep reinforcement learning - 2048 AI
- Reinforcement Learning to Finance
- Developing Hybrid ANN-Statistical Model for Robust Stock Market Prediction
- Astronomical Data-modelling and Interpretation
- Visual Perception for Self Driving Cars
- Convolutional Neural Networks and Applications
- Quantum Computing Algorithms
- Algorithm Visualizer
- Anime Club IITB Website using Django
- Machine Learning in Browser
“Machine intelligence is the last invention that humanity will ever need to make.” ~Nick Bostrom Try out your hands on developing a superhuman AI to ace the game of 2048.
No. of mentees: 5
Fascinated by the potential of Reinforcement Learning? Want to leverage this potential on the challenging game 2048? Want to explore how the convolution of Neural Networks and Reinforcement Learning is turning out to be a game changer in the field of AI. Try out your hands on developing a superhuman AI to ace the game of 2048.
We will be developing an AI that can play the game 2048. The agent will be based on Deep Reinforcement Learning architecture Deep Q Network (DQN). We will also be developing our own game environment using Matplotlib or PyGame. We might as well use OpenAI Gym for the same.
It would require sound knowledge on Reinforcement Learning, Deep Learning, modern deep learning frameworks like Pytorch or Tensorflow, Python programming.
The pre-requisites are Python Basics, Machine Learning and Artificial Neural Networks. These aren’t hard prerequisites, if you are willing to spend time during the break to get a firm hold on these aspects of the project.
We expect you to cover the following aspects in your proposal. Previous knowledge in this domain Any projects that you have worked on ML/DL/RL. How much time per week would you be able to devote? Are you willing to read up the relevant material in the break? Why are you interested in this project?
The famous Barto and Sutton book for Reinforcement Learning. You can find the PDF here. CS 234 : Reinforcement Learning on Stanford Engineering Channel on Youtube. DeepMind Atari research paper published in 2015.
Tentative Project Timeline
|Week Number||Tasks to be Completed|
|Week 1||Python basics and Python libraries like Matplotlib, numpy. Read about Python Object Oriented Programming.|
|Week 2||Brush up the basics of Deep Learning. Revisit tensorflow/pytorch Framework. Start reading RL from Barto and Sutton.|
|Week 3||Explore the architectures like DQN, DDQN from Stanford Engineering on Youtube. Develop the game environment using MatPlotlib|
|Week 4||Complete the code of vanilla DQN from scratch on the lines of DeepMind Atari research paper.|
|Week 5||Train on Google Colab or any other GPU resource and analyse the performance of other DRL based architectures|
|1||Read the first 6 chapters of the Barto and Sutton book.|
|2||Get familiar with DRL and explore the various architectures like DQN, DDQN|
|3||Develop the game environment using MatPlotlib/PyGame.|
|4||Complete the code of vanilla DQN from scratch.|
|5||Train and analyze the performance of other DRL based architectures on the gaming environment.|