Seasons Of Code

Gaming meets AI !!!    • Silky Kumari    • Ankit Kumar Jain   

WnCC - Seasons of Code

Seasons of Code is a programme launched by WnCC along the lines of the Google Summer of Code. It provides one with an opprtunity to learn and participate in a variety of interesting projects under the mentorship of the very best in our institute.


List of Running Projects

Gaming meets AI !!!

Gaming meets AI !!!


“Machine intelligence is the last invention that humanity will ever need to make.” ~Nick Bostrom Try out your hands on developing a superhuman AI to ace the game of 2048.

No. of mentees: 5

Description:

Fascinated by the potential of Reinforcement Learning? Want to leverage this potential on the challenging game 2048? Want to explore how the convolution of Neural Networks and Reinforcement Learning is turning out to be a game changer in the field of AI. Try out your hands on developing a superhuman AI to ace the game of 2048.

We will be developing an AI that can play the game 2048. The agent will be based on Deep Reinforcement Learning architecture Deep Q Network (DQN). We will also be developing our own game environment using Matplotlib or PyGame. We might as well use OpenAI Gym for the same.

It would require sound knowledge on Reinforcement Learning, Deep Learning, modern deep learning frameworks like Pytorch or Tensorflow, Python programming.

The pre-requisites are Python Basics, Machine Learning and Artificial Neural Networks. These aren’t hard prerequisites, if you are willing to spend time during the break to get a firm hold on these aspects of the project.

PROPOSAL

We expect you to cover the following aspects in your proposal. Previous knowledge in this domain Any projects that you have worked on ML/DL/RL. How much time per week would you be able to devote? Are you willing to read up the relevant material in the break? Why are you interested in this project?

RESOURCES

The famous Barto and Sutton book for Reinforcement Learning. You can find the PDF here. CS 234 : Reinforcement Learning on Stanford Engineering Channel on Youtube. DeepMind Atari research paper published in 2015.

Tentative Project Timeline

Week Number Tasks to be Completed
Week 1 Python basics and Python libraries like Matplotlib, numpy. Read about Python Object Oriented Programming.
Week 2 Brush up the basics of Deep Learning. Revisit tensorflow/pytorch Framework. Start reading RL from Barto and Sutton.
Week 3 Explore the architectures like DQN, DDQN from Stanford Engineering on Youtube. Develop the game environment using MatPlotlib
Week 4 Complete the code of vanilla DQN from scratch on the lines of DeepMind Atari research paper.
Week 5 Train on Google Colab or any other GPU resource and analyse the performance of other DRL based architectures

Checkpoints:

Checkpoint Number Progress
1 Read the first 6 chapters of the Barto and Sutton book.
2 Get familiar with DRL and explore the various architectures like DQN, DDQN
3 Develop the game environment using MatPlotlib/PyGame.
4 Complete the code of vanilla DQN from scratch.
5 Train and analyze the performance of other DRL based architectures on the gaming environment.