Deep Reinforcement Learning for Equity Trading


  • Machine Learning


Mentors :

  • Sanyam Singhal

Mentees :

  • 4


We will learn how does deep reinforcement learning works. We will then use it to find best trading strategies to maximize returns. Let us see if we can do better than pro-traders's strategies (aka technical analysis) :) . Some math and python programming background is all that you would need to get started with the project.
Prerequisites: 1. Python Programming: Prior exposure to Python is required as we would be using NumPy heavily. You should at least be comfortable with writing functions, loops, and classes. 2. Probability: Over and above the probability knowledge from pre-JEE days, understanding of concepts like expectation, understanding of common distributions like Gaussian, Poisson would be desirable. 3. Vector Calculus: MA109/111 recap is sufficient (mainly understand how gradient works).

Tentative Timeline :

Week Work
Week 1 : RL Basics: MDP Formulation, some basic algorithms (theory). Stock market basics.
Week 2 Implementing the studied algorithms in Python on some toy problem from OpenAI Gym.
Week 3 Project Problem's MDP formulation+Data Scraping
Week 4 Implementing studied algorithms for this problem and comparing the performance
Week 5 Going Deep: Basics of Deep Learning (theory+python)
Week 6 Understanding how to use Deep Learning in RL (theory+python)
Week 7-8 Implementing Deep RL in our project problem
Week 9 Benchmarking against rule based methods for trading.