Deep Reinforcement Learning for Equity Trading
Machine Learning
Mentors :
Sanyam Singhal
Mentees :
4
We will learn how does deep reinforcement learning works. We will then use it to find best trading strategies to maximize returns. Let us see if we can do better than pro-traders's strategies (aka technical analysis) :) . Some math and python programming background is all that you would need to get started with the project.
Prerequisites:
1. Python Programming: Prior exposure to Python is required as we would be using NumPy heavily. You should at least be comfortable with writing functions, loops, and classes.
2. Probability: Over and above the probability knowledge from pre-JEE days, understanding of concepts like expectation, understanding of common distributions like Gaussian, Poisson would be desirable.
3. Vector Calculus: MA109/111 recap is sufficient (mainly understand how gradient works).
Tentative Timeline :
| Week | Work |
|---|---|
| Week 1 | : RL Basics: MDP Formulation, some basic algorithms (theory). Stock market basics. |
| Week 2 | Implementing the studied algorithms in Python on some toy problem from OpenAI Gym. |
| Week 3 | Project Problem's MDP formulation+Data Scraping |
| Week 4 | Implementing studied algorithms for this problem and comparing the performance |
| Week 5 | Going Deep: Basics of Deep Learning (theory+python) |
| Week 6 | Understanding how to use Deep Learning in RL (theory+python) |
| Week 7-8 | Implementing Deep RL in our project problem |
| Week 9 | Benchmarking against rule based methods for trading. |
