Video Super Resolution


  • Machine Learning, Image Processing


Mentors :

  • Kartik Gokhale & Hastyn Doshi

Mentees :

  • 4


Want to watch a movie in 4k ultra HD when it was available only up to 720p? Welcome to Video Super Resolution! Here, we are going to delve into the field of super resolution using deep learning algorithms where we try to create higher resolution videos from lower resolution data. Yes, this seems baffling. You might be confused as to how is this even possible.

Existing video super-resolution (SR) algorithms usually assume that the blur kernels in the degradation process are known and do not model the blur kernels in the restoration. However, this assumption does not hold for blind video Super Resolution and usually leads to over-smoothed super-resolved frames. We will be creating models and developing algorithms which assume an unknown blur kernel and motion fields.
Through the course of this project, you will explore Machine Learning and Deep Learning techniques. You will also pick up image processing and implement some state-of-the-art techniques in this field.
Needless to say, this project will be rather loaded and requires a lot of time commitment. However, the results you will obtain will be quite satisfying and the skills you will learn will be invaluable.
Prerequisites: Desire to see the project to completion and be involved in implementing state-of-the-art techniques. Loads of Enthusiasm :) (Goes without saying) Prior coding experience is recommended but not necessary. The proposal will be in the form of an assignment. Instructions are within the assignment document. Note that this project will have a steep learning curve and will be time-intensive. Assignment Link: https://docs.google.com/document/d/1Ezg29iZ366F7_mTPoBCRQsbg8UTmSezcBiElHYm2SEw/edit?usp=sharing

Tentative Timeline :

Week Work
Week 1 Python basics + Data Analysis, Get familiar with version control (Git and Github)
Week 2 Introduction to Machine Learning and Associated Libraries
Week 3 Deep Learning + Some Image Processing
Week 4 Implementing Convolutional Neural Networks
Week 5 Catch Up + Super Resolution with Known Blur Kernels
Week 6-7 Video Super Resolution with Unknown Blur Kernels and Motion Fields
Week 8 Documenting Results + Finishing Up