Understanding and optimizing Internet video delivery with self-driving networks

Video dominates today’s Internet and will play an even larger role going forward. Netflix users stream over 150 million hours of video per day, and video makes up more than half of the traffic on broadband networks. Networks struggle with handling this flood of traffic, wanting to simultaneously deliver high quality video to their users without letting it overwhelm other applications that require low latency service. Complicating matters, the network operators are stuck with outdated tools, and video is increasingly encrypted, giving little insight into which streams are behaving well and which might need help. In this project, we will develop techniques (based on machine learning and optimization methods) and conduct studies to understand the streaming video delivery ecosystem, addressing questions including: what strategies do services use to deliver video? Do simultaneous streams by different users (possibly using different streaming services) fairly share bandwidth, or do some crowd out others? How can operators infer the quality of experience they are providing to users when traffic is encrypted? Given that encrypted traffic, how can they design networks and traffic management techniques that automatically optimize video delivery, balancing bandwidth allocations to provide the best service possible to all users?

Dates: 6/1/2020 - 8/31/2020

Direct Supervisor: Thomas Koch (tak2154)

Paid: Yes

Credit: Yes

Hours per week: 20-40

Number of positions: 1

 

Qualifications/skill-set: programming experience, basic Linux experience.

Desired skills: Python, data science/Big Data processing, basic statistics, scripting

Eligibility: Junior, Senior, Master's (SEAS only)

Students should provide a brief 250 word description with reasons for interest in the project and goals for the summer. Please include your dates of availability for summer 2020 with hours per week, a CV, and an (unofficial) transcript. We are looking for students to spend 20-40 hours per week. A stipend or research credits may be available for qualified and experienced applicants.


Interested in applying?

The Internet under widespread shelter-in-place: Resilience, response, and lessons for the future

Email: columbia.networking.research+covid@gmail.com


Interested in applying?

Understanding and optimizing Internet video delivery with self-driving networks? Email:

Email: columbia.networking.research+video@gmail.com


Interested in applying to both projects? 

Email: columbia.networking.research+summer2020@gmail.com