Data science at Netflix goes far beyond eponymous recommendation systems and touches every aspect of the business, from optimizing content delivery to fighting fraud. Netflix’s unique culture affords its data scientists extraordinary freedom of choice in tools, which results in an ever-expanding set of machine learning (ML) approaches and systems. In 2019, Netflix open-sourced Metaflow, its human-centric ML platform. In this session, Netflix shares some lessons learned in its multi-year journey building the ML systems that Metaflow incorporates, covering a diverse range of scale from one-time experimentation on laptops to large-scale model training and serving systems on AWS.

Now, using Amazon S3 as our data lake has paid off significant benefits for us over the years. It has allowed us to decouple compute from data storage, which means that now we can invest in different querying engines, different compute engines, and we can move as the industry moves."
Savin Goyal
Software Engineer, Netflix
AWS Services Used
Amazon S3
Amazon Simple Storage Service (Amazon S3) is an object storage service offering industry-leading scalability, data availability, security, and performance.
Explore Netflix's journey of innovation using AWS
More Netflix Stories
Total results: 28
no items found
-
United States
Netflix Catalogs Objects Across Hybrid Cloud Storage Systems
In this re:Invent 2022 session, learn how Netflix uses a hybrid cloud storage solution that combines Amazon Web Services (AWS) and on-premesis storage. -
United States
Netflix Operates Mission-Critical Data Stores on AWS
Learn how distributed database engineers have established tools, techniques, and approaches on Amazon Web Services (AWS) to debug and mitigate failures. -
United States
Netflix Uses Amazon FSx for Large-Scale Distributed Training of Media Machine Learning
In this AWS re:Invent 2021 session, learn about the challenges of scalable distributed training of media machine learning (ML) models on multi-GPU nodes used by Netflix. -
United States
More Data Science with Less Engineering: ML Infrastructure at Netflix
In this AWS re:Invent session, Netflix shares its human-centric design principles that provides its engineers with autonomy.
Get Started
Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today.