Data science at Netflix goes far beyond eponymous recommendation systems and touches every aspect of the business, from optimizing content delivery to fighting fraud. Netflix’s unique culture affords its data scientists extraordinary freedom of choice in tools, which results in an ever-expanding set of machine learning (ML) approaches and systems. In 2019, Netflix open-sourced Metaflow, its human-centric ML platform. In this session, Netflix shares some lessons learned in its multi-year journey building the ML systems that Metaflow incorporates, covering a diverse range of scale from one-time experimentation on laptops to large-scale model training and serving systems on AWS.

Now, using Amazon S3 as our data lake has paid off significant benefits for us over the years. It has allowed us to decouple compute from data storage, which means that now we can invest in different querying engines, different compute engines, and we can move as the industry moves."
Savin Goyal
Software Engineer, Netflix
AWS Services Used
Amazon S3
Amazon Simple Storage Service (Amazon S3) is an object storage service offering industry-leading scalability, data availability, security, and performance.
Explore Netflix's journey of innovation using AWS
More Netflix Stories
Total results: 28
no items found
-
United States
Netflix Drive: Cloud Filesystem in Studio Workflows
Learn about the architecture that provides Netflix artists with a secure, performant, and seamless storage interface using Amazon S3. -
United States
Netflix Accelerates Insights Using AWS SDK Instrumentation
Learn how Netflix Migrates application identity across AWS accounts and fills gaps in cloud data sources by instrumenting AWS SDKs to create new categories of visibility. -
United States
Netflix: Hybrid cloud approach to cataloging objects across storage systems
learn how Netflix tracks, stores and moves assets across its hybrid cloud consisting of object stores and file systems. -
United States
The Evolution of Chaos Engineering at Netflix
hear how Netflix has evolved chaos engineering into the discipline of infrastructure experimentation.
Get Started
Organizations of all sizes across all industries are transforming their businesses and delivering on their missions every day using AWS. Contact our experts and start your own AWS journey today.