Netflix & Amazon Kinesis Streams Case Study
Netflix uses Amazon Web Services (AWS) for nearly all its computing and storage needs, including databases, analytics, recommendation engines, video transcoding, and more—hundreds of functions that in total use more than 100,000 server instances on AWS.
This results in an extremely complex and dynamic networking environment where applications are constantly communicating inside AWS and across the Internet. Monitoring and optimizing its network is critical for Netflix to continue improving customer experience, increasing efficiency, and reducing costs. In particular, Netflix needed a solution for ingesting, augmenting, and analyzing the multiple terabytes of data its network generates daily in the form of virtual private cloud (VPC) flow logs. This would enable Netflix to identify performance-improvement opportunities, such as identifying apps that are communicating across regions and collocating them. The company would also be able to increase uptime by quickly detecting and mitigating application downtime.
Each log record carries information about the communications between two IP addresses. However, in a dynamic environment like the one at Netflix, where an IP address can float between applications from day to day or even minute to minute, IP addresses alone don’t have much meaning. “The data sources we had before we took on this initiative were one sided,” says John Bennett, senior software engineer at Netflix. “We’d know an application was connecting to others, but we didn’t know both sides of the conversation and how to optimize those communications or the placement of the applications on the network.”
Netflix set out to establish a new data source that could give it more insight into communication among applications and regions by combining VPC flow logs with application metadata.
相關推薦
Netflix & Amazon Kinesis Streams Case Study
Netflix uses Amazon Web Services (AWS) for nearly all its computing and storage needs, including databases, analytics, recommendation engin
Netflix 和 Amazon Kinesis Streams 案例研究
Netflix 使用 Amazon Web Services (AWS) 來滿足幾乎所有計算和儲存需求,包括資料庫、分析、建議引擎、視訊編碼和數百種功能,總共使用 AWS 上 100000 多個伺服器例項。 這導致極其複雜的動態聯網環境,應用程式在
Amazon Prime Video Case Study
Amazon Prime Video measured the fan viewing experience by using video-stream metrics. “We paid close attention to the reliability of the video
Amazon Wallet Service Case Study
Wallet must work all the time—even during a migration. Amazon sought to eliminate any impact on customer transactions, maintain complete data
Amazon Financial Systems Case Study
Across its many business entities, Amazon processes more than 20 billion financial transactions each month, including accounts receivable,
新增:Amazon Kinesis Streams 伺服器端加密
在這個智慧家居、大資料、物聯網裝置、手機、社交網路、聊天機器人和遊戲機的時代,流媒體資料場景無處不在。利用,您可以構建自定義應用程式,以便從數千個流媒體資料來源捕獲、處理、分析和儲存每小時數 TB 的資料。由於 Amazon Kinesis Streams 允許應用程式從同一個 Kinesi
FICO CSS Amazon Polly Video Case Study
Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So
New: Server-Side Encryption for Amazon Kinesis Streams
In this age of smart homes, big data, IoT devices, mobile phones, social networks, chatbots, and game consoles, streaming data scenarios are every
Amazon Kinesis Data Streams Resources
This is a pre-built library that helps you easily integrate Amazon Kinesis Data Streams with other AWS services and third-party tools. Amazon Ki
Amazon Kinesis Data Streams getting started
Reducing the time to get actionable insights from data is important to all businesses and customers who employ batch data analytics tools are exp
Disc Jam Case Study: Supporting a Mission for Fast-Paced Competitive Gameplay with Amazon Gamelift
About High Horse Entertainment Having gained over 20 years’ experience at both Treyarch and Activision, where they worked on succ
Amazon Kinesis Data Streams FAQs
Q: What is an Amazon Kinesis Application? An Amazon Kinesis Application is a data consumer that reads and processes data from an Amazon
Building a Data Processing Pipeline with Amazon Kinesis Data Streams and Kubeless
If you’re already running Kubernetes, FaaS (Functions as a Service) platforms on Kubernetes can help you leverage your existing investment in EC2
Amazon.com Case Study
Elimination of complex and time-consuming tape capacity planning. Amazon.com is growing larger and more dynamic each year, both organically an
Amazon Kinesis Data Streams News
Two years ago we introduced Amazon Kinesis, which we now call Amazon Kinesis Streams, to allow customers to build applications that collect,
Amazon Kinesis Data Streams Pricing
Let’s assume that our data producers put 100 records per second in aggregate, and each record is 35KB. In this case, the total data input rate is
Edmunds Amazon Macie Case Study
By taking advantage of Macie, Edmunds can better discover, classify, and protect its data, giving administrators actionable information about p
Netflix & AWS Lambda Case Study
Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So
Brooks Brothers Amazon Chime Case Study
Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So
Amazon Web Services (AWS)AWS Case Study: MiHiN
Using AWS, MiHIN can scale without limit to support increasing volumes of patient information from healthcare providers and payers. “We’re that