All 7 Amazon Kinesis & Data Streaming questions
More in Amazon Kinesis & Data Streaming
What is Amazon Kinesis and what type of problems does it solve? What is a shard in Kinesis Data Streams, and how does it affect throughput? How does the partition key affect how records are distributed across shards in Kinesis? How do consumer applications read and process data from a Kinesis Data Stream? What is enhanced fan out in Kinesis Data Streams, and why is it useful for multiple consumers? How does data retention and replay work in Kinesis Data Streams?
Advertisement
AWS › Amazon Kinesis & Data Streaming

What is the difference between Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Data Analytics?

Beginner

Answer

Kinesis Data Streams is the core service for capturing and storing streaming data that you process using your own custom consumer applications, Kinesis Data Firehose is a fully managed service that automatically loads streaming data into destinations like S3 or Redshift without you managing any consumer code, and Kinesis Data Analytics lets you run SQL or Apache Flink queries directly against streaming data to perform real time analysis and transformations.
aws firehose create-delivery-stream --delivery-stream-name my-firehose --s3-destination-configuration RoleARN=arn:aws:iam::123456789012:role/firehose-role,BucketARN=arn:aws:s3:::my-bucket
Real-world example A company uses Kinesis Data Firehose to automatically load raw clickstream events into S3 for long term storage, while a separate Kinesis Data Analytics application runs SQL queries on the same stream to detect unusual traffic patterns in real time.

Common follow-ups: When would you choose Firehose instead of writing your own Data Streams consumer?;What data destinations does Firehose support besides S3?

S3 & Storage;Amazon Redshift & Data Warehousing
All 7 Amazon Kinesis & Data Streaming questions