Kinesis Data Streaming | Data firehouse | |
---|---|---|
Objective | AWS Kinesis service for low-latency streaming and data ingestion at scale. | Data transfer service for loading streaming data into Amazon S3, Redshift etc. |
Fully Managed? | ❌ No, requires configuration for shards | ✅ Yes |
Data Storage | ✅ Yes | ❌ No |
Processing | Real-time processing | Near-real-time processing |
Scaling | Manual, through configuration of shards | 🚀 Automated, according to users |
Replay Capabilities | ✅ Yes | ❌ No |
Data Consumer modeling | Open-Ended model | Close-Ended model |
Spark supported? | ✅ Yes | ❌ No |