Please enable JavaScript.
Coggle requires JavaScript to display documents.
Analytics - Coggle Diagram
Analytics
Kinesis
Data Streams
Real-time data capture
Ingest and store data streams from hundreds of thousands of data sources:
Log and event data collection
IoT device data capture
Mobile data collection
Gaming data feed
Modes
Provisioned Mode
manually set the capacity (SHARDS) of the conveyor belt. You’re in control of throughput, but you must scale shards up/down yourself as traffic changes.
On-Demand Mode
The conveyor belt (SHARDS) auto-expands or shrinks depending on how many packages arrive. You don’t plan capacity
-
-
-
Firehose Stream
Load real-time data
Load streaming data into data lakes, data stores, and analytics tools for:
Log and event analytics
IoT data analytics
Clickstream analytics
Security monitoring
source > firehose > destination
destinations:
opensearch
redshift
s3
Kinesis Data Analytics
now named as Amazon Managed Service for Apache Flink
runs real-time data stream processing applications using Apache Flink
Opensearch
-
-
managed cluster
create domain name > choose opensearch engine > create VPC for the domain > create
- multiAZ
- 2 active : 1 standby
- IOPS: 3000
- EBS for storage
- Master node : Worker node
-
Athena
Query Editor data source from a table/database > query > analyzes3 > aws glue > athenadatabase/table can be from:
- s3
- dynamodb
- etc