In this project, we will setup simple analytic application, it takes a the data is generated,sorts it catalogs it and transforms it and then makes it available for Athena and quicksight to parse and display a beautiful graph.
Our Data science and data analytic friend will help us translate 😁
Here are the steps
- Create our Data Generator with cloudformation
- Send the Data to Kinesis Firehose
- Save the unstructred data into a bucket
- The crawlers will pick up the data and catalog and structure them
- Use AWS Glue studio and transform the data
- Save the structured data into a bucket
- Use Athena to Parse,Explore the data
- Set up QuickSight to visualise the data
