What you'll learn
Understand the AWS data ecosystem and how to use various services and tools to build data engineering pipelines
Write Python and SQL queries to perform data transformations and analytics
Setting up local development environment for AWS on windows/mac
Learn how to store and manage large volumes of data using AWS S3
To secure your AWS resources using IAM
Use PySpark for Big Data Analysis
Data ingestion using Lambda Functions
Populating DynamoDB table with data
Perform ETL operations on large datasets using AWS Glue and Lambda
Build scalable and efficient data processing workflows using PySpark and EMR
Understand and utilize various data warehousing and data querying techniques using Redshift and Athena
Learn how to ingest real-time data streaming pipelines using Kinesis