AWS Data Engineer with Python Pyspark

Knowledge in Terraform S3 API Gateway Lamba SNS and SQS.

Should have wide experience in AWS services such as Glue EMR Lambda Step Functions CloudTrail CloudWatch SNS SQS S3 VPC EC2 RDS IAM Node JS Glue ETL

Should have CICD experience using tools like GIT Jenkins etc

Should have extensive handson experience with SPARK and real time analytic frameworks data streaming & Structured streaming.

Knowledge in Databricks reporting.

They need to be experienced in programming language (Python Pyspark)

Handson experience integrating opensource components into dataanalytic solutions

Working with vendors to enhance tool capabilities to meet enterprise needs

Willingness to continuously learn & share learnings with others

Strong troubleshooting and performance tuning skills.

Experience building multitenant virtualized infrastructure a strong plus