AWS Lead Data Engineer

Job title: AWS Lead Data Engineer

Location:- 3 days from office

Note: People who are available for an in-person client interview from Newark (Washington Street) office after the 1st round of client interview is complete.

.Job summary : We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader you will be responsible for architecting implementing and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers collaborate with cross-functional partners and ensure best practices in cloud data engineering. Candidate would be required to work from NJ office as part of this role.

Experience: 7to10Yrs

Required Skills : AWS Lambda AWS RDSAWS EMRAWS Glue Redshift AWS Athena AWS Kinesis to have skills : : -Not Applicable : Day : 1. Lead the design development and optimization of large-scale reliable and secure data pipelines and data lake architecture on AWS. 2. Architect and implement end-to-end data solutions including data ingestion storage transformation and analytics using AWS services - Glue Redshift S3 Lambda EMR Kinesis Athena RDS etc. 3. Mentor and guide a team of data engineers conducting code reviews and fostering best practices in data engineering and cloud architecture. 4. Collaborate with data scientists analysts and business stakeholders to translate requirements into scalable and maintainable solutions. 5. Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses. 6. Develop and enforce standards for data quality security and governance. 7. Drive the adoption of DevOps CI or CD and infrastructure-as-code practices within the data engineering team. 8. Ensure solutions are cost-effective performant and aligned with enterprise data strategy. 9. Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption. 10. Troubleshoot complex data issues and provide technical leadership in problem resolution. 11. 7 years of experience in data engineering with at least 3 years in technical leadership or lead engineer role. 12. Extensive hands-on experience with AWS data services -Glue Redshift S3 Lambda EMR or Spark Kinesis Athena RDS API Gateway etc. 13. Proficient in programming languages such as Python and SQL experience with Shell scripting and Scala is a plus. 14. Strong experience designing implementing and managing data lakes data warehouses and data ingestion pipelines on AWS. 15. Proven experience with ETL or ELT processes data modeling and big data frameworks. 16. Demonstrated ability to lead mentor and coach engineers in a collaborative team environment. 17. Experience with DevOps practices CI or CD pipelines and infrastructure-as-code tools e.g. CloudFormation Terraform 18. Excellent problem-solving communication and organizational skills.

Certifications Required : 1. AWS Solutions Architect or AWS Data Engineer certification. 2. Experience with real-time streaming technologies. 3. Knowledge of data governance compliance and security best practices