REQUIREMENTS:
- Total experience 10 years.
- Strong working experience in Data Engineering and Big Data platforms.
- Hands-on experience with Python and PySpark.
- Expertise with AWS Glue including Crawlers and Data Catalog.
- Hands-on experience with Snowflake.
- Strong understanding of AWS services: S3 Lambda Athena SNS Secrets Manager.
- Experience with Infrastructure-as-Code (IaC) tools like CloudFormation and Terraform.
- Strong experience with CI/CD pipelines preferably using GitHub Actions.
- Working knowledge of Agile methodologies JIRA and GitHub version control.
- Experience with data quality frameworks and observability.
- Exposure to data governance tools and practices.
- Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the clients business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation.
- Writing and reviewing design document explaining overall architecture framework and high-level design of the application for the developers.
- Reviewing architecture and design on various aspects like extensibility scalability security design patterns user experience NFRs etc. and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies patterns and frameworks to materialize it.
- Understanding and relating technology integration scenarios and applying these learnings in projects.
- Resolving issues that are raised during code/review through exhaustive systematic analysis of the root cause and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications :
Bachelors or masters degree in computer science Information Technology or a related field.
Remote Work :
No
Employment Type :
Full-time