REQUIREMENTS:
- Total experience 7years.
- Excellent knowledge and experience in Big data engineering.
- Strong hands-on experience with Apache Spark (PySpark) and Scala.
- Proficiency in SQL for data transformation and querying.
- Deep understanding of AWS Data Services: S3 Glue Redshift EMR.
- Experience with streaming data tools (Kafka or Kinesis).
- Familiarity with CI/CD practices and version control systems (e.g. Git).
- Solid knowledge of data modeling data lake architecture and cloud-native data pipelines.
- Knowledge of data governance and security practices in cloud-based environments.
- Problem-solving mindset with the ability to tackle complex data engineering challenges.
- Strong communication and teamwork skills with the ability to mentor and collaborate effectively.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the clients business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements
- Mapping decisions with requirements and be able to translate the same to developers
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation
- Writing and reviewing design document explaining overall architecture framework and high-level design of the application for the developers
- Reviewing architecture and design on various aspects like extensibility scalability security design patterns user experience NFRs etc. and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies patterns and frameworks to materialize it
- Understanding and relating technology integration scenarios and applying these learnings in projects
- Resolving issues that are raised during code/review through exhaustive systematic analysis of the root cause and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications :
Bachelors or masters degree in computer science Information Technology or a related field.
Remote Work :
Yes
Employment Type :
Full-time