REQUIREMENTS:
- Total experience 3 years.
- Excellent knowledge and experience in Big data engineer.
- Strong handson experience with PySpark and Apache Spark development.
- Proficiency in Python for data processing and automation.
- Expertise in SQL for querying transformation and performance tuning.
- Handson experience with Databricks or similar cloudbased big data platforms.
- Proven ability to work with large datasets in distributed computing environments.
- Solid understanding of data engineering best practices including version control CI/CD and testing.
- Knowledge of data modeling ETL frameworks and workflow orchestration tools (e.g. Airflow Azure Data Factory).
- Experience with cloud platforms such as Azure AWS or GCP.
- Familiarity with Delta Lake Lakehouse architecture or data warehousing concepts.
- Excellent problemsolving and communication skills.
RESPONSIBILITIES:
- Writing and reviewing great quality code
- Understanding functional requirements thoroughly and analyzing the clients needs in the context of the project
- Envisioning the overall solution for defined functional and nonfunctional requirements and being able to define technologies patterns and frameworks to realize it
- Determining and implementing design methodologies and tool sets
- Enabling application development by coordinating requirements schedules and activities.
- Being able to lead/support UAT and production roll outs
- Creating understanding and validating WBS and estimated effort for given module/task and being able to justify it
- Addressing issues promptly responding positively to setbacks and challenges with a mindset of continuous improvement
- Giving constructive feedback to the team members and setting clear expectations.
- Helping the team in troubleshooting and resolving of complex bugs
- Coming up with solutions to any issue that is raised during code/design review and being able to justify the decision taken
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications :
Bachelors or masters degree in computer science Information Technology or a related field.
Remote Work :
No
Employment Type :
Fulltime