DescriptionThe Data Engineer is responsible for designing developing implementing and supporting reports and data transformations with a focus on PySpark and SQL. The ideal candidate must have handson experience with these technologies and should be familiar with modern UI technologies specifically React.js.
Main Accountabilities
- Analyzes business requirements and develop detailed accurate technical specifications.
- Designs and build robust data models and ETL processes using Python and PySpark.
- Maintains and enhance existing React.js user interfaces for business data acquisition.
- Creates comprehensive technical documentation and operation manuals.
- Develops unit tests and implement CI/CD processes for automated ETL validation
RequirementsEducation Skills and Experience
- BSc degree in Computer Science or Electrical Engineering
- Minimum of 4 years of proven experience in Data Engineering or similar position
- Experience with cloud technologies particularly AWS is a plus
- Knowledge of the Databricks platform is highly valued
Competencies
- Excellent interpersonal skills with ability to communicate effectively at all levels
- Strong analytical and problemsolving capabilities
- Resultsoriented mindset
- Effective time management with ability to multitask and prioritize work
- Consistent application of software development practices and methodologies