Junior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Job Summary
Junior Data Engineer Workflow Automation & Analytics
Experience: 35 years
Employment Type: Full-Time
Role Overview:
We are seeking a technically strong and highly analytical Data Engineer to join our onsite team. This role demands hands-on expertise in workflow automation data pipeline development and dashboard as well as strong skills in database investigation and optimization. Experience with AWS services such as EMR ECS and S3 is a plus.
Key Responsibilities:
Design build and maintain scalable ETL/ELT workflows using Apache Airflow or Prefect.
Write clean and efficient Python and PySpark scripts for large-scale data processing.
Investigate and debug data anomalies through advanced SQL and database forensics.
Develop interactive dashboards and reports using Power BI and Meta base.
Collaborate with cross-functional teams to ensure data accuracy consistency and availability.
Optimize workflows and data processing jobs on AWS infrastructure including EMR and ECS.
Set up alerts monitoring and logging to maintain high reliability in data operations.
Good to Have:
Experience with AWS services: EMR ECS S3 Lambda etc.
Understanding of data warehousing (e.g. Redshift Snowflake BigQuery).
Familiarity with Docker Kubernetes or other orchestration tools.
Exposure to CRM data environments (e.g. Salesforce Zoho) is a bonus.
Requirements
Required Skills:
Hands-on experience with Apache Airflow and/or Prefect for workflow orchestration.
Proficiency in Python and PySpark for data transformation and processing.
Solid knowledge of SQL and data investigation techniques in complex database systems.
Experience building visualisations and reports with Power BI and Metabase.
Familiarity with Git CI/CD practices and working in fast-paced production environments.
Soft Skills:
Excellent communication and documentation skills.
Self-motivated proactive and able to work independently in an onsite team setting
Benefits
" We are an ISO 27001:2013 compliant organization and emphasise information security of our clients"
Required Skills:
Hands-on experience with Apache Airflow and/or Prefect for workflow orchestration. Proficiency in Python and PySpark for data transformation and processing. Solid knowledge of SQL and data investigation techniques in complex database systems. Experience building visualizations and reports with Power BI and Metabase. Familiarity with Git CI/CD practices and working in fast-paced production environments.
Company Industry
IT Services and IT Consulting
Key Skills
- Electrical Commissioning
- Insurance Paralegal
- Linux
- Arabic English Translation
- AV
