Data Engineer
Job Location:
Monthly Salary:
Posted:
Application Deadline:
Vacancies:
Job Summary
About the role
We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a solid background in data engineering with expertise in AWS technologies and data processing frameworks.
Key responsibilities
Design and implement data pipelines using AWS services and PySpark.
Develop and optimize SQL queries for data extraction and transformation.
Monitor and maintain data workflows in Apache Airflow.
Collaborate with data scientists and analysts to understand data requirements.
Ensure data quality and integrity across all platforms.
Document data architecture and engineering processes.
Stay updated with emerging technologies and best practices in data engineering.
Required qualifications
3-5 years of experience in data engineering or related field.
Proficient in AWS services such as S3 Redshift and Glue.
Strong experience with PySpark for big data processing.
Solid SQL skills for data manipulation and analysis.
Experience with workflow orchestration using Apache Airflow.
Nice to have
Familiarity with data warehousing concepts and architecture.
Experience with ETL processes and tools.
Knowledge of Python or Java programming for data processing.
Understanding of data visualization tools and techniques.
Required Skills:
Data engineer Aws Pyspark SQL Airflow
