Data Engineer
Job Summary
We are seeking a Data Engineer to join our team. This role involves building and maintaining data pipelines onpremises with cloud integration. Join us to deliver highquality data solutions.
Key responsibilities
Design implement and maintain scalable data pipelines.
Optimize SQL queries for performance.
Develop PySpark jobs for data processing.
Orchestrate workflows using Airflow.
Manage data ingestion with NiFi and Cloudera.
Integrate onprem and cloud components.
Collaborate with crossfunctional teams.
Monitor performance and troubleshoot issues.
Required qualifications
Minimum 3-4 years of data engineering experience.
degree in Computer Science Engineering or related field.
Strong SQL and PySpark skills.
Handson experience with Airflow.
Familiarity with NiFi and Cloudera.
Experience with at least one cloud platform preference for AWS.
Nice to have
Experience with onprem cloud integration.
Excellent communication skills.
Required Skills:
SQL PySpark Airflow AWS NiFi Cloudera Data Engineering Python Spark ETL Data Modeling