Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Title: Data Engineer
Job Summary:
We are seeking an experienced Data Engineer to design implement and maintain our data infrastructure and pipelines. The ideal candidate will have a strong background in data engineering big data technologies and cloud platforms. You will work closely with data scientists analysts and other stakeholders to ensure efficient and reliable data processing and storage solutions.
Key Responsibilities:
1. Design develop and maintain scalable data pipelines and ETL processes
2. Implement and optimize data storage solutions including data warehouses and data lakes
3. Collaborate with data scientists and analysts to understand data requirements and provide efficient data access
4. Ensure data quality consistency and reliability across all data systems
5. Develop and maintain data models and schemas
6. Implement data security and access control measures
7. Optimize query performance and data retrieval processes
8. Evaluate and integrate new data technologies and tools
9. Mentor junior data engineers and provide technical leadership
10. Collaborate with cross-functional teams to support data-driven decision-making
Requirements:
1. Bachelors or Masters degree in Computer Science Engineering or a related field
2. 5 years of experience in data engineering or related roles
3. Strong programming skills in Python Java or Scala
4. Extensive experience with big data technologies such as Hadoop Spark and Hive
5. Proficiency in SQL and experience with both relational and NoSQL databases
6. Experience with cloud platforms (AWS Azure or GCP) and their data services
7. Knowledge of data modeling data warehousing and ETL best practices
8. Familiarity with data visualization tools (e.g. Tableau Power BI)
9. Experience with version control systems (e.g. Git) and CI/CD pipelines
10. Strong problem-solving skills and attention to detail
11. Excellent communication and collaboration skills
Preferred Qualifications:
1. Experience with stream processing technologies (e.g. Kafka Flink)
2. Knowledge of machine learning and AI technologies
3. Familiarity with data governance and compliance requirements
4. Experience with containerization and orchestration tools (e.g. Docker Kubernetes)
5. Contributions to open-source projects or relevant certifications
6. Experience in Azure big data platform (ADF Databrick)
7. Experience in PowerBI
Employment Type
Full Time
