Data Engineer

Overview:

Key Responsibilities:

• Design and implement scalable data pipelines for data ingestion processing and extraction
• Develop and maintain data warehousing solutions
• Collaborate with data scientists and analysts to understand data requirements and design appropriate data models
• Optimize data infrastructure for performance and costefficiency
• Ensure data quality and integrity through data validation and testing
• Implement data security and privacy measures
• Automate data processes and workflows
• Monitor and troubleshoot data infrastructure and processing issues
• Stay updated with the latest technologies and best practices in the data engineering field
• Collaborate with crossfunctional teams to support datarelated needs

Required Qualifications:

• Bachelors or Masters degree in Computer Science Information Technology or related field
• Proven experience in data engineering or related roles
• Proficiency in SQL and database management systems
• Strong programming skills in languages such as Python Java or Scala
• Experience with big data technologies such as Hadoop Spark or Kafka
• Expertise in data modeling and designing efficient data structures
• Experience in developing ETL processes and familiarity with ETL tools
• Understanding of cloud platforms and services such as AWS Azure or GCP
• Knowledge of data warehousing concepts and technologies
• Excellent problemsolving and analytical abilities
• Strong communication and collaboration skills
• Ability to work effectively in a fastpaced and dynamic environment
• Certifications in relevant data engineering or cloud technologies are a plus

sql,python,data modeling,etl,big data