Data Engineer

Overview:

Key Responsibilities:

• Designing and developing scalable data pipelines for ingesting transforming and storing large volumes of data
• Collaborating with data scientists and analysts to understand data requirements and implement solutions
• Building and optimizing data models and schemas for performance and reliability
• Implementing ETL processes to integrate data from various sources into the data warehouse
• Writing and optimizing complex SQL queries for data analysis and reporting
• Developing and maintaining APIs for data access and manipulation
• Ensuring the security and privacy of data by implementing access controls and encryption
• Performance tuning of database systems and data processing workflows
• Monitoring and troubleshooting data infrastructure to ensure high availability and reliability
• Collaborating with crossfunctional teams to understand and address datarelated challenges
• Documenting data processes data flows and data infrastructure
• Staying updated with the latest trends and technologies in data engineering and analytics

Required Qualifications:

• Bachelors degree in Computer Science Engineering or a related field
• Proven experience in building and optimizing largescale data pipelines and data warehouses
• Proficiency in data modeling data warehousing and ETL processes
• Expertise in programming languages such as Python Java or Scala
• Strong understanding of database systems and SQL query optimization
• Experience with cloud platforms like AWS Azure or GCP
• Knowledge of big data technologies like Hadoop Spark or Kafka
• Familiarity with data pipeline orchestration tools like Airflow or Luigi
• Excellent problemsolving and analytical skills
• Ability to work in a fastpaced collaborative team environment
• Strong communication and interpersonal skills
• Relevant certifications in data engineering or cloud platforms
• Understanding of software engineering best practices and version control systems
• Experience in the healthcare/finance/retail industry is a plus

data modeling,etl,sql,python,data warehousing