DescriptionDevsincis seeking a talented Senior Data Engineerto join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles along with hands-on experience in developing optimizing and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance the efficiency of our analytical capabilities.
Responsibilities:
- Design develop and maintain scalable data processing systems and data pipelines to facilitate the collection storage and analysis of large data sets.
- Collaborate with data scientists analysts and other engineers to understand data requirements and architecture needs and to ensure data is accessible and reliable.
- Optimize data storage and retrieval performance while ensuring data integrity and security.
- Implement ETL (Extract Transform Terraform Load) processes and automate data workflows to improve efficiency and accuracy.
- Monitor and troubleshoot data pipeline performance addressing issues as they arise to minimize downtime.
- Maintain documentation for the data architecture processes and workflows to ensure smooth collaboration and knowledge transfer within the team.
- Stay updated on emerging technologies and best practices in data engineering and contribute to the continuous improvement of data processes and systems.
Requirements - Bachelors or masters degree in Computer Science Engineering or a related field.
- 3 years of experience in data engineering data warehousing or a related field.
- Strong proficiency in SQL and experience with NoSQL databases (e.g. MongoDB Cassandra).
- Expertise in programming languages such as Python Java or Scala.
- Hands-on experience with big data technologies (e.g. Apache Hadoop Spark Kafka).
- Experience with cloud platforms (AWS Azure or GCP) including data storage solutions like S3 Redshift or BigQuery.
- Understanding of data modeling ETL concepts and data pipeline automation tools.
- Demonstrated problem-solving skills and the ability to work effectively in a fast-paced collaborative environment.
- Excellent communication skills with at least 2 years of international client communication experience.
Required Experience:
Senior IC