Senior Data Engineer ADFDatabrick
Share
Job Location:
Monthly Salary:
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Job Summary
Big data design and analysis data modeling development deployment and CICD operations of big data pipelines Collaborate with a team of other data engineers data scientists and business subject matter experts to process data and prepare data sources. Mentor other data engineers to develop a world class data engineering team. Ingest Process and Model data from heterogeneous data sources to support Data Science -depth experience with a big data cloud platform preferably Azure. Strong grasp of programming languages (Python PySpark or equivalent) and a willingness to learn new ones. Experience writing database-heavy services or APIs. Experience building and optimizing data pipelines architectures and data sets. Working knowledge of queueing stream processing and highly scalable data stores Experience working with and supporting cross-functional teams. Strong understanding of structuring code for testability.
