Technical Lead, Data Ingestion (Tech Lead)
Job Summary
Mandate Overview:
- The Tech Lead leads the ingestion POD of the CDAC project which integrates several legacy systems and the new group insurance system into an Azure cloud environment exposed to users through Power BI. He builds the complex components configures ingestion pipelines and takes part in data loading while supporting and coordinating developers. Technical governance is explicit: validating infrastructure configurations (repo ingestion and enrichment framework Synapse and SQL databases gateways MFT flows file servers) validating access against the security model refactoring and coordinating branches and promotions with the other PODS. The context is strongly schedule-driven and the targeted seniority is 8 years and more.
- Target candidate: a senior data developer 8 years who has led a development team on Azure ingestion pipelines (Data Factory Data Lake Synapse) in a large organization while remaining the main code contributor. He shows tooled quality practices (TDD automated testing CI/CD) and command of production releases in an environment with standardized processes.
Required:
- Excellent ETL knowledge
- Experience in data projects
- Azure data storage environments (Data Storage Data Lake Blob Storage Azure Data Factory Azure SQL Database Synapse Analytics Flyway)
- Relational and dimensional models
- Testing approaches: TDD user interface testing automated testing continuous integration
- Source control and deployment (GitHub GitHub Actions Concourse)
- Power BI (Desktop Service components including gateway)
- Architecture patterns: object-oriented cloud (IaaS CaaS PaaS SaaS iPaaS) application resilience event-driven
- Functional knowledge
- Soft skills: leadership resourcefulness autonomy teamwork and task sharing standardized processes pleasant personality
Desired:
- Industry knowledge (checked on the form)
- Checked competencies: action-oriented managing complexity results-driven analysis and synthesis
Asset:
- Domain Driven Design (DDD)
- Security principles and protocols: SSO Auth0 SAML OpenID JWT OAuth2 ABAC/RBAC
Profiles to Exclude:
- Profile mentioning Azure Data Factory or Synapse without an ingestion pipeline built and deployed in a described mandate.
- BI analyst or developer profile whose experience is limited to Power BI reports and dashboards without ETL development.
- Team lead or development manager profile without hands-on development in recent mandates.
- Data or solution architect profile who designs without developing or executing production releases.
- Profile whose ETL experience is exclusively on on-premise tools without a completed Azure project.
- Profile without demonstrated automated testing or continuous integration practice in a mandate.
Required Skills:
Required: Excellent ETL knowledge Experience in data projects Azure data storage environments (Data Storage Data Lake Blob Storage Azure Data Factory Azure SQL Database Synapse Analytics Flyway) Relational and dimensional models Testing approaches: TDD user interface testing automated testing continuous integration Source control and deployment (GitHub GitHub Actions Concourse) Power BI (Desktop Service components including gateway) Architecture patterns: object-oriented cloud (IaaS CaaS PaaS SaaS iPaaS) application resilience event-driven Functional knowledge Soft skills: leadership resourcefulness autonomy teamwork and task sharing standardized processes pleasant personality Desired: Industry knowledge (checked on the form) Checked competencies: action-oriented managing complexity results-driven analysis and synthesis Asset: Domain Driven Design (DDD) Security principles and protocols: SSO Auth0 SAML OpenID JWT OAuth2 ABAC/RBAC Profiles to Exclude: Profile mentioning Azure Data Factory or Synapse without an ingestion pipeline built and deployed in a described mandate. BI analyst or developer profile whose experience is limited to Power BI reports and dashboards without ETL development. Team lead or development manager profile without hands-on development in recent mandates. Data or solution architect profile who designs without developing or executing production releases. Profile whose ETL experience is exclusively on on-premise tools without a completed Azure project. Profile without demonstrated automated testing or continuous integration practice in a mandate.