PC 1469 Data Engineer (ADF Dataflow Specialist)
Posted on:
4 hours ago
Vacancies:
1 Vacancy
Department:
Job Summary
Data Engineer Kochi Data CoE
Role Basics
We are looking for a skilled and driven Data Engineer with 4 to 6 years of experience to join our Architecture & Delivery Team in Kochi on a fully onsite this role you will focus heavily on designing building and optimizing robust data pipelines using Microsoft Azure Data Factory (ADF) and Dataflows.
Operating under our specialized Agentic Development Lifecycle (AiDLC) you will transition standard data migration and modernization tasks into repeatable high-margin software products. You will build automated data tools and embed smart subscription-enabling validation agents into software deployed for our global clients maintaining strict engineering and security baselines throughout a rapid 90-day deployment lifecycle.
Key Responsibilities
Pipeline & Product Engineering
- Design & Build Pipelines: Develop orchestrate and maintain scalable data ingestion and transformation pipelines using Azure Data Factory (ADF) and Dataflows.
- Accelerate Migrations: Build automated data solutions and core data assets focusing on the Data Migration Accelerator for Dynamics 365 Dataverse and Microsoft Fabric.
- Embed Agentic Logic: Develop and integrate intelligent automated agents (including validation reconciliation and data-stewardship agents) within pipelines to shift client value from one-time migration builds to ongoing subscription-based service models.
- Analytics Delivery: Create and pre-package robust Analytics & Insights Accelerators utilizing Microsoft Fabric and Power BI to maximize day-one reporting capabilities for end-users.
Governance Delivery Standards & Quality
- Data Governance: Implement and enforce native data governance security baselines and tracking frameworks seamlessly across environments using Microsoft Purview.
- Agile Delivery: Deliver and deploy all assigned data products utilizing the internal Agentic Development Lifecycle (AiDLC) adhering strictly to a 90-day development-to-production cycle (the 3-month rule).
- Quality Assurance: Ensure all data pipelines and products strictly align with ISO/IEC 25010 software quality standards and pass uncompromising security clearance checks before entering active client environments.
Required Technical Skills
| Domain | Skills & Technologies | Must / Preferred |
| Core Cloud Data | Microsoft Azure Data Factory (ADF) / Dataflows / Azure Data Engineering / Microsoft Fabric / Dataverse | Must-Have |
| Governance & Quality | Microsoft Purview ISO/IEC 25010 Compliance Frameworks | Good-to-Have |
| Analytics & BI | Power BI Advanced DAX Pre-packaged Analytics Frameworks | Good-to-Have |
| AI & Lifecycle | Agentic Development Lifecycle (AiDLC) Embedded Validation Agents | Good-to-Have |
| Target Architecture | Dynamics 365 Core Schemas & Migration APIs | Preferred |
Qualifications & Certifications
- Education: Bachelors degree in Computer Science Information Technology Software Engineering or a related technical discipline.
- Experience: 46 years of professional data engineering experience with a heavy emphasis on building cloud data pipelines (ADF/Dataflows) reusable accelerators or SaaS-based data integrations.
- Mandatory Certification Timeline: Must currently hold or explicitly commit to achieving the DP-203 (Azure Data Engineer Associate) or DP-600 (Fabric Analytics Engineer Associate) along with PL-300 (Power BI Data Analyst) certifications by December 2026 to support Softobizs Solutions Partner for Data & AI designation roadmap.
Soft Skills & Cultural Fit
- Accountability & Drive: High ownership mindset with a proven ability to independently drive complex engineering milestones to completion under 90-day cycles.
- Cross-Border Communication: Strong written and verbal communication skills with the capability to clearly articulate technical logic documentation and product requirements.
- Product-Centric Thinking: Ability to design data flows with modularity and reusability in mind looking past single-project silos to build scalable platforms.
What We Offer
- Leading-Edge Innovation: Deep direct engagement with emerging technologies like Agentic AI orchestration Micro-Agent Architectures and advanced Microsoft Fabric implementations.
- Global Exposure: Opportunity to contribute directly to data systems deployed for premier enterprise clients across Australia the US and India.
- Upskilling & Certification Support: Structured organizational tracking and learning assistance to clear premier Microsoft and Azure technical certifications.
Required Experience:
IC
About Company
Softobiz prepares businesses for transformative success by embracing change and engineering innovative digital products.