Senior Data Engineer India (Profisee)
Job Summary
While technology is the heart of our business a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency diversity integrity learning and growth.
If working in an environment that encourages you to innovate and excel not just in professional but personal life interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer (Informatica or Reltio)
Experience Level: 3 to 5 Years
Work location: Mumbai Bangalore & Trivandrum
Role & Responsibilities:
Design and develop enterprise Master Data Management (MDM) solutions using Profisee with experience in Informatica MDM or Reltio as analternative.
Develop scalable data ingestion integration transformation and publishing pipelines for master data.
Implement data cleansing standardization validation matching deduplication and survivorship rules to create trusted Golden Records.
Design and implement Golden Record/Golden Entity hierarchy and relationship management solutions.
Integrate MDM platforms with databases APIs data lakes data warehouses and downstream applications.
Develop and maintain ETL/ELT pipelines using technologies such as Azure Data Factory Databricks/Spark or equivalent tools.
Implement incremental/CDC processing error handling reconciliation and data quality checks.
Analyze and troubleshoot complex data integration MDM and data quality issues in production environments.
Collaborate with Data Architects Data Governance teams Business stakeholders and application teams to understand requirements and design effective MDM solutions.
Define and maintain data mappings transformation rules business rules data models and technical documentation.
Ensure solutions follow enterprise standards for data quality security governance metadata and lineage.
Participate in solution design code reviews testing deployment and production support.
Provide technical guidance and mentor junior data engineers
and contribute to continuous improvement of MDM and data engineering practices.
Skills expectation:
3 years of hands-on Data Engineering experience with strong experience in enterprise data integration and Master Data Management.
Hands-on experience with Profisee MDM is highly preferred.
Strong understanding of MDM concepts including:
Golden Record / Golden Entity
Matching & Deduplication
Survivorship
Data Quality & Standardization
Hierarchy Management
Reference Data
Entity Resolution
Data Governance
Strong SQL skills and experience with relational databases.
Strong programming skills in Python and/or PySpark.
Experience designing and developing ETL/ELT and data integration pipelines.
Experience with Azure Data Factory Databricks/Spark or equivalent data integration technologies.
Experience integrating MDM platforms with APIs databases data lakes data warehouses and downstream applications.
Understanding of data modeling metadata lineage data quality and governance.
Experience with incremental loads CDC data reconciliation error handling and production support.
Good understanding of Agile development methodologies.
If you like wild growth and working with happy enthusiastic over-achievers youll enjoy your career with us!
Required Experience:
Senior IC
About Company
Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business. Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineer ... View more