Job Title: MDM Developer with Databricks Experience
Job Location: Mississauga ON (3 days onsite in a week)
Duration: Long Term
Job Overview:
We are seeking an experienced Senior MDM Developer with expertise in Databricks to join our data management team. The ideal candidate will be responsible for designing developing and implementing scalable MDM solutions leveraging Databricks and related big data technologies. This role requires strong technical skills data modeling proficiency and the ability to collaborate across teams to ensure data integrity quality and governance.
Our Challenge:
The Senior MDM Developer will face the challenge of designing scalable high-quality master data solutions in a complex cloud-based environment while ensuring data integrity consistency and compliance across systems. They must effectively address data silos and transformation complexities to enable reliable strategic insights for the organization.
Key Responsibilities:
- Design develop and maintain Master Data Management (MDM) solutions to ensure accurate consistent and reliable master data across the organization.
- Build and optimize scalable data pipelines and workflows using Databricks on Azure cloud platform.
- Collaborate with data architects business analysts and data stewards to gather requirements and translate them into technical solutions.
- Develop and implement data integration processes data quality rules and data transformation logic within Databricks environment.
- Create and maintain data models metadata and documentation for MDM processes.
- Apply best practices for data governance security and compliance within MDM and Databricks ecosystem.
- Perform data profiling analysis and troubleshooting to resolve data issues and improve data quality.
- Automate routine tasks and implement continuous improvement initiatives.
- Mentoring junior team members and providing technical guidance on MDM and Databricks best practices.
- Stay updated with emerging trends and technologies in MDM big data and cloud-based data platforms.
Required Qualifications:
- Bachelors degree in Computer Science Information Technology or related field; Masters preferred.
- Extensive experience in MDM design development and implementation.
- Proven expertise with Databricks platform including notebooks Spark Delta Lake and Spark SQL.
- Strong programming skills in Python.
- Experience with cloud platform such as Azure (Azure Data Factory Azure Data Lake)
- Familiarity with data modeling data warehousing and ETL/ELT processes.
- Understanding of data governance data quality and master data concepts.
- Good knowledge of SQL and working with large datasets.
- Excellent problem-solving communication and team collaboration skills.
Preferred Qualifications:
- Certifications in Databricks (e.g. Databricks Certified Data Engineer) or cloud platforms.
- Experience with other data integration tools and MDM solutions.
- Knowledge of data visualization and reporting tools.
- Prior experience in an Agile development environment.