Technology Lead Databricks Admin

• Candidates authorized to work for any employer in Canada without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
• Candidate must be located within commuting distance ofMississauga Ontarioor be willing to relocate to the areas.
• Bachelors degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 4 years of Information Technology experience

• 6 years of experience in cloud-based database and platform administration (AWS/Azure).
• 3 years hands-on experience administering Databricks environments.
• Strong understanding of autoscaling job orchestration and pipeline execution.
• Deep knowledge of cloud storage networking basics IAM and security best practices.
• Experience with Delta Lake Unity Catalog and workspace governance.
• Proficiency in scripting (Python Shell PowerShell) for automation.
• Experience with monitoring tools and log analytics (CloudWatch Azure Monitor Databricks Logs).
• Familiarity with DevOps and CI/CD (GitHub Actions Azure DevOps Jenkins).
• Databricks certifications (Admin Associate Data Engineer or Architect).
• Understanding of data engineering ETL/ELT workflows and big data concepts.

• Manage and administer Databricks workspaces clusters pools jobs and user access controls.
• Implement and enforce cluster policies workspace best practices and governance standards.
• Oversee Libraries Repos and Job scheduling within Databricks.
• Monitor and optimize runtime versions cluster configurations and performance.

• Provide L2/L3 support for platform issues job failures cluster outages and scheduled maintenance.
• Collaborate with Data Engineering Security Cloud Infra and Governance teams.
• Support upgrades migrations patching and operational improvements.

• Automate deployment processes using Git-based workflows (Repos/GitHub).
• Develop and maintain scripts for workspace automation.
• Manage CI/CD pipelines for notebooks jobs and Delta pipelines.

• Troubleshoot cluster performance issues job failures and resource utilization.
• Optimize Spark configurations autoscaling parameters and workload management.
• Monitor audit logs job runs compute usage and cost trends.

• Implement role-based access control (RBAC) and workspace governance aligned with corporate security standards.
• Manage secrets tokens service principals and integration with Azure AD / AWS IAM.
• Ensure compliance with data protection logging audit requirements and enterprise governance.

• Administer cloud-based databases (AWS/Azure) including provisioning performance tuning maintenance and monitoring.
• Manage S3 / ADLS storage integrations mount points permissions and lifecycle policies.
• Support ingestion frameworks and ETL/ELT workflows using Spark Delta Lake and Databricks Asset Bundles (optional).

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills expertise and ideas from our innovation ecosystem.

EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy childbirth or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.