Data Platform DevOps Engineer
Share
Job Location:
Monthly Salary:
Posted on:
13 hours ago
Vacancies:
1 Vacancy
Job Summary
We are seeking an experienced Data Platform Engineer to join our core platform this role you will be responsible for building securing and automating our enterprise Data Platform on AWS. You will go beyond basic pipeline creation by designing and maintaining the underlying infrastructure and CI/CD frameworks that enable our data teams to operate and scale ResponsibilitiesCloud & Platform Infrastructure (IaC): Deploy and maintain Databricks workspaces and AWS infrastructure (VPC PrivateLink IAM S3 Lambda EKS and Fargate) using Catalog Implementation: Automate the governance layer including metastore configuration external locations and access controls within Unity & Compliance: Ensure the platform adheres to enterprise security standards by managing implementing cloud infrastructure and data protection automated security Lifecycle Management: Use Terraform for end-to-end workspace provisioning ensuring consistent setup across Dev Acc and Prod & Cost Control (Policies): Design and implement policies and guardrails to enforce standardsIdentity & Access Automation: Automate assignment of permissions using Terraform. Manage Service Principals for pipelines and map groups to specific Workspace roles and Unity Catalog & Automation (CI/CD)Pipeline Architecture: Oversee GitLab CI/CD pipelines for data projects transitioning the team from manual notebook deployments to automated Asset Bundles (DABs): Standardize deployment strategies using DABs. Develop templates and presets for Data Engineers to deploy jobs and Management: Implement branching strategies code review policies and environment promotion rules (Dev Acc Prod).Service Organization & OperationsObservability: Configure monitoring alerting and logging (using system tables or integration with tools like CloudWatch) to ensure platform & Incident Management: Serve as an escalation point for platform-related Sharing: Document best practices and conduct workshops to upskill data engineers on effective platform usage. Job Qualifications:Bachelors in computer science software engineering mathematics or related field.5 years industry experience in Data Engineering Cloud Infrastructure or DevOps; 3 years with Databricks in enterprise Terraform skills for managing Cloud infrastructure and Databricks resourcesExtensive AWS portfolio knowledgeExpertise in CI/CD pipelines using GitLab CI and Databricks Asset understanding of Databricks Lakehouse architecture Unity Catalog Serverless Compute Delta Lake and Workflow grasp of SDLC/DataOps including unit testing modular code and Git in Python (e.g. automation PySpark pandas) and Bash/Shell scripting for CI/ communication documentation mentoring and collaboration : Databricks Certified Data Engineer Professional or AWS Solutions Architect certification.#LI-29f4
Required Experience:
IC
Key Skills
About Company
NXP is a global semiconductor company creating solutions that enable secure connections for a smarter world.
