Data Engineer – QA & Release Management

We are seeking a detailoriented and versatile Data Engineer QA & Release Management to play a critical role in ensuring the quality reliability and security of our data engineering solutions. This role sits at the intersection of data engineering quality assurance and DevOps with responsibilities ranging from code review and validation to automating deployments and managing releases. The ideal candidate will have a strong foundation in Python and SQL experience working with modern data platforms like SingleStore and Snowflake and familiarity with infrastructure and orchestration tools such as Airflow Kubernetes Azure and Terraform. This position also involves working across Linux and Windows Server environments supporting security compliance through application upgrades and enabling CI/CD processes using GitHub and GitHub Actions.

Key Responsibilities:

• Code Quality & Review
  • Conduct indepth reviews of Python and SQL code to ensure accuracy performance maintainability and alignment with business requirements and coding standards.
  • Collaborate with developers and data teams to enforce best practices in data engineering and QA.
• Release Management
  • Design implement and maintain automated release pipelines using GitHub Actions and Terraform.
  • Manage and execute manual deployments to Windows Server and Linux based virtual machines.
  • Coordinate release schedules monitor deployment progress and resolve issues to ensure smooth rollouts.
• Quality Assurance & Testing
  • Develop and maintain validation scripts and test cases to ensure data integrity and application reliability.
  • Support prerelease testing environment setup and regression testing for new features and updates.
• Infrastructure & Platform Management
  • Work with Kubernetes Azure and Terraform to support scalable and secure data infrastructure.
  • Upgrade applications and underlying services to comply with security and operational standards.
• Workflow Orchestration & Monitoring
  • Build and manage data pipelines and workflows using Apache Airflow.
  • Monitor pipeline performance and troubleshoot failures or data anomalies.
• CrossFunctional Collaboration
  • Partner with development data security and DevOps teams to align on release processes and compliance requirements.
• Participate in agile ceremonies including sprint planning and retrospectives.

Key Skills & Experience:

• Bachelors degree in Computer Science Information Technology or a related field.
• Strong understanding of QA methodologies and release processes
• Prior experience in a DataOps or DevOpsfocused data engineering role
• Experience automating testing and deployment processes in mixed environments
• Familiarity with version control systems and CI/CD particularly GitHub and GitHub Actions.
• Proficient in ETL tools and processes using Python and SQL
• Experience with SingleStore Snowflake MS SQL Serer and MySQL databases

• Strong understanding of Kubernetes for containerization and Airflow for orchestration

• Proficiency in both Linux and Windows Server environments

• Experience with application security compliance and patching/upgrades
• Knowledge of Azure services and Terraform infrastructureascode
• 37 Years of experience in a previous role.

Personal Attributes:

• Detailoriented with a strong focus on quality and reliability
• Active listening skills including investigating requirements and proactively identifying potential issues.
• Critical thinker who naturally sees opportunities to develop and optimize work processes finding ways to simplify standardize and automate.
• Selfdirected and takes ownership of their work.
• Collaborative partner who builds and leverages crossfunctional relationships to bring together ideas data and insights to drive continuous improvement in execution.
• Analytical problem solvers. People who go beyond just fixing to identify root causes evaluate optimal solutions and recommend comprehensive upgrades to prevent future issues.
• Strong communication and problemsolving skills
• Able to work independently and manage multiple priorities
• Comfortable operating in a fastpaced Multiteam environment

Additional Information :

Powered by SmartRecruiters Candidate Privacy Policy

Remote Work :

No

Employment Type :

Fulltime