We are seeking a highly experienced DataOps Engineer / SDM (Software Development Manager) with strong DevOps and AWS data engineering expertise to support GS-TRP integration initiatives. The ideal candidate will drive automation CI/CD enablement cloud-native data infrastructure and operational excellence across data platforms.
This role requires hands-on experience with AWS data services Kubernetes-based deployments strong SQL capabilities and a solid understanding of data analytics workflows.
Key Responsibilities
DevOps & Automation
- Design implement and maintain CI/CD pipelines for data and application deployments.
- Automate infrastructure provisioning and deployment processes.
- Manage build release and environment promotion strategies (Dev QA Prod).
- Monitor and optimize deployment reliability and performance.
AWS Data Services
- Work extensively with AWS data services such as:
- AWS S3
- AWS Glue
- AWS Lambda
- AWS RDS / Redshift
- AWS EMR
- CloudWatch
- Support scalable secure and high-performance cloud data solutions.
- Ensure cost optimization and performance tuning of AWS resources.
Kubernetes & Containerization
- Deploy and manage containerized workloads using Kubernetes.
- Handle pod management scaling service mesh and cluster monitoring.
- Implement container orchestration best practices.
SQL & Data Analytics
- Write and optimize complex SQL queries.
- Support analytical workloads and data validation processes.
- Collaborate with analytics teams for performance tuning and troubleshooting.
- Ensure data integrity and pipeline reliability.
DataOps Best Practices
- Implement DataOps frameworks for data pipeline automation.
- Enable monitoring observability logging and alerting mechanisms.
- Improve data release velocity and reduce operational bottlenecks.
Communication & Collaboration
- Work closely with data engineers analysts DevOps teams and business stakeholders.
- Translate technical concepts into business-friendly language.
- Provide status updates and proactively resolve integration issues.
Mandatory Skills
- 10 years of strong DevOps experience
- Hands-on experience with AWS Data Services
- Strong Kubernetes experience
- Strong SQL expertise
- Experience in data analytics environments
- Excellent communication skills
Preferred Skills
- Experience with DataOps frameworks
- Infrastructure as Code (Terraform/CloudFormation)
- CI/CD tools (Jenkins GitHub Actions GitLab)
- Monitoring tools (Prometheus Grafana ELK Datadog)
- Experience in financial or enterprise integration programs
We are seeking a highly experienced DataOps Engineer / SDM (Software Development Manager) with strong DevOps and AWS data engineering expertise to support GS-TRP integration initiatives. The ideal candidate will drive automation CI/CD enablement cloud-native data infrastructure and operational excel...
We are seeking a highly experienced DataOps Engineer / SDM (Software Development Manager) with strong DevOps and AWS data engineering expertise to support GS-TRP integration initiatives. The ideal candidate will drive automation CI/CD enablement cloud-native data infrastructure and operational excellence across data platforms.
This role requires hands-on experience with AWS data services Kubernetes-based deployments strong SQL capabilities and a solid understanding of data analytics workflows.
Key Responsibilities
DevOps & Automation
- Design implement and maintain CI/CD pipelines for data and application deployments.
- Automate infrastructure provisioning and deployment processes.
- Manage build release and environment promotion strategies (Dev QA Prod).
- Monitor and optimize deployment reliability and performance.
AWS Data Services
- Work extensively with AWS data services such as:
- AWS S3
- AWS Glue
- AWS Lambda
- AWS RDS / Redshift
- AWS EMR
- CloudWatch
- Support scalable secure and high-performance cloud data solutions.
- Ensure cost optimization and performance tuning of AWS resources.
Kubernetes & Containerization
- Deploy and manage containerized workloads using Kubernetes.
- Handle pod management scaling service mesh and cluster monitoring.
- Implement container orchestration best practices.
SQL & Data Analytics
- Write and optimize complex SQL queries.
- Support analytical workloads and data validation processes.
- Collaborate with analytics teams for performance tuning and troubleshooting.
- Ensure data integrity and pipeline reliability.
DataOps Best Practices
- Implement DataOps frameworks for data pipeline automation.
- Enable monitoring observability logging and alerting mechanisms.
- Improve data release velocity and reduce operational bottlenecks.
Communication & Collaboration
- Work closely with data engineers analysts DevOps teams and business stakeholders.
- Translate technical concepts into business-friendly language.
- Provide status updates and proactively resolve integration issues.
Mandatory Skills
- 10 years of strong DevOps experience
- Hands-on experience with AWS Data Services
- Strong Kubernetes experience
- Strong SQL expertise
- Experience in data analytics environments
- Excellent communication skills
Preferred Skills
- Experience with DataOps frameworks
- Infrastructure as Code (Terraform/CloudFormation)
- CI/CD tools (Jenkins GitHub Actions GitLab)
- Monitoring tools (Prometheus Grafana ELK Datadog)
- Experience in financial or enterprise integration programs
View more
View less