DescriptionCloudEngineer - Software Engineer - Analyst
Who We Look For:
Goldman Sachs Engineers are innovators and problem-solvers who thrive in fast-paced global environments. We are seeking a motivated Cloud Engineer to support the WM Data Engineering this role you will be a key contributor to the migration and modernization of our on-premises legacy data pipelines and services toAWS. You will work at the intersection of software engineering and data architecture translating technical blueprints into high-performance code. Your mission is to build secure accessible and cost-optimized data assets that power real-time client insights and advanced analytics in a cloud-native environment.
Key Responsibilities:
- Data Pipeline Development & Migration:
- ETL/ELT Execution:Build and maintain scalable data pipelines usingAWS GlueAmazon EMR andSnowflake transitioning legacy on-premises workloads to modern cloud-native architectures.
- Microservices Transition:Execute the migration of on-premises microservices to AWS by containerizing workloads withDockerand deploying them toAmazon ECS.
- Schema Evolution:Implement and manage open table formats specificallyApache Iceberg to ensure high-performance analytics and seamless schema evolution across the WM data lake.
- Orchestration & Automation:
- Workflow Management:Develop and schedule complex data workflows usingApache Airflow (MWAA)orAWS Step Functions ensuring robust error handling and retry logic.
- Infrastructure as Code (IaC):Deploy and manage cloud infrastructure using TerraformorAWS CDK adhering to the Infrastructure as Code philosophy for all deployments.
- CI/CD Integration:Maintain automated deployment pipelines to ensure consistent and auditable code promotion across development UAT and production environments.
- Data Quality & Governance:
- Automated Testing:Implement data validation to ensure data integrity and accuracy during and after the migration process.
- Observability:Build monitoring dashboards and alerting mechanisms to track pipeline health data latency and SLA adherence.
- Modernization:
- Migration Support:Contribute to the migration of on-premises data workloads to AWS.
- AI/ML Readiness:Help build the data foundations required for predictive modeling and generative AI applications.
Qualifications:
Technical Requirements
- Experience:2 years of hands-on experience inData EngineeringorSoftware Engineering with a focus on cloud-based data solutions.
- Technical Skills:
- Experience with modern data platforms like Snowflake and cloud-native AWS services.
- Understanding of open-source table formats specifically Apache Iceberg.
- Proficiency in Java Python and SQL.
- Hands-on experience with Spark Kafka and orchestration tools like Apache Airflow Dagster or dbt.
- Soft Skills:Strong problem-solving builder mindset and the ability to communicate technical concepts within a team environment.
Education
- Bachelors or Masters degree in computer science Engineering Mathematics or a related field.
ABOUT GOLDMAN SACHS
At Goldman Sachs we commit our people capital and ideas to help our clients shareholders and the communities we serve to grow. Founded in 1869 we are a leading global investment banking securities and investment management firm. Headquartered in New York we maintain offices around the world.
We believe who you are makes you better at what you do. Were committed to fostering and advancing diversity and inclusion in our own workplace and beyond by ensuring every individual within our firm has a number of opportunities to grow professionally and personally from our training and development opportunities and firmwide networks to benefits wellness and personal finance offerings and mindfulness programs. Learn more about our culture benefits and people at
Were committed to finding reasonable accommodations for candidates with special needs or disabilities during our recruiting process. Learn more:
The Goldman Sachs Group Inc. 2023. All rights reserved.
Goldman Sachs is an equal opportunity employer and does not discriminate on the basis of race color religion sex national origin age veterans status disability or any other characteristic protected by applicable law.
Required Experience:
IC
DescriptionCloudEngineer - Software Engineer - AnalystWho We Look For:Goldman Sachs Engineers are innovators and problem-solvers who thrive in fast-paced global environments. We are seeking a motivated Cloud Engineer to support the WM Data Engineering this role you will be a key contributor to the ...
DescriptionCloudEngineer - Software Engineer - Analyst
Who We Look For:
Goldman Sachs Engineers are innovators and problem-solvers who thrive in fast-paced global environments. We are seeking a motivated Cloud Engineer to support the WM Data Engineering this role you will be a key contributor to the migration and modernization of our on-premises legacy data pipelines and services toAWS. You will work at the intersection of software engineering and data architecture translating technical blueprints into high-performance code. Your mission is to build secure accessible and cost-optimized data assets that power real-time client insights and advanced analytics in a cloud-native environment.
Key Responsibilities:
- Data Pipeline Development & Migration:
- ETL/ELT Execution:Build and maintain scalable data pipelines usingAWS GlueAmazon EMR andSnowflake transitioning legacy on-premises workloads to modern cloud-native architectures.
- Microservices Transition:Execute the migration of on-premises microservices to AWS by containerizing workloads withDockerand deploying them toAmazon ECS.
- Schema Evolution:Implement and manage open table formats specificallyApache Iceberg to ensure high-performance analytics and seamless schema evolution across the WM data lake.
- Orchestration & Automation:
- Workflow Management:Develop and schedule complex data workflows usingApache Airflow (MWAA)orAWS Step Functions ensuring robust error handling and retry logic.
- Infrastructure as Code (IaC):Deploy and manage cloud infrastructure using TerraformorAWS CDK adhering to the Infrastructure as Code philosophy for all deployments.
- CI/CD Integration:Maintain automated deployment pipelines to ensure consistent and auditable code promotion across development UAT and production environments.
- Data Quality & Governance:
- Automated Testing:Implement data validation to ensure data integrity and accuracy during and after the migration process.
- Observability:Build monitoring dashboards and alerting mechanisms to track pipeline health data latency and SLA adherence.
- Modernization:
- Migration Support:Contribute to the migration of on-premises data workloads to AWS.
- AI/ML Readiness:Help build the data foundations required for predictive modeling and generative AI applications.
Qualifications:
Technical Requirements
- Experience:2 years of hands-on experience inData EngineeringorSoftware Engineering with a focus on cloud-based data solutions.
- Technical Skills:
- Experience with modern data platforms like Snowflake and cloud-native AWS services.
- Understanding of open-source table formats specifically Apache Iceberg.
- Proficiency in Java Python and SQL.
- Hands-on experience with Spark Kafka and orchestration tools like Apache Airflow Dagster or dbt.
- Soft Skills:Strong problem-solving builder mindset and the ability to communicate technical concepts within a team environment.
Education
- Bachelors or Masters degree in computer science Engineering Mathematics or a related field.
ABOUT GOLDMAN SACHS
At Goldman Sachs we commit our people capital and ideas to help our clients shareholders and the communities we serve to grow. Founded in 1869 we are a leading global investment banking securities and investment management firm. Headquartered in New York we maintain offices around the world.
We believe who you are makes you better at what you do. Were committed to fostering and advancing diversity and inclusion in our own workplace and beyond by ensuring every individual within our firm has a number of opportunities to grow professionally and personally from our training and development opportunities and firmwide networks to benefits wellness and personal finance offerings and mindfulness programs. Learn more about our culture benefits and people at
Were committed to finding reasonable accommodations for candidates with special needs or disabilities during our recruiting process. Learn more:
The Goldman Sachs Group Inc. 2023. All rights reserved.
Goldman Sachs is an equal opportunity employer and does not discriminate on the basis of race color religion sex national origin age veterans status disability or any other characteristic protected by applicable law.
Required Experience:
IC
View more
View less