DescriptionWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.
As a Software Engineer III at JPMorgan Chase within the Commercial and Investment Bank you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure stable and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firms business objectives.
Job responsibilities
- Design develop and maintain scalable data pipelines and ETL processes to support data integration and analytics.
- Frequently utilizes SQL and understands NoSQL databases and their niche in the marketplace
- Implement best practices for data engineering ensuring data quality reliability and performance
- Contribute to data modernization efforts by leveraging cloud solutions and optimizing data processing workflows
- Perform data extraction and implement complex data transformation logic to meet business requirements
- Monitor and executes data quality checks to proactively identify and address anomalies
- Ensure data availability and accuracy for analytical purposes
- Identify opportunities for process automation within data engineering workflows
- Deploy and manage containerized applications using Kubernetes (EKS) and Amazon ECS.
- Implement data orchestration and workflow automation using AWS step Event Bridge
- Use Terraform for infrastructure provisioning and management ensuring a robust and scalable data infrastructure.
Required qualifications capabilities and skills
- Formal training or certification on Data Engineering concepts and 3 years applied experience
- Experience across the data lifecycle
- Experience working with modern Lakehouse : Databricks )
- Proficient in SQL coding (e.g. joins and aggregations)
- Experience in Micro service based component using ECS or EKS
- Working understanding of NoSQL databases
- Experience in building and optimizing data pipelines architectures and data sets ( Glue or Data bricks etl)
- Proficienct in object-oriented and object function scripting languages (Python etc.)
- Experience in developing ETL process and workflows for streaming data from heterogeneous data sources
- Experience building Pipeline on AWS using Terraform and using CI/CD pipelines
Preferred qualifications capabilities and skills
- Advanced knowledge of RDBMS like Aurora
- Experience with data pipeline and workflow management tools (Airflow etc.)
- Strong analytical and problem-solving skills with attention to detail.
- Ability to work independently and collaboratively in a team environment.
- A proactive approach to learning and adapting to new technologies and methodologies.