DescriptionWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.
As a Software Engineer III - Data Engineer at JPMorgan Chase within the Commercial Banking Technology and Data Management team youll serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure stable and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firms business objectives.
Job responsibilities
- Develop enhance and test new/existing interfaces and work on developing enhancing ETL pipelinesdesign solutions
- Handle Dev Ops effort in terms of CICD Scanning Code Performance testing and Test coverage
- Identify analyze and interpret trends or patterns in complex data sets and transforming existing ETL logic into AWS and Hadoop Platform
- Innovate new ways of managing transforming and validating data
- Establish and enforce guidelines to ensure consistency quality and completeness of data assets
- Apply quality assurance best practices to all work products
Required qualifications capabilities and skills
- Formal training or certification on software engineering concepts and 3 years applied experience
- Experience in AWS Services
- Experience in Redshift Glue Aurora RDS S3 Lambda and EC2
- Experience in Terraform
- Experience in a Big Data technology (Spark Architecture Performance tuning Spark SQL Streaming KAFKA Entitlements etc. )
- Experience in real time streaming data
- Experience in Python is a must and Experience in writing SQL queries is a must
- Strong Experience with UNIX shell scripting is must
- Experience in cloud platforms - AWS is a must.
Preferred qualifications capabilities and skills
- Bachelors degree in a technical or quantitative field with preferred focus on Information Systems
- Experience in Data bricks and Snowflake is preferred
- Experience with AI/ML is preferred.
- Experience of working in a development teams using agile techniques and Object Oriented development and scripting languages is preferred.
- Experience in Athena