Software Engineer III Python, Spark,Data pipelines
Share
Job Location:
Monthly Salary:
Posted on:
2 days ago
Vacancies:
1 Vacancy
Job Summary
Description
As a Data Engineer III at JPMorgan Chase within the Corporate Technology you serve as a seasoned member of an agile team to design and deliver trusted data collection storage access and analytics solutions in a secure stable and scalable way. You are responsible for developing testing and maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firms business objectives.
Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team.
As a Data Engineer III at JPMorgan Chase within the Corporate Technology you serve as a seasoned member of an agile team to design and deliver trusted data collection storage access and analytics solutions in a secure stable and scalable way. You are responsible for developing testing and maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firms business objectives.
Job responsibilities
- Supports review of controls to ensure sufficient protection of enterprise data
- Advises and makes custom configuration changes in one to two tools to generate a product at the business or customer request
- Updates logical or physical data models based on new use cases
- Frequently uses SQL and understands NoSQL databases and their niche in the marketplace
Required qualifications capabilities and skills
- Formal training or certification on data engineering concepts and 3 years applied experience
- 5 years experience in advanced proficiency in programming languages including Python Spark
- Advanced at SQL (e.g. joins and aggregations)
- Advanced proficiency in cloud data lakehouse platform such as AWS data lake services Databricks or Hadoop at least one relational data store such as Postgres Oracle or similar and at least one NOSQL data store such as Cassandra Dynamo MongoDB or similar
- Advanced proficiency in at least one scheduling/orchestration tool such as Airflow AWS Step Functions or similar
- Proficiency in Unix scripting data structures data serialization formats such as JSON AVRO Protobuf or similar big-data storage formats such as Parquet Iceberg or similar data processing methodologies such as batch micro-batching or stream
- Significant experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
- Experience customizing changes in a tool to generate product
Preferred qualifications capabilities and skills
- Proficiency in IaC (preferably Terraform alternatively AWS cloud formation).
- Strong Python and Spark
Key Skills
- Anti Money Laundering
- Employee Relations
- Actuarial
- Attorney At Law
- Big Data
- Filing
About Company
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans ov ... View more
