Lead Data Engineer PySparkAWS
Share
Job Location:
Monthly Salary:
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
We have an opportunity to impact your career and provide an adventure where you can push the limits of whats possible.
As a Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Banking - Payments Technology Regulatory Reporting Team you play a crucial role in an agile team dedicated to enhancing building and delivering trusted market-leading technology products in a secure stable and scalable manner. As a core technical contributor you are tasked with developing critical technology solutions across multiple technical domains supporting various business functions to achieve the firms business objectives.
Job responsibilities
- Executes creative software solutions design development and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Develops secure high-quality production code and reviews and debugs code written by others
- Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
- Leads evaluation sessions with external vendors startups and internal teams to drive outcomes-oriented probing of architectural designs technical credentials and applicability for use within existing systems and information architecture
- Leads communities of practice across Software Engineering to drive awareness and use of new and leading-edge technologies
- Adds to team culture of diversity opportunity inclusion and respect
Required qualifications capabilities and skills
- Formal training or certification on software engineering concepts and 5 years applied experience
- Hands-on practical experience in system design application development testing and operational stability
- Advanced hands-on capability coding in one or more data engineering languages/platforms - Python / PySpark / Databricks or similar
- Proficiency in automation and continuous delivery methods
- Proficient in all aspects of the Software Development Life Cycle
- Advanced understanding of agile methodologies such as CI/CD Application Resiliency and Security
- Demonstrated proficiency in software applications and technical processes within a technical discipline (e.g. cloud artificial intelligence machine learning mobile etc.)
- In-depth knowledge of the financial services industry and their IT systems
Practical cloud native experience
- Exposure to cloud technologies Databricks AWS MSK EC2 EKS S3 RDS Lambdas
- Exposure to payment domain streaming systems
- Exposure to payment regulatory reporting
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans ov ... View more
