Data Bricks & Pyspark Software Engineer II

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorganChase within the ENTERPRISE TECHNOLOGY(EMPLOYEE DIGITAL AND SERVICE EXP) you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure stable and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firms business objectives.

Job responsibilities

• Execute creative software and data solutions including design development and technical troubleshooting by thinking beyond routine approaches to build solutions or break down technical problems.
• Develop secure high-quality production code and data pipelines reviewing and debugging processes implemented by others.
• Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.
• Work with business stakeholders to understand requirements and design appropriate solutions producing architecture and design artifacts for complex applications.
• Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues optimizing performance and throughput.
• Implement data quality checks and validation processes to ensure accuracy and reliability of data.
• Help design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.

• Gather analyze and synthesize large diverse data sets to continuously improve capabilities and user experiences leveraging data-driven insights.

Required qualifications capabilities and skills

• Formal training or certification in software engineering concepts with 2 years of applied experience
• 3 years in data engineering including design application development testing and operational stability.
• Advanced proficiency in data processing frameworks and tools including Parquet Iceberg PySpark Glue Lambda Databricks and AWS data services like EMR Athena and Redshift.
• Proficiency in programming languages like Python Java or Scala for data processing and application development.
• Proficiency in automation and continuous delivery methods utilizing CI/CD pipelines with tools like Git/Bitbucket Jenkins or Spinnaker for automated deployment and version control.
• Hands-on practical experience delivering system design application development testing and operational stability
• Understanding of agile methodologies application resiliency and security.
• Demonstrated proficiency in software applications and technical processes within technical disciplines like cloud artificial intelligence machine learning and mobile.
• Proficiency in database management and data modeling working with relational databases like Oracle or SQL Server.

Preferred qualifications capabilities and skills

• AWS Certification
• Databricks Certification
• Experience with scheduling tools like Autosys & Airflow to automate and manage job scheduling for efficient workflow execution.
• In-depth knowledge of the financial services industry and their IT systems.