Senior Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
7 hours ago
Vacancies:
1 Vacancy
Job Summary
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way youd like where youll be supported and inspired bya collaborative community of colleagues around the world and where youll be able to reimagine whats possible. Join us and help the worlds leading organizationsunlock the value of technology and build a more sustainable more inclusive world.
Job Description:
As a Senior Data Engineer you will be a member of the ADE Data Development team with a specific focus on developing data solutions for NonFinancial Risk Technology within Morgan this role you will be primarily responsible for the design implementation and support of data workflows and ETL pipelines using Spark/Scala PySpark/Python APIs libraries views and stored procedures. You will also perform data and process analysis monitor and tune queries and optimize data loads.
You will work closely with data providers data scientists developers and data analytics teams to implement clientspecific business requirements and requests.
Your Key Responsibilities:
- Design implement and maintain Spark / PySpark / Scala / Python components flows and codebases for various business and technical requirements
- Design implement and maintain RDBMS databases ensuring optimal performance scalability and data integrity
- Monitor and optimize data access and storage patterns identify and resolve bottlenecks and apply performancetuning techniques
- Write complex SQL queries to analyze data and create views for downstream reporting consumers
- Implement and enforce data security and access controls in compliance with industry standards and regulations
- Conduct database capacity planning forecast future requirements and implement scaling strategies
- Troubleshoot and resolve complex databaserelated issues in collaboration with development and operations teams
- Use Git and Jenkins / CICD pipelines for automated code deployment
- Work with Agile development methodologies
- Demonstrate strong communication skillsverbal and writtencapable of effective collaboration across IT and Business teams across regions
- Apply strong analytical skills to interpret business requirements and convert them into technical designs and solutions
- Act as a selfstarter capable of managing multiple concurrent projects with minimal supervision
- Resolve conflicts in priorities and navigate complex everchanging project needs
- Exhibit strong problemsolving skills and the ability to bring clarity to objectives requirements and priorities
Minimum Qualifications:
- Bachelors degree in engineering technology or computer applications
- 12 years of experience in developing data components and pipelines using Python Spark / PySpark / Scala and SQL
- Proficient in SQL query writing
- Solid understanding of relational databases and Snowflake
- Familiarity with the Software Development Life Cycle (SDLC)
- Excellent communication skills and independent thinking ability
- Strong skills in presenting to stakeholders
Additional Qualifications / Skills:
- Knowledge and experience with Amazon Web Services (AWS) specifically S3
The base compensation range for this role in the posted location is: 97000 to 109000
Capgemini provides compensation range information in accordance with applicable national state provincial and local pay transparency laws. The base compensation range listed for this position reflects the minimum and maximum target compensation Capgemini in good faith believes it may pay for the role at the time of this posting. This range may be subject to change as permitted by law.
The actual compensation offered to any candidate may fall outside of the posted range and will be determined based on multiple factors legally permitted in the applicable jurisdiction.
These may include but are not limited to: Geographic location Education and qualifications Certifications and licenses Relevant experience and skills Seniority and performance Market and business consideration Internal pay equity.
It is not typical for candidates to be hired at or near the top of the posted compensation range.
In addition to base salary this role may be eligible for additional compensation such as variable incentives bonuses or commissions depending on the position and applicable laws.
Capgemini offers a comprehensive non-negotiable benefits package to all regular full-time employees. In the U.S. and Canada available benefits are determined by local policy and eligibility and may include:
- Paid time off based on employee grade (A-F) defined by policy: Vacation: 12-25 days depending on grade Company paid holidays Personal Days Sick Leave
- Medical dental and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g. 401(k) in the U.S. RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
Important Notice: Compensation (including bonuses commissions or other forms of incentive pay) is not considered earned vested or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgeminis discretion consistent with applicable laws. The Company reserves the right to amend or withdraw compensation programs at any time within the limits of applicable legislation.
Disclaimers
Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. Capgemini also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness accessibility inclusion and respect. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment. All qualified applicants will receive consideration for employment without regard to race national origin gender identity/expression age religion disability sexual orientation genetics veteran status marital status or any other characteristic protected by law.
This is a general description of the Duties Responsibilities and Qualifications required for this position. Physical mental sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed provided that such accommodation does not pose an undue hardship. Capgemini is committed to providing reasonable accommodation during our recruitment process. If you need assistance or accommodation please reach out to your recruiting contact.
Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification including during the hiring and onboarding process.
Click the following link for more information on your rights as an Applicant in the United States. is a global business and technology transformation partner helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340000 team members in more than 50 countries. With its strong over 55-year heritage Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering all fueled by its market leading capabilities in AI generative AI cloud and data combined with its deep industry expertise and partner ecosystem.
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
A global leader in consulting, technology services and digital transformation, we offer an array of integrated services combining technology with deep sector expertise.
