Senior Software Engineer - Data Engineer: Python/Scala Developer with Spark and Snowflake
Senior Software Engineer - Data Engineer: Python/Scala Developer with Spark and Snowflake
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Strong in Python/Scala scripting minimum 3 yrs
Must have hands on experience implementing AWS Big data lake using EMR and Spark.
Working experience with Spark Hive Message Queue or Pub/Sub Streaming technologies (3 years)
Have 6 years of experience developing data pipelines using mix of languages (Python Scala SQL etc.) and open source frameworks to implement data ingest processing and analytics technologies.
Experience leveraging open source big data processing frameworks such as Apache Spark Hadoop and streaming technologies such as Kafka.
Hands on experience with newer technologies relevant to the data space such as Spark Airflow Apache Druid Snowflake (or any other OLAP databases).
Experience developing and deploying data pipelines and real-time data streams within a cloud native infrastructure preferably AWS
Experience in using CI/CD pipeline (Gitlab)
Experience in Code Quality implementation (Used Pep8/Pylint) tools or any other code quality tool.
Experience of Python Plugins /operators like FTP Sensor Oracle Operator etc.
Implement Industry Standards /Best Practices.
Excellent analytical and problem-solving skills
Excellent verbal and written communication skills
Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development Support and Deployment.
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.
Software Engineers perform requirements analysis. They then design develop or maintain the physical application (components) or the application environment based on the Software Architecture (models and principles). Activities include coding integrating implementing installing or changing frameworks and standard components or technical and functional application management. A Software Engineer also develops languages methods frameworks and tools and/or undertakes activities in support of server-based databases in development test and production environments.
Required Skills and Experience:
You have mastered several Software Engineering areas applications or database environments. You act as a Software Engineering stream leader with technical delivery ownership within a (limited) number of technology areas. You contribute to bids or client proposals based on your technological expertise. You also act as a team leader with delivery ownership and guide individuals and groups towards desired outcomes. You actively participate in at least one community and contribute to community discussions.
Qualification: 7-10 years (3 years min relevant experience in the role) experience Bachelors Degree.
Certification: Should have SE Level 1 and seeking level 2.
Should be proficient in Business Analysis Business Knowledge Software Engineering Testing Data Management Architecture Knowledge and Technical Solution Design.
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race national origin gender identity/expression age religion disability sexual orientation genetics veteran status marital status or any other characteristic protected by law.
This is a general description of the Duties Responsibilities and Qualifications required for this position. Physical mental sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed provided that such accommodations do not pose an undue hardship.
Required Experience:
Senior IC
Employment Type
Full-Time
