Sr Data Engineer4 Yrs Hadoop Scala Python Java
Sr Data Engineer4 Yrs Hadoop Scala Python Java
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Description
Team Summary
The Risk Solution Services (RSS) team part of the Acceptance Risk organization includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules maximizing automated acceptance while minimizing fraud losses.
What a Sr Data Engineer does at Visa:
The Sr Data Engineer will be a member of RSS team in Asia Pacific. The position will be based in Visas Bangalore office.
The individual will be accountable for supporting and driving the design development and implementation of analyticsdriven strategies as well as highimpact solutions for Visa clients. He/she will bring in deep expertise from banking and payments with a strong background in data pipelines to solve complex problems and unlock business value.
Responsibilities
Experience on developing maintaining and supporting big data ETL pipelines (Hadoop Hive Spark)
Responsible for the implementation and test of scalable distributed ensuring security timeliness and quality of data.
Experience supporting production systems
Work closely with other engineers and peers to design and develop ETL pipelines
Work with product managers in understanding and clarifying on the requirements
Demonstrate inclination towards continuous learning and professional development.
Proven track record of quickly acquiring new skills and knowledge in a fastpaced environment.
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 23 set days a week (determined by leadership/site) with a general guidepost of being in the office 50% or more of the time based on business needs.
Qualifications :
Qualifications
Basic Qualifications
2 or more years of work experience with a Bachelors Degree or an Advanced Degree (e.g. Masters MBA JD MD or PhD)
Preferred Qualifications
5 yrs. work experience with a Bachelors degree or 4 Masters or Advanced degree in an analytical field such as computer science statistics finance economics or relevant area.
Working knowledge of Hadoop ecosystem and associated technologies (For e.g. Apache Spark etc.)
Experience in writing Spark and Hive code to process large data sets in Hadoop environments
Strong experience with SQL for extracting aggregating and processing big data using Hadoop
Development experience in one or more of the following: Scala Python or Java.
Basic experience with Unix/Shell or Python scripting
Exposure to Scheduling tools like Airflow and Control M will be a plus
Experience using VCS like Git
Basic understanding of RDBMs viz MS SQL DB2 Oracle etc for data retrieval
Understanding of Kafka Apache Hudi is a plus.
Additional Information :
Additional information
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
