Associate Data Engineer
Associate Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
- Develop a deep understanding of Visas data assets and how they can be used to support Data Science activities across the company
- Execute data engineering projects ranging from small to large either individually or as part of a project team.
- Build and maintain ETL pipelines in Spark Python or HIVE that process transaction and account level data and standardize data fields across various data sources
- Troubleshoot
- Design develop and maintain reusable data assets
- Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy integrity and consistency
- Collaborate with Data Engineering teams in North America and other Global regions to production and maintenance of key data assets.
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.
Qualifications :
Required qualifications:
- Bachelors Degree in an analytical field such as computer science statistics finance economics or relevant area.
- Entry level experience of Hadoop ecosystem and associated technologies (For e.g. Apache Spark MLlib GraphX iPython sci-kitPandas etc.)
- Working knowledge in writing and optimizing efficient SQL queries with Python Hive Scala handling Large Data Sets in Big-Data Environments.
- Experience managing large-scale datasets using Big Data and distributed processing platforms such as Hadoop Hive and Spark
- Experience with Visualization Tools like Tableau Power BI D3
- Experience with modern DevOps practices (including Git and CI/CD)
- Experience with Unix/Shell and exposure to Scheduling tools such as Airflow.
- Strong problem-solving skills
Preferred qualifications:
- Functional knowledge of cloud computing platforms such as AWS Azure or GCP
- Background in payments or banking
Additional Information :
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Remote Work :
No
Employment Type :
Full-time
Employment Type
Full-time
