Data Engineer Sr. Consultant level (8 12 Years)
Share
Job Location:
Monthly Salary:
Posted on:
5 hours ago
Vacancies:
1 Vacancy
Job Summary
We value creative and driven individuals who love to own their products and design and implement solutions that create a seamless experience for consumers and clients. Our Data engineers work across the stack and are experts in building data driven business solutions using technologies such as Hadoop Hive Spark Scala Python MS SQL Kafka & Power BI. As we embark on the journey to build a Data Lake we are looking for a Senior Consultant - Data Engineer who can drive architecture design and development activities.
The role involves extensive hands-on activities. Here are key job responsibilities
- Responsible for the architecture design and development
- Work on development of new products iteratively by building quick POCs and converting ideas into real products
- Develop workflows and ETL/ELT code using Hive scripts Spark and other utilities on Hadoop.
- Build analytical applications using Hadoop eco system using packaged or open source technologies
- Build resilient data pipelines for reporting and data science/ML use cases
- Interact with both business and technical stakeholders to deliver high quality products and services that meet business requirements and expectations while applying the latest available tools and technology
- Have a passion for delivering zero defect code and be responsible for ensuring the teams deliverables meet or exceed the prescribed defect SLA
- Present technical solutions capabilities considerations and features in business terms. Effectively communicate status issues and risks in a precise and timely manner.
- Perform other tasks on R&D data governance data security system infrastructure and other cross team functions on an as-needed basis
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.
Qualifications :
Basic Qualifications
9 years of relevant work experience with a Bachelors Degree or at least 7 years of experience with an Advanced Degree (e.g. Masters MBA JD MD) or 2 years of work experience with a PhD OR 11 years of relevant work experience.
Preferred Qualifications
Masters or Bachelor degree in Computer science or related fields required.
Minimum of 9 years of experience in building data driven business solutions and solving data problems
Minimum of 4 years of experience in building large-scale data solutions using open source technologies. Design and coding skills with Big Data technologies like Hadoop Spark Hive Kafka
Minimum of 4 years of hands-on expertise with Java or Scala or Python
Experience with highly distributed scalable concurrent and low latency systems working with one or more of the following database technologies: DB2 MS SQL MySQL and NoSQL data warehouses such as HBase
Experience with Continuous Integration tools such as Jenkins Artifactory etc desirable
Experience with data visualization and business intelligence tools like Power BI is a plus
Experience with Databricksclickkhouse or Microsoft Fabric is advantageous
Additional Information :
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Remote Work :
No
Employment Type :
Full-time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Visa (NYSE: V) is a world leader in digital payments, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories. Our purpose is to uplift everyone, everywhere by being the best way to pay and b ... View more
