The Senior Data Engineer will design build and optimize scalable data pipelines cloud-based data solutions and advanced analytics frameworks that support Visas enterprise data ecosystem. This role requires deep technical expertise cross-functional collaboration and ownership of endtoend data engineering initiatives.
Responsibilities:
- Design build and optimize scalable data pipelines for ingesting and processing structured and unstructured data within the Hadoop data lake and cloud environments.
- Architect and develop new data pipelines data models and analytical frameworks that provide intuitive actionable insights to internal and external customers.
- Develop tools automation and self-service capabilities that enhance data accessibility and improve analytics efficiency across the organization.
- Create repeatable automated data engineering processes that support business users and reduce manual operational efforts.
- Lead and execute data engineering projects of varying scope and complexity both independently and as part of a cross-functional team.
- Partner with engineering analytics and product teams in high-visibility roles to deliver robust end-to-end data solutions.
- Support the scoping design and development of analytic data assets and data products.
- Maintain and enhance data engineering best practices governance standards and scalable architectures across Hadoop and cloud platforms.
- Participate in R&D initiatives infrastructure enhancements and cross-team technology efforts.
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.
Visa does not offer relocation assistance or immigration sponsorship for this role now or in the future.
Qualifications :
Basic Qualifications:
- 2 or more years of relevant work experience and a Bachelors degree OR 5 years of relevant work experience
Preferred Qualifications:
- 3 or more years of work experience with a Bachelors Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters MBA JD MD)
- Proficient in Hadoop Spark PySpark Scala and Python for largescale data processing.
- Strong SQL skills with experience in performance tuning indexing and query optimization.
- Hands-on experience with relational and NoSQL databases data modeling and data warehousing.
- Expertise in writing optimizing and tuning SQL for high performance and efficient data retrieval.
- Skilled with Presto Impala SparkSQL and Hive for big-data querying.
- Proficient in Tableau and Power BI for analytics and visualization.
- Strong experience with Databricks including notebook/job optimization Delta Lake cluster management CI/CD and performance tuning.
- Skilled in AWS GCP and Azure for scalable data architectures using cloud-native tools for ingestion processing and orchestration.
- Advanced experience with Apache Spark for batch and nearreal-time analytics.
- Experience designing implementing and managing relational (RDBMS) and non-relational (NoSQL) databases.
- Proficiency in data modeling and data warehousing methodologies supporting BI and analytics workloads.
Additional Information :
Work Hours: Varies upon the needs of the department.
Travel Requirements: This position requires travel 5-10% of the time.
Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk communicate in person and by telephone frequently operate standard office equipment such as telephones and computers.
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law including the requirements of Article 49 of the San Francisco Police Code.
U.S. APPLICANTS ONLY: The estimated salary range for this position is $110700 to $171800 USD per year which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge skills experience and addition this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical Dental Vision 401 (k) FSA/HSA Life Insurance Paid Time Off and Wellness Program.
Remote Work :
No
Employment Type :
Full-time
The Senior Data Engineer will design build and optimize scalable data pipelines cloud-based data solutions and advanced analytics frameworks that support Visas enterprise data ecosystem. This role requires deep technical expertise cross-functional collaboration and ownership of endtoend data enginee...
The Senior Data Engineer will design build and optimize scalable data pipelines cloud-based data solutions and advanced analytics frameworks that support Visas enterprise data ecosystem. This role requires deep technical expertise cross-functional collaboration and ownership of endtoend data engineering initiatives.
Responsibilities:
- Design build and optimize scalable data pipelines for ingesting and processing structured and unstructured data within the Hadoop data lake and cloud environments.
- Architect and develop new data pipelines data models and analytical frameworks that provide intuitive actionable insights to internal and external customers.
- Develop tools automation and self-service capabilities that enhance data accessibility and improve analytics efficiency across the organization.
- Create repeatable automated data engineering processes that support business users and reduce manual operational efforts.
- Lead and execute data engineering projects of varying scope and complexity both independently and as part of a cross-functional team.
- Partner with engineering analytics and product teams in high-visibility roles to deliver robust end-to-end data solutions.
- Support the scoping design and development of analytic data assets and data products.
- Maintain and enhance data engineering best practices governance standards and scalable architectures across Hadoop and cloud platforms.
- Participate in R&D initiatives infrastructure enhancements and cross-team technology efforts.
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.
Visa does not offer relocation assistance or immigration sponsorship for this role now or in the future.
Qualifications :
Basic Qualifications:
- 2 or more years of relevant work experience and a Bachelors degree OR 5 years of relevant work experience
Preferred Qualifications:
- 3 or more years of work experience with a Bachelors Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters MBA JD MD)
- Proficient in Hadoop Spark PySpark Scala and Python for largescale data processing.
- Strong SQL skills with experience in performance tuning indexing and query optimization.
- Hands-on experience with relational and NoSQL databases data modeling and data warehousing.
- Expertise in writing optimizing and tuning SQL for high performance and efficient data retrieval.
- Skilled with Presto Impala SparkSQL and Hive for big-data querying.
- Proficient in Tableau and Power BI for analytics and visualization.
- Strong experience with Databricks including notebook/job optimization Delta Lake cluster management CI/CD and performance tuning.
- Skilled in AWS GCP and Azure for scalable data architectures using cloud-native tools for ingestion processing and orchestration.
- Advanced experience with Apache Spark for batch and nearreal-time analytics.
- Experience designing implementing and managing relational (RDBMS) and non-relational (NoSQL) databases.
- Proficiency in data modeling and data warehousing methodologies supporting BI and analytics workloads.
Additional Information :
Work Hours: Varies upon the needs of the department.
Travel Requirements: This position requires travel 5-10% of the time.
Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk communicate in person and by telephone frequently operate standard office equipment such as telephones and computers.
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law including the requirements of Article 49 of the San Francisco Police Code.
U.S. APPLICANTS ONLY: The estimated salary range for this position is $110700 to $171800 USD per year which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge skills experience and addition this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical Dental Vision 401 (k) FSA/HSA Life Insurance Paid Time Off and Wellness Program.
Remote Work :
No
Employment Type :
Full-time
View more
View less