Lead Software Engineer (Java Fullstack, Gen AI)

The Visa Data Catalog (VDC) is a comprehensive metadata management platform designed to provide a centralized repository for all data-related information across the organization. The platform enables efficient data discovery governance and utilization by offering detailed metadata definitions for tables columns and other data assets. It supports various business units by improving data accessibility enhancing data quality and facilitating compliance with data governance policies. Our implementation leverages the open-source DataHub project ensuring a robust flexible and scalable solution.

Key Responsibilities
Develop and maintain the Enterprise Data Catalog (Visa Data Catalog) platform ensuring it aligns with the organizations evolving data needs and strategic objectives.
Design implement and manage robust metadata ingestion processes to keep the catalog current with the latest data definitions business context and usage information.
Collaborate with Product teams the Global Data Governance team and the Privacy Office to deliver features that meet customer and compliance requirements.
Partner with data stewards data owners and other stakeholders to enrich metadata with business definitions data lineage and usage context.
Leverage Generative AI (GenAI) technologies to support Visas 2030 goals and enhance catalog capabilities.
Integrate the data catalog with other enterprise platforms to enable effective governance quality management and analytics.
Monitor and optimize the performance scalability and reliability of the data catalog platform.
Engage with the open-source community contributing to and utilizing advancements in the DataHub project.
Continuously analyze industry best practices to update the catalogs features and ensure scalability.
Advocate for and implement open infrastructure solutions that are modern and purpose-fit.
Dedicate approximately 70 percent of time to hands-on coding across various languages frameworks and technology stacks to deliver high-quality solutions.

Qualifications :

Basic Qualifications
13 or more years of work experience with a Bachelors Degree or with an Advanced Degree (e.g. Masters MBA JD MD) or 8 years of work experience with a PhD
Bachelors degree in computer science or a related technical field required an advanced degree (Masters or PhD) is highly desirable.
Minimum of 13 years of relevant professional experience
At least 8 years of hands-on experience in the architecture design and development of large-scale data management platforms and data-driven applications.
Proven expertise in coding and designing solutions using Java and or Python as well as experience with web services REST APIs and Spring Boot.
Practical experience in leveraging Generative AI tools and technologies with exposure to advanced GenAI capabilities.
Demonstrated proficiency working with distributed big data systems such as Hadoop Hive Spark Kafka and similar technologies.
Strong background in service architecture and development with a focus on building high-performance scalable systems.
Preferred Skills
Familiarity with front-end frameworks such as React or Angular is an advantage.
In-depth knowledge and hands-on experience with big data and cloud computing technologies.
Solid technical background in data with a comprehensive understanding of challenges and solutions in data acquisition ingestion and processing data management distributed processing and high availability.
Experience in the payments industry is a plus.
Interpersonal and Leadership Skills
Results-driven self-motivated and committed to continuous learning with a strong grasp of emerging and advanced technologies.
Proactive in staying current with industry trends leveraging new developments to improve and future-proof existing architectures.
Demonstrated leadership abilities and a collaborative team-oriented mindset.

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Remote Work :

No

Employment Type :

Full-time