Sr. Manager, Data Engineering

With data being the fuel that drives our future - our strategies policies and business successes around data will define our future growth prospects. Unlocking the value available through the innovative use of data on behalf of consumers businesses and communities is key to our future. With our ongoing commitment to Visas Data Values and the responsible use of data we at Visa have a bold vision to continue to grow and accelerate our data-related businesses and capabilities.

Led by Visas first Chief Data Officer the Global Data Office coordinates high-impact complex company-wide projects related to data business strategy critical investments policy development and marketplace execution. Working closely with Visas Chief Privacy Officer the Technology organization the wider data community and the full set of Visas global lines of business the Global Data Office is evolving Visas data-related work with momentum and enthusiasm. Driven by its commitment to trusted use of data Visa is seeking enthusiastic leaders who are change-agents and passionate about the future of data around the world.

We are a Data Engineering team within GDO responsible for designing building and optimizing data pipelines and platforms that power Visas analytics and decisioning capabilities. Our focus is on data quality scalability and reliability enabling seamless integration of complex datasets across regions. By partnering with product and business teams we ensure that data-driven solutions deliver measurable impact and support Visas global innovation strategy.

About the role:

• As a Senior Manager you will be part of this core Data Engineering team primarily working for the Visa Consulting & Analytics line of business.
• In this role you will lead a high-performing team providing technical leadership to the team stakeholder engagement and capacity planning across the different DE projects.
• This position will be in Bengaluru reporting to the Director of Data Engineering.

Primary responsibilities:

Data Engineering Excellence:

• Lead the implementation to build/re-engineer Data solutions overseeing the ingestion processing and management of high-volume multi-dimensional datasets ensuring data quality reliability and scalability.
• Responsible for the Data model architecture aligning with the Data strategy defined by GDO.
• Architect design and implement large-scale data pipelines and ETL processes using big data technologies (e.g. Hadoop Spark Hive Airflow) following the medallion architecture.
• Accountable for overseeing the continuous improvement process by integrating change requests from regional teams on developed solutions.
• Responsible for the on-time delivery of dashboards and model scores/validation outcomes to VCA clients through a streamlined client delivery process.
• Optimize and maintain the Data Solutions and Capabilities in the portfolio proactively identifying and resolving processing performance bottlenecks as necessary.
• Unblock technical issues for the team working in collaboration with the technology teams who manage the data and job orchestration platforms
• Ensure adherence to defined data and security policies adoption of centralized platforms around data catalog tools and technologies.
• Identifes & implement areas of improvement to bring efficiency into development and operations using Gen AI.
• Contribute to identifying and building capabilities as part of Data engineering CoE and Data initiatives.

Project Management:

• Lead project estimation delivering accurate timelines resource planning and risk assessments.
• Develop and maintain comprehensive project plans to ensure alignment with business priorities and timely milestone delivery.
• Lead monthly update meetings with regional stakeholders to review progress share key developments and align priorities for data engineering and ML-based solutions.
• Facilitate open discussions to gather feedback address challenges and incorporate regional needs into solution delivery.
• Communicate clearly and effectively with stakeholders at all levels including executives technical teams and external partners.

Team Management:

• Build mentor and lead a high-performing data engineering team cultivating a culture of innovation ownership and results.
• Develop and drive the strategic vision for data solutions ensuring alignment with GDO and VCA business objectives.
• Collaborate with solution and consulting teams to define priorities and manage the solution backlog for seamless solution development and operations.

Technical skills:

• Big Data Technologies: Advanced experience with Hadoop ecosystem (HDFS Hive Spark EMR). Proficiency in building scalable ETL/data pipelines using tools like Apache Airflow Oozie or similar orchestration frameworks
• Programming & Scripting: Strong coding skills in Python and SQL for data processing transformation and analytics.
• Data Architecture & Modeling: Expertise in designing and implementing large-scale multi-dimensional data architectures. Knowledge of data modeling concepts for both structured and unstructured data.
• Cloud Platforms: Hands-on experience with cloud data platforms (AWS Azure) for storage compute and data pipeline management.
• ML Inferencing: Understanding of ML model lifecycle and experience in generating the scores using ML models.
• Data Quality & Governance: Experience implementing data quality frameworks versioning and governance practices. Ability to ensure data reliability integrity and compliance with internal/external standards.
• Data Visualization & Reporting: Proficiency with visualization tools (Tableau Power BI D3) for presenting data insights to stakeholders.
• Production Systems & Performance Optimization: Experience creating/supporting production-grade software/systems. Proven track record of identifying and resolving performance bottlenecks in data pipelines and systems.
• Collaboration & Communication Tools: Familiarity with collaboration platforms (MS Teams Slack Confluence Jira) for stakeholder engagement and project management
• Version Control & CI/CD: Experience with code management and version control systems (git). Knowledge of CI/CD pipelines for data engineering and ML workflows

People Leadership and Stakeholder Management:

• Strong interpersonal and leadership skills to influence and build credibility with senior leaders across a federated organization.
• Team-oriented collaborative diplomatic and flexible with proven ability to build strong working relationships with internal and external clients at all levels of management and work on complex issues within cross-functional teams.
• Self-starter who can responsibly advance work and is comfortable making sound well-informed judgement calls for progress without needless delays.
• An individual who is known for building deep and trusted relationships despite sometimes competing priorities.
• Open-minded and willing to listen to ideas and opinions from others. Able to look for new solutions when current processes dont work.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications :

12 yrs. work experience with a Bachelors Degree or 10 years of work experience with a Masters or Advanced Degree in an analytical field such as computer science electronics.
Working knowledge of Hadoop ecosystem and associated technologies (For e.g. Apache Spark Python Pandas etc.)
Familiarity with shared services consulting financial services is a strong plus.

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Remote Work :

No

Employment Type :

Full-time