Data Engineer Sr Consultant level

CMS divisions charter is to capture new sources of money movement through card and non-card flows including Visa Business Solutions Government Solutions and Visa Direct which presents an enormous growth opportunity. Our team brings payment solutions and associated services to clients around the globe. Our global clients and partners deploy our solutions to serve the needs of Small Businesses Middle Market Clients Large Corporate Clients Multi Nationals and Governments. 

The Visa Business Solutions (VBS) and Visa Government Solutions (VGS) team is a world-class technology organization experiencing tremendous double-digit growth as we expand products into new payment flows and continue to grow our core card solutions. This is an incredibly exciting team to join as we expand globally. 

Essential Functions:

• Strong technology and leadership background delivering enterprise-scale data and AI solutions using Scala/Java Python Spring Boot REST/gRPC APIs SQL/NoSQL databases and modern UI frameworks such as Angular/React. Expertise with distributed systems cloud-native architectures and microservices is essential.
• Deep experience in modern Data Engineering including Spark (Structured Streaming) Databricks Kafka Airflow DBT Delta Lake/Apache Iceberg and large-scale ETL/ELT pipelines across cloud platforms (AWS/GCP/Azure).
• Ability to design implement and operationalize data platforms & pipeline frameworks using open-source and cloud-native technologies such as Hadoop ecosystem Spark Hive HBase Flink Kafka Kinesis BigQuery/Snowflake/Redshift.
• GenAI and LLM engineering exposure including prompt engineering LLM finetuning RAG (RetrievalAugmented Generation) vector databases (Pinecone FAISS Weaviate Milvus) and integration of foundation models (OpenAI Anthropic Gemini Llama).
• Experience building LLMOps pipelines: model versioning deployment monitoring evaluation and reinforcement learning from human feedback (RLHF) workflows.
• Champion Design Architecture and Coding best practices performing code reviews improving engineering quality and technically leading and mentoring a small team.
• Hands-on experience with CI/CD and DevOps/MLOps tools such as Jenkins GitHub Actions GitLab CI Argo CD Terraform Docker Kubernetes Helm Artifactory Selenium and configuration tools like Chef/Ansible.
• Familiarity with machine learning data science and statistical modeling (regression clustering decision trees time-series modeling) and experience partnering with ML teams to productionize models.
• Responsible for designing and building scalable secure cloud-based distributed systems and data platforms ensuring resiliency governance lineage and data quality using tools like Great Expectations Monte Carlo Collibra and Apache Atlas.
• Experience managing global/remote teams across different time zones and driving effective collaboration.
• Partner closely with product managers to shape long-term vision capability strategy and roadmap aligned to business objectives.
• Work collaboratively with senior engineers to establish architecture blueprints evaluate new technologies and define reusable components for new product development.
• Enforce strong software engineering standards (documentation testing coding conventions) and ensure high-quality deliverables on demanding timelines.
• Lead project planning prioritization stakeholder management delivery tracking and cross-functional communication.
• Ensure operational excellence through monitoring observability (Prometheus Grafana New Relic) reliability engineering and production support best practices.
• Identify opportunities for innovation process optimization automation and standardization across the data and AI ecosystem.
• Mentor junior team members guide architectural decisions establish departmental best practices and engineering playbooks.
• Participate in hiring developing and retaining world-class data ML and GenAI engineering talent.
• Demonstrate strong stakeholder and negotiation skills acting as a trusted ambassador between engineering business units and executive leadership to balance strategic trade-offs.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications :

Bachelor degree in a technical field such as computer science computer engineering or related field required. Advanced degree preferred
Requires 10 years of experience at least 3 of which were in leading engineering teams
6 years of hands-on experience in Hadoop using Core Java Programming Spark Scala Hive MongoDB Streaming Kafka and any ETL tool exposure
Strong knowledge of Database concepts and UNIX
Experience in handling very large data volume in low latency and/or batch mode
Proven experience delivering large scale highly available production software
Ability to handle multiple competing priorities in a fast-paced environment
A deep understanding of end-to-end software development in a team and a track record of shipping software on time
Payment processing background desirable but not required
Experience working in an Agile and Test-Driven Development environment
Strong business and technical vision
Outstanding verbal written presentation facilitation and interaction skills including ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management
Quick learner self-starter detailed and work with minimal supervision

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Remote Work :

No

Employment Type :

Full-time