Data Engineering Lead (Visa Spend Clarity)

The Data Engineering Lead is an individual that has been recognized as a leader and expert developer.  They champion technical excellence while leading the software development process technical design and best practice in their team or teams.  They work to ensure that any software development undertaken by their teams is in alignment with the overall stream goals. 

While they are committed to delivery as part of a team and stream they have a portion of time to work with the engineering practice to improve the company-wide engineering culture practices training and standards at Visa Spend Clarity for Enterprise. They may also assist in the implementation of new standards technologies or methodologies across the broader engineering community. 

You will be part of a team who are growing the capabilities and services in the Visa Spend Clarity to deliver scalable and robust solutions that will take Visa Spend Clarity to more customers and users around the globe. With an engineering group of nearly 300 people Visa Spend Clarity is a key focus area with large growth ambitions driven by customer needs and a desire to innovate using modern cloud technologies. 

Responsibilities include:

• Gathering Requirements: The engineer leads collaboration with stakeholders to determine project requirements. They use their understanding of tradeoffs and project costs to define critical metrics or measures to assess the feasibility of delivery across multiple features and capabilities. They proactively seek clarification on non-functional requirements (NFR) and lead junior engineers in understanding requirements across solution delivery.
• Translating Business Requirements: The engineer translates functional and non-functional requirements into system designs and communicates how the components will interact across teams. They identify and interpret possible solutions and understand requirements and interdependencies in their solution space. The engineer also identifies potential impacts of risks in solutions and communicates these to the team lead.
• System Design and Architecture: The engineer designs and develops complex architectural solutions that are robust scalable and meet the project requirements. They plan and pilot new technology capabilities and features to enhance the systems functionality and user experience.

Skills and competencies include:

• Technical Expertise: The engineer should have advanced technical knowledge relevant to software development. They should be capable of analyzing patterns across bugs and implementing systemic solutions.
• Leadership: The engineer should demonstrate leadership in technical discussions and decisions and be capable of leading junior engineers in understanding requirements.
• Communication: Effective communication with a wide range of stakeholders is crucial. The engineer should be able to translate business requirements into technical ones and vice versa.
• Problem-Solving: The engineer should have strong problem-solving skills with the ability to identify potential impacts of risks in solutions and implement systemic solutions to address patterns across bugs.
• Proactiveness: The engineer should proactively seek clarification on non-functional requirements new knowledge and adapt to new trends technical solutions and patterns.

At Visa this role is classified as Data Engineer Senior Consultant. While it denotes a high level of seniority and scope it is not a people manager role. The position focuses on technical leadership and hands-on engineering rather than team management.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications :

10 years experience in professional software development and data engineering roles.

Solid experience working with:

• Cloud environments AWS preferred
• Data ETL/ELT transformation (e.g. Python Spark SSIS)
• Deep knowledge of Microsoft SQL Server internals
• Data modelling and design experience

Experience required in:

• .NET Core/Standard development in C#
• Streaming data solutions
• Scripting (e.g. PowerShell)
• Data governance
• CI/CD
• Source control (e.g. Git GitHub etc) and continuous integration (e.g. GitHub Actions Code Deploy etc)
• Performance profiling troubleshooting and issue resolution

For someone were looking for at a Senior Consultant level we would like to find these skills.  Itll help set expectations to candidates on what were looking for at least.

Desired experience in:

• Data Analysis / Data Science
• Serverless technologies (e.g. S3 Lambda Glue Athena DynamoDB)
• BI and Reporting technologies (PowerBI SSRS etc)
• Test automation frameworks supporting unit integration end to end testing

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Remote Work :

No

Employment Type :

Full-time