Senior Analytical Engineer

We are seeking a forward-thinking and hands-on Senior Manager to lead our Analytics Engineering this high-impact role you will act as the primary architect and lead developer for our analytics ecosystem. You will be responsible for migration of Cloud data and establishing Microsoft Fabric as our central analytics hub and executing complex data pipelines.

This is a technical leadership role for a builder. You will drive an AI-First methodology leveraging AI coding assistants to accelerate development while designing data structures that power future AI Agents and LLMs. You will define the standards write the core code and own the technical roadmap.

Responsibilities:

Architecture & AI Strategy:

• Fabric Architecture: Design and implement the end-to-end Medallion Architecture (Bronze/Silver/Gold) within Microsoft Fabric ensuring data is structured not just for BI reporting but optimized for AI/ML integration.
• Data for AI: Lead the strategy for building Data for AI pipelinespreparing unstructured text and data for vectorization RAG (Retrieval-Augmented Generation) and AI Agent consumption.
• AI-First Development: Champion the use of AI coding assistants (e.g. Copilot Cline Claude Code) to generate boilerplate code write unit tests and document logic setting the standard for high-velocity development.

Migration & Pipeline Execution:

• Hadoop Migration: Lead the technical strategy and execution of migrating on-prem Hadoop data to the Cloud (AWS/Azure) and connecting it to Fabric.
• Complex Pipeline Development: Build and maintain complex PySpark notebooks and data flows. Orchestrate data movement between on-prem cloud and hybrid data systems specifically sourcing information from CRM/ERP systems such as Microsoft Dynamics or Salesforce.
• Legacy Integration: Utilize deep knowledge of Bash Unix and HDFS to interact with legacy systems during the migration phase.

DevOps Standards & Project Management:

• Code Quality & Governance: Act as the gatekeeper for the GitHub repository. Enforce strict CI/CD practices manage branching strategies and perform code reviews to ensure production-grade quality.
• Project Leadership: Manage the engineering roadmap using tools like Jira or Jira Align. Translate high-level business requirements from stakeholders into technical sprints and deliverables.
• Collaboration: Partner with the BI team to ensure Gold layer data models are optimized for downstream reporting and analysis.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications :

Basic Qualifications:

• 8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters MBA JD MD) or 2 years of work experience with a PhD

Preferred Qualifications:

• 9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters MBA JD MD) or 3 or more years of experience with a PhD

Experience & Leadership:

• 7 years of Analytical Engineering experience.
• Proven experience leading technical projects architecture design or migrations (formal people management experience is not required but technical leadership is essential).

Technical Mastery:

• Core Stack: Mastery of Python/PySpark SQL and Airflow.
• Legacy Stack: Expert familiarity with Bash Unix Hadoop Hive Trino SSH the terminal and HDFS.
• Cloud & Platforms: Strong experience with Microsoft Fabric Azure Databricks Synapse and/or AWS.
• DevOps: Proficient in GitHub flows (Branching Merging Reverting) GitHub Actions and Test-Driven Development (TDD).

AI & Innovation:

• Demonstrated interest or experience in Generative AI (specifically tools like Cline and/or Claude Code) for building data foundations or process automation.
• Strong experience with context and prompt engineering token management and sub-agent management.
• Ability to leverage AI tools to accelerate coding velocity and enforce coding standards.

Additional Information :

Work Hours: Varies upon the needs of the department.

Travel Requirements: This position requires travel 5-10% of the time.

Mental/Physical Requirements: This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk communicate in person and by telephone frequently operate standard office equipment such as telephones and computers.

Visa is an EEO Employer.  Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status.  Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law including the requirements of Article 49 of the San Francisco Police Code.

U.S. APPLICANTS ONLY: The estimated salary range for this position is 127300 to USD per year which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge skills experience and addition this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical Dental Vision 401 (k) FSA/HSA Life Insurance Paid Time Off and Wellness Program.

Remote Work :

No

Employment Type :

Full-time