Snowflake Platform Consulting and Implementation

Snowflake Platform Consulting and Implementation

Project Role: Data Engineer

Contract: 12 months

Location: Sacramento CA 95811

Work Mode: Onsite

Interview: In person (F2F)

Overview: We are seeking highly skilled Snowflake Data Engineers / Consultants to support client in its Investment Office Data & Technology Modernization project. The consultant(s) will design build and implement a modern data platform leveraging Snowflake Data Cloud Microsoft Azure dbt Prefect and related technologies. The role involves conducting infrastructure assessments implementing robust data solutions and delivering knowledge transfer sessions to ensure client achieves a secure scalable and cost-effective data ecosystem.

Key Responsibilities/Tasks:

The engagement begins with an infrastructure assessment where the vendor will perform a detailed gap analysis of clients existing data architecture tools and processes identify inefficiencies and recommending optimizations aligned with industry best practices. The vendor will deliver critical documentation including an assessment report target state architecture and future-state process design to establish a robust foundation for the implementation phase. Following this the vendor will design build and implement a modern centralized data platform leveraging Snowflake Data Cloud Microsoft Azure dbt Prefect and related technologies. This platform will streamline data access enhance analytics capabilities and ensure scalability security and governance through a Hub & Spoke architecture robust data models and semantic layers. Finally the vendor will conduct knowledge transfer sessions providing hands-on training workshops and detailed documentation to equip clients staff with the skills and tools needed to manage optimize and expand the platform independently. These services will ensure client achieves a secure scalable and cost-effective data ecosystem aligned with its organizational goals.

The scope of this project encompasses the following deliverable base tasks:

Infrastructure Assessment and Recommendations:

• This assessment will include a detailed analysis of ETL tools processes and patterns encompassing Python scripts Prefect orchestration data pipelines Snowflake database and dbt workflows.
• The vendor will also evaluate the current data schema organization ETL processing standards and methodology to identify inefficiencies and opportunities for optimization.
• Key areas of focus will include performance scalability security resilience and reliability of the existing architecture.
• Deliverables for this phase will include a comprehensive assessment report a target state architecture document and a future-state process design.
• These outputs will serve as the foundation for the implementation phase ensuring that the Snowflake platform is built on a solid well-defined framework.
• The vendor will work closely with client teams to review and approve these deliverables ensuring alignment with organizational goals and priorities.
• This phase will also establish the groundwork for strong collaboration between the vendor and client setting expectations for the subsequent implementation phase.
• Solution design will adhere to Client policies and software assessments.

Data Platform Implementation:

• Building on the recommendations from the assessment phase the vendor will design build and implement a modern data platform using Snowflake Data Cloud Microsoft Azure dbt Prefect and related technologies.
• This platform will serve as a centralized secure and scalable data hub enabling client to streamline data access enhance analytics capabilities and support data-driven decision- making across the enterprise.
• The implementation will follow a Hub & Spoke architecture with the Hub serving as the centralized repository for standardized governed and curated data and the Spokes supporting specific data applications and business functions.
• Separate environments for Development User Acceptance Testing (UAT) and Production will be established to support testing validation and deployment processes.
• The vendor will also implement robust data governance practices including lineage tracking monitoring tools and access controls to ensure consistent data quality and security.
• Logical and physical data models such as star and snowflake schemas will be defined and implemented to support advanced analytics and reporting.
• Semantic layers will be created to enable business users to access and analyze data efficiently.
• Deliverables for this phase will include a fully configured data platform data pipelines security and documentation.
• The data platform is a Snowflake data Hub environment with integrations security documentation process flows component diagrams dbt model documentation and CI/CD scripts that implement the design and architecture from Deliverable 1.
• The vendor will also deliver starter data models and fully functional Spokes including ELT workflows dbt models and Prefect orchestration that address operational business needs throughout the Investment Office.
• The vendor will provide detailed documentation and training materials to support ongoing operations and future enhancements.
• This phase will culminate in the delivery of a secure scalable and cost-effective data platform aligned with clients organizational goals and priorities.

Knowledge Transfer and Operational Readiness:

• The vendor will conduct comprehensive knowledge transfer sessions to ensure Client staff are fully equipped to manage optimize and extend the Snowflake Data Cloud platform independently.
• These sessions will include hands-on training workshops and detailed walk-throughs of the platforms architecture ELT pipelines data governance practices and security configurations.
• The vendor will provide documentation covering all aspects of the implementation including technical architecture process flows data pipelines CI/CD scripts operating model and best practices for ongoing maintenance and scalability.
• Additionally the vendor will deliver a support plan and troubleshooting guidelines to empower Client teams to address future challenges effectively.
• By the end of this phase Client staff will have the skills tools and confidence to operate optimize and expand the Snowflake Data Platform.

Minimum Qualifications

1. Vendor has verifiable experience designing and implementing production data warehouse and data analytics solutions for investment clients that leverage the technology stack that includes Snowflake dbt Prefect Azure DevOps (and other Azure data services) and a data catalog.

2. Vendor has implemented two or more investment data warehouse/data analytics solutions.

a. Clients include public sector agencies

b. Included preferred technology stack (Snowflake dbt Prefect Azure DevOps

c. Included data pipeline design and implementation

d. Includes a data catalog solution

e. Includes data governance and master data management

3. Experience in conducting comprehensive infrastructure assessments including gap analysis of architecture ETL tools processes and patterns with recommendations for performance resilience reliability and alignment with industry best practices.

4. Vendor maintains an internal team of investment/finance data professionals experienced in investment/financial data warehouses and data analytics applications using the preferred technology stack (Snowflake dbt Prefect Azure).