Data Engineer

Huntington Beach, CA - USA

Yearly Salary: $ 120000 - 150000

Posted on: 8 hours ago

Vacancies: 1 Vacancy

Department:

Administration

Job Summary

Pay Range:

$120000 - $150000 / year

Our Perks:

Generous PTO plans sick pay and health benefits
Annual bonus based on employment standing*
Work from home and hybrid model employment
Confie Enablement Fund/ Scholarship Program
I-Care Recognition Program
Corporate Social Responsibility Program
Diversity Equity and Inclusion Initiatives
Confie Hub and Discount Programs (Gym Membership)

Purpose

Work under the guidance and supervision of the Director of Enterprise Architecture to build Confies next-generation Enterprise Data Solutions. Requires expertise in implementing and maintaining data solutions on Snowflake data cloud environments that drive critical business insights and operations. Responsible for developing robust data models creating efficient ELT processes and optimizing performance to support the organizations data needs

Essential Duties & Responsibilities

Design and develop data pipelines ETL workflows to populate the cloud Data Lake and Data Warehouse on Snowflake with transformation tools (e.g. Coalesce WhereScape Azure Data Factory) and replication tools (e.g. Fivetran Airbyte etc.)

Translate business requirements into technical specifications; establish and define details definitions and requirements of applications components and enhancements

Design and develop robust and scalable data pipelines to support data integrations using Snowflake Coalesce Python Airflow and Fivetran

Design and develop Snowflake data objects (tables views stored procedures udfs etc.)

Implement ELT (Extract Load Transform) processes using Snowflakes features such as SnowPipe Streams and Tasks

Perform data cleaning analysis and integration using Python

Ability to work with multiple data sources and types (structured/semi-structured/unstructured)

Design and implement efficient data models and schemas within Snowflake to support reporting analytics and business intelligence needs

Monitor and optimize query performance and resource utilization within Snowflake using query profilling query optimization techniques and workload management features

Identify and resolve performance bottlenecks and optimize data warehouse configurations for maximum efficiency

Implement processes and systems to monitor data quality. ensuring production data is always accurate and available for key stakeholders and business processes that depend on it

Monitor data pipelines for timely and accurate completion

Stay up-to-date with industry trends and advancements in data engineering continuously improving the teams technical knowledge and skills

On-call support

Qualifications and Education Requirements

4 years of professional experience in data engineering designing and implementing data pipelines and building data infrastructure

4 years of strong experience required in Snowflake data cloud and ETL development including Snowflake procedures udfs in Python and SQL streams tasks Snowpipe and working with semi-structured data

3 years of strong experience with Python programming and extensively used frameworks/packages like Snowpark pandas numpy and requests for Data Analysis and integration

Solid understanding of data warehousing concepts dimensional modeling and data integration techniques

2 years of strong experience with data integration and transformation tools like Coalesce WhereScape and Azure Data Factory

Experience with data quality and observability concepts is a plus

Bachelors degree in Computer Science Engineering or a related field

Snowflake Advanced Certification is a plus

Additional certifications related to data platforms are a plus

Other Duties

This job description is not designed to cover or contain a comprehensive listing of activities duties and responsibilities that are required of the employee for this job. Duties responsibilities and activities may change at any time with or without notice

Notice

As permitted by applicable law and from time-to-time Confie may use a computer system that has elements of artificial intelligence to help make decisions about your employment including recruitment hiring renewal of employment or the terms and conditions of your employment. Employees with questions about Confies use of these computer systems should contact Human Resources at

Required Experience:

Pay Range:$120000 - $150000 / yearOur Perks:Generous PTO plans sick pay and health benefitsAnnual bonus based on employment standing*Work from home and hybrid model employmentConfie Enablement Fund/ Scholarship ProgramI-Care Recognition ProgramCorporate Social Responsibility ProgramDiversity Equity ...