Senior Data Engineer, Compliance Engineering & Technology

Jersey, NJ - USA

Monthly Salary: Not Disclosed

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Responsibilities

Work with engineering and product teams to design develop and manage scalable ETL pipelines to unblock new product launches.

Create brand new and optimize existing data models and schemas on top of Block data including but not limited to eventing customer level and process level data.

Build monitoring to assess the health of the teams infrastructure as well as data quality and lineage.

Participate in on-call rotation monitor daily execution diagnose and log issues and fix business critical pipelines to ensure SLAs are met with internal stakeholders

Work with non-technical partners and product teams to understand their needs translate business requirements into applicable data requirements and come up with automated end-to-end solutions.

Standardize business and product metric definitions in curated and optimized datasets and develop data dictionaries and other related documentation.

Teach and encourage others to self-serve by building tools that make it simpler and faster for them to do so.

Should have experience working on below technology

Snowflake

Databricks

Dbt

Github

Airflow

Prefect

Tableau

Preferred Qualifications/ Skills

A minimum of 8 years of related experience with a Bachelors degree; or 6 years and a Masters degree; or equivalent experience.

High proficiency in SQL

Working experience with Python and Terraform

Experience designing medium-to-large data engineering solutions and responsible for the entire lifecycle of projects including scoping design development testing deployment and documentation

Experience with ETL scheduling technologies with dependency checking such as Airflow or Prefect as well as schema design and dimensional data modeling

Experience with setting up data quality and data lineage monitoring

Experience with financial crimes compliance systems technologies and processes is a big plus

Experience driving data-driven decisions for AI initiatives / agent building is a big plus

Responsibilities Work with engineering and product teams to design develop and manage scalable ETL pipelines to unblock new product launches. Create brand new and optimize existing data models and schemas on top of Block data including but not limited to eventing customer level and process lev...