Data Operations, Principal
Job Summary
ABOUT THE ROLE
The Principal Data Operations builds and operates the systems that move Hut 8s business and operational data from source systems into reliable secure analytics-ready data products. This includes source integrations API and SFTP ingestion ETL (Airflow) orchestration data transformation warehousing cloud infrastructure configuration monitoring data quality and production support. This is an individual-contributor role. Principal Data Operations candidates will deliver work within established patterns and grow their ownership of production systems. Senior candidates will lead complex technical initiatives improve standards and provide technical guidance through design and code review.
What Youll Do
- Translate business and stakeholder requirements into reliable well-documented data pipelines and services.
- Build and maintain ingestion from APIs SFTP endpoints files databases and cloud services including coordination with external providers.
- Develop and operate Airflow and Google Cloud Composer workflows including dependencies retries backfills and alerting.
- Model and deliver data across BigQuery Snowflake Cloud SQL/PostgreSQL and Google Cloud Storage using dbt data marts and semantic-layer objects.
- Support the cloud infrastructure behind data products including Cloud Run container images Artifact Registry IAM service accounts and Secret Manager.
- Design pipelines for idempotency safe reruns recoverability and failure containment with freshness reconciliation schema and completeness checks.
- Improve observability through logs dashboards alerts and runbooks and validate that downstream data products are complete and accurate.
- Own production support for data systems resolving incidents through root-cause analysis and durable corrective actions.
- Apply least-privilege access secure secrets management and sensitive-data controls and support access reviews and data-governance practices.
- Work within GitHub pull-request testing CI/CD and change-management practices; at the Senior level lead complex integrations migrations reliability initiatives and technical reviews.
ABOUT YOU
- 3 years of experience in data engineering software engineering DataOps or a related field; 5 years for Senior level.
- Bachelors degree in Computer Science Engineering Information Systems or a related field or equivalent experience.
- Strong Python and SQL skills.
- Experience operating production data pipelines.
- Experience with Airflow or Google Cloud Composer.
- Experience with BigQuery Google Cloud Storage and Snowflake.
- Familiarity with Git GitHub pull requests automated testing and CI/CD.
- Linux and Bash familiarity.
- Experience integrating REST APIs SFTP scheduled files or databases.
- Understanding of data quality freshness reconciliation schema evolution and monitoring.
- Strong communication and cross-functional collaboration skills.
PREFERRED QUALIFICATIONS
- 3 years of experience in data engineering software engineering or a related field.
- Bachelors degree in Computer Science Engineering Information Systems or a related field or equivalent experience.
- Strong Python and SQL skills.
- Experience operating production systems and data pipelines.
- Experience with Airflow or Google Cloud Composer.
- Experience with BigQuery Google Cloud Storage and Snowflake.
- Familiarity with Git GitHub pull requests automated testing and CI/CD.
- Experience integrating REST APIs SFTP scheduled files or databases.
- Understanding of data quality freshness reconciliation schema evolution and monitoring.
- Strong communication and cross-functional collaboration skills.
Nice to Haves:
- Experience with dbt data modeling data marts metadata lineage or semantic layers.
- Experience with Cloud Run Artifact Registry IAM Secret Manager Docker or service accounts.
- Experience with Cloud SQL/PostgreSQL or time-series data.
- Experience with Grafana Tableau Metabase or similar reporting tools.
- Experience with finance operational telemetry infrastructure monitoring or other time-series data.
- Experience with data governance access reviews and sensitive-data handling.
- Experience leading technical initiatives or mentoring peers for the Senior level.
ABOUT THE WORK ENVIRONMENT
This role is in office at our corporate headquarters in the Brickell area of Miami Florida. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.