Yaroslav Smekhnov – Data Engineer | Public Profile on Dr.Job

About Me

Data Engineer experienced in building and maintaining reliable data pipelines, data warehouse loading processes, and replication workflows. Skilled in data migration, data anonymization, performance optimization, data qu…

Experience

DATA ENGINEER

Glowbyte Consulting · Annino , Moscow Oblast , Russia

Jun 2024 - Present · 2 years 1 month

Migration of data and ETL processes from Informatica/Oracle to Airflow and Greenplum, Personal data anonymization in DWH data marts (Greenplum, Hadoop), Development of a data replication layer: Greenplum → Oracle, Development of a data replication layer: Oracle/Greenplum → HDFS

Data Engineer

Glowbyte Consulting

Jan 2024 - Present · 2 years 6 months

Migration of data and ETL processes from Informatica/Oracle to Airflow and Greenplum.
Personal data anonymization in DWH data marts (Greenplum, Hadoop).
Development of a data replication layer: Greenplum → Oracle.
Development of a data replication layer: Oracle/Greenplum → HDFS.
Built and maintained ETL/ELT pipelines for DWH loading in Oracle and Greenplum using Airflow, Oozie, and Spark.
Implemented data anonymization for Hadoop-based data marts, covering ~113 replicas and 36 data marts.
Optimized SQL/ETL workflows and improved data loading performance.
Performed source-to-target reconciliation and data quality validation in DEV/TEST environments.
Automated ETL entity and script generation, reducing manual effort.

Skills

Linux Oracle PostgreSQL Python Data Migration Data Quality Hadoop Hive OLAP PySpark Docker PL/SQL SQL ETL/ELT Data Warehousing Data Replication Apache Spark HDFS Apache Airflow Apache Oozie Greenplum Git ETL ELT