Yaroslav Smekhnov

Yaroslav Smekhnov

Data Engineer
Mytishchi Urban Okrug , Moscow Oblast , Russia
English, Russian
Contract Work from Home

نبذة عني

Data Engineer experienced in building and maintaining reliable data pipelines, data warehouse loading processes, and replication workflows. Skilled in data migration, data anonymization, performance optimization, data qu…

الخبرة

DATA ENGINEER

Glowbyte Consulting · Annino , Moscow Oblast , Russia
Jun 2024 - حتى الآن · 2 سنوات 1 شهر

Migration of data and ETL processes from Informatica/Oracle to Airflow and Greenplum, Personal data anonymization in DWH data marts (Greenplum, Hadoop), Development of a data replication layer: Greenplum → Oracle, Development of a data replication layer: Oracle/Greenplum → HDFS

Data Engineer

Glowbyte Consulting
Jan 2024 - حتى الآن · 2 سنوات 6 أشهر

Migration of data and ETL processes from Informatica/Oracle to Airflow and Greenplum.
Personal data anonymization in DWH data marts (Greenplum, Hadoop).
Development of a data replication layer: Greenplum → Oracle.
Development of a data replication layer: Oracle/Greenplum → HDFS.
Built and maintained ETL/ELT pipelines for DWH loading in Oracle and Greenplum using Airflow, Oozie, and Spark.
Implemented data anonymization for Hadoop-based data marts, covering ~113 replicas and 36 data marts.
Optimized SQL/ETL workflows and improved data loading performance.
Performed source-to-target reconciliation and data quality validation in DEV/TEST environments.
Automated ETL entity and script generation, reducing manual effort.

المهارات

لينكس أوراكل بوستجريس كيو إل بايثون (لغة برمجة) هجرة البيانات جودة البيانات هادوب (Hadoop) هيف (Hive) أولاب باي سبارك دوكر بي إل/إسكيوإل SQL ETL/ELT Data Warehousing Data Replication Apache Spark HDFS Apache Airflow Apache Oozie Greenplum Git ETL ELT
الإبلاغ عن هذا الملف الشخصي؟