The Senior Data Engineer will design build and optimize large-scale data infrastructure ensuring efficient data collection processing and availability to support advanced analytics and data-driven decision-making.
Role description:
Design ETL/ELT pipelines for network telemetry data
Interface with on-premises data collection systems
Implement Iceberg table structures also for time-series data
Optimize data processing for analytics
Manage data quality and lineage
Implement pipeline observability
Implement modern data protection strategies
Qualifications:
5 years experience with AWS Glue S3 Athena IAM Lakeformation Lambda S3 Tables
Apache Iceberg and lakehouse architectures
Java (Python Scala) for data processing
Familiarity with data formats (JSON Avro Parquet)
Time-series database queires
Data processing (Spark DuckDB Flink AirFlow Prefect)
Graph Theory
Excellent SQL Knowledge
English: B1
Nice to have:
AWS Certifications
Since 1998 weve been active in the Human Resources consulting market providing regional coverage across four key areas of expertise: recruitment and selection personnel leasing assessment centers and consultancy. As leaders in Transylvania weve expanded our reach to embrace a culture ... View more