Data Engineer (Python AWS Data Pipelines) (1372)

SOFTGIC S.A.S.

Not Interested
Bookmark
Report This Job

profile Job Location:

Medellín - Colombia

profile Monthly Salary: COP 2800 - 2800
profile Experience Required: 4-5years
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Este es un puesto de trabajo remoto.

We are looking for a skilled Data Engineer to design build and maintain scalable data systems supporting analytics and machine learning initiatives. This role works in hybrid environmentsboth SaaS-hosted and client-managed (on-premises)and focuses on enhancing the Elastic Hierarchy framework unifying diverse financial datasets across multiple systems.

Key Responsibilities:

Design and maintain scalable ETL/ELT pipelines in Python integrating structured and semi-structured data (JSON CSV XML) across Snowflake MongoDB Postgres and AWS services (S3 Glue Lambda EC2 EMR Redshift RDS).
Build and optimize transformation and orchestration workflows using DBT Airflow Prefect or Dagster.
Implement data governance quality checks and security best practices throughout data pipelines.
Extend and optimize the Elastic Hierarchy framework to harmonize financial data from various systems.
Collaborate with analysts ML engineers and product teams to deliver business-ready datasets and data solutions.

Requisitos

Bachelors or Masters degree in Computer Science Data Engineering or a related field.
Strong Python programming skills with experience in data processing and automation.
Proven experience with the AWS data ecosystem including S3 Glue Lambda EMR EC2 Redshift and RDS.
Hands-on experience with Snowflake MongoDB and Postgres databases.
Proficiency with DBT or similar data transformation tools and with orchestration frameworks such as Airflow Prefect or Dagster.
Knowledge of data mapping attribution or reconciliation (experience in financial services is a strong plus).
Understanding of hybrid/on-premise deployment models within enterprise environments.
Excellent English communication skills and ability to collaborate effectively within distributed teams.


Required Skills:

Must-Have Skills: Strong proficiency in TypeScript and . Experience with PostgreSQL and GraphQL. Solid understanding of frontend and backend development (50/50 balance expected). Excellent communication and teamwork skills. Ability to work independently in a remote setup. Nice-to-Have Skills: Experience with React Native (without Expo) or Svelte. Familiarity with performance optimization and user experience best practices. Previous experience working in startups or agile environments.


Required Education:

At least five years of experience in civil design/ or advanced level in the use of AutoCAD Civil 3D and other engineering automation tools (Revit BIM 360).Ability to properly operate technical analysis equipment and computer oral and written technical communication skills with the ability to read technical literature and engineering analytical and problem-solving skills applying professional knowledge to both routine and non-routin

Este es un puesto de trabajo remoto. We are looking for a skilled Data Engineer to design build and maintain scalable data systems supporting analytics and machine learning initiatives. This role works in hybrid environmentsboth SaaS-hosted and client-managed (on-premises)and focuses on enhancin...
View more view more

Company Industry

IT Services and IT Consulting

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala