Data Engineer

Archie Labs

Not Interested
Bookmark
Report This Job

profile Job Location:

Medellín - Colombia

profile Monthly Salary: Not Disclosed
Posted on: Yesterday
Vacancies: 1 Vacancy

Job Summary

What were looking for Data Engineer (Only for people located in Latinamerica).

Were looking for a Data Engineer/Azure Data Factory/Azure Databricks

Key Responsibilities
  • Design implement and maintain pipelines using Azure Data Factory (ADF) to ingest data from various sources: transactions (orders) product pricing inventory customer etc. into Azure Databricks.
  • Understanding of Medallion Architecture to logically organize data in a lakehouse.
  • Develop data transformation and processing using Azure Databricks (PySpark) for large datasets.
  • Setup & manage data lakehouse (Azure Data Lake) to ensure speed scalability and efficient storage.
  • Real-time or near real-time monitoring alerting for delays failures accuracy issues.
  • Implement data governance security data quality checks.

Experience and knowledge

  • 5 years experience in Data Engineering / similar role.
  • Strong experience with Azure Data Factory (ADF).
  • Solid skills in Azure Databricks including PySpark.
  • Proficient SQL skills.
  • Knowledge of Azure Data Lake / Blob Storage.
  • Familiarity with CI/CD in Azure DevOps.
  • Good problem solving monitoring troubleshooting skills.
  • English B2
  • Only for people located in Latinamerica

Compensation & Benefits

  • Participation in innovative high-impact regional projects.
  • People-centric culture with autonomy and continuous learning.
  • Work 100% Remote
  • Work from anywhere
  • We pay in US dollars.
  • 40 USD BYOD.
  • You can enjoy all the holidays in your country.
  • 10 days of PTO payments

Compensation & Benefits

  • Participation in innovative high-impact regional projects.
  • People-centric culture with autonomy and continuous learning.
  • Work 100% Remote
  • Work from anywhere
  • We pay in US dollars.
  • 40 USD BYOD.
  • You can enjoy all the holidays in your country.
  • 10 days of PTO payments
What were looking for Data Engineer (Only for people located in Latinamerica). Were looking for a Data Engineer/Azure Data Factory/Azure Databricks Key Responsibilities Design implement and maintain pipelines using Azure Data Factory (ADF) to ingest data from various sources: transactions (order...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala