Data Engineer

StraitsX

Not Interested
Bookmark
Report This Job

profile Job Location:

Taipei City - Taiwan

profile Monthly Salary: Not Disclosed
Posted on: 2 days ago
Vacancies: 1 Vacancy

Job Summary

About The Role

The Data Engineer is responsible for managing the StraitsXs data pipeline that underlie all our ETL/ELT process and data warehouse solutions. The teams mission is to achieve maximum efficiency and stability of the entire data infrastructure.

What You Will Do

As a Data Engineer you will work to ensure the smooth running of all our data pipelines and that accurate data is available in a timely manner for management to make informed decisions and operational teams to track their metrics. The responsibilities include:

  • Develop and maintain data pipeline and infrastructure for ETL/ELT process Data Warehouse Business Intelligence reporting.
  • Create active and passive monitoring for data infrastructure (alerts usage dashboards etc).
  • Manage access control to data infrastructure.

What We Are Looking For

  • 1 - 3 years of Data Engineering and/or Software Engineering Experience.
  • BS/MS Degree in any relevant major. (ex: IT / Information Systems Computer Science etc).
  • Solid algorithm and data structure knowledge.
  • Excellent SQL query skills.
  • Ability to write robust and scalable code in Python or other scripting programming language.
  • Experience with data warehouse solutions such as Redshift or BigQuery preferably with experience configuring such solutions.
  • Experience with setting up or configuring data pipeline tools such as Airflow Cloud Composer DBT etc.
  • Experience with setting up or configuring business intelligence tools such as Metabase Tableau etc.
  • Experience with Cloud technologies GCP or AWS (including cloud networking).
  • Experience with Infrastructure as Code (e.g. using Terraform) will be an advantage.
  • Exceptional written and verbal communication skills in both English and Chinese (Mandarin) are essential.

Required Experience:

IC

About The RoleThe Data Engineer is responsible for managing the StraitsXs data pipeline that underlie all our ETL/ELT process and data warehouse solutions. The teams mission is to achieve maximum efficiency and stability of the entire data infrastructure.What You Will DoAs a Data Engineer you will w...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala