Data Engineer SparkScala

Hola!

Desde ToBeIT estamos buscando un Data Engineer Spark/Scala para trabajar en una de las principales compaas de consultora tecnolgica 100% remoto.

Funciones:

Ingesta y procesamiento de datos con Spark y Scala.

Requisitos obligatorios:

At least 2 years experience working with big data (spark hadoop hive kafka).

At least 2 year experience programming with Spark/Scala.

Experience with different database structures including SQL (postgres mysql )

Experience working in agile continuos integration/devops paradigm and tool set (git jenkins sonar nexus jira splunk).

Experience and expertise across data integration and data management with high data volumes.

Requisitos deseables:

Experience with AWS ecosystem (AWS EMR s3 redshift lambda glue athena)

NOSQL (cassandra redis elastic search).

Experience with data warehousing and visualisation tools.

Experience with NRT applications: Flink spark streaming hbase.

Experience with cloudera. ( desirable)

Experience with machine learning. ( desirable)