Data Engineer

Make an impact by working for sectors where technology is the enabler everything is ground-breaking and theres a constant need to be innovative.

Create and enhance projects in Java Python Angular and so much more while diving in the world of Blockchain Artificial Intelligence Data Science Security and Internet of Things.

Be part of the team that combines business knowledge technological edge and a design experience. Our different backgrounds and know-how are key in developing solutions and experiences for digital clients.

Face challenges and learn other ways of thinking and seeing the world - theres always room for your energy and creativity.

About the role

Data Engineer is responsible for building and maintaining Data Platforms. Recognizes the importance of data for the organization in the areas where it is the key to success. Maintaining an eye on the big picture and knowing the details of the business are decisive for this role.

This role is focused on designing developing and maintaining the data platform required for data storage processing orchestration and analysis.

The mission involves implementing scalable and performant data pipelines and data integration solutions.

Agnostic of data sources and technologies to ensure efficient data flow and high data quality enabling data scientists analysts and other stakeholders to access and analyze data effectively.

As a part of your job you will:

• Design build and maintain scalable data platforms

• Collect process and analyze large and complex data sets from various sources

• Develop and implement data processing workflows using data processing framework technologies

• Collaborate with cross-functional teams to ensure data accuracy and integrity

• Ensure data security and privacy through the proper implementation of access controls and data encryption

• Extraction of data from various sources including databases file systems and APIs

• Monitor system performance and optimize for high availability and scalability

What are we looking for

• BSc or MSc in Computer Engineering or IT-related courses;

• 5 Years of Data Engineering experience;

• Experience with at least one programming language in the context of Data Engineering such as Java Scala or Python;

• Experience working with at least one event streaming platform such as Kafka Pulsar or similar Cloud services such as Amazon Kinesis Data Streams Amazon MSK (Kafka) GCP Pub/Sub or Azure Event Hubs.

• Experience with at least one stream processing framework such as Apache Kafka Streams Apache Flink Apache Spark Streaming or Apache Storm or similar Cloud data processing frameworks such as GCP Dataflow or Amazon Kinesis Data Analytics.

• Experience working with at least one modern data integration and movement framework suitable for streaming data sources such as Apache NiFi Streamsets Kafka Connect GCP Data Fusion and Amazon Firehose

Nice to have:

• Experience with Docker Kubernetes and Helm;

• Experience with CI/CD tools such as Jenkins Nexus Sonarqube etc;

• Experience with Datalakes Lakehouses MPP Engines such as Presto Dremio Drill Impala Hive Amazon Athena GCP BigQuery Databricks;

• Experience working in Cloud Environments (I.e AWS GCP Azure);

• General knowledge of agile methodologies such as Scrum Kanban etc;

• Experience working with NoSQL Databases such as Key-Value stores Document DBs Time-series DBs or Graph DBs;

• Experience with Data Warehouse (Data Modelling ETL and BI tooling);

• Knowledge with Apache Druid (data modelling real-time ingestion and efficient query patterns);

• Knowledge of code instrumentation APM Prometheus and Grafana.

Personal traits

• Ability to adapt to different contexts teams and Clients;

• Teamwork skills but also a sense of autonomy;

• Motivation for international projects and ok if travel is included;

• Willingness to collaborate with other players;

• Strong communication skills.
  

At Celfocus we are committed to cultivate a diverse and inclusive workplace. As an equal-opportunity employer we welcome applicants of all backgrounds gender identities and abilities. We are dedicated to providing reasonable accommodations for candidates with specific needs. If you require any adjustments during the selection process please inform our Talent Acquisition Team.

Come join the Team!