Senior Data Engineer

Job Summary:

As a Senior Data Engineer you will be responsible for creating effective technological solutions for work with big data. They are also responsible for managing a team of specialists in their field and related IT professions. In addition their roles include quality control of the work performed.

Position

Senior Data Engineer 5 to 7 Years

Technical Skills:

Programming Languages: Proficiency in languages like Python SQL and possibly Scala or Java.

Database Technologies: Experience with relational databases (e.g. MySQL PostgreSQL) and NoSQL databases (e.g. MongoDB Cassandra).

Big Data Technologies: Knowledge of distributed computing frameworks such as Hadoop Spark and Apache Flink.

Data Warehousing: Familiarity with data warehousing concepts and tools like Amazon Redshift Google BigQuery or Snowflake.

ETL Tools: Experience with ETL tools like Apache NiFi Apache Airflow Talend or Informatica.

Data Modeling: Understanding of data modelling principles and experience with tools like ERwin Lucidchart or DbSchema.

Version Control: Proficient in version control systems like Git for managing codebase changes.

Cloud Platforms: Experience working with cloud platforms like AWS Azure or Google Cloud Platform for deploying and managing data solutions.

Data Visualization: Basic understanding of data visualization tools like Tableau Power BI or matplotlib/seaborn in Python.

Requirements

Designing building and maintaining scalable and robust data pipelines for ingesting processing and transforming large volumes of data.

Collaborating with crossfunctional teams including data scientists analysts and business stakeholders to understand data requirements and deliver solutions that meet business objectives.

Optimizing and finetuning data pipelines for performance reliability and efficiency.

Implementing data security and privacy measures to ensure compliance with regulations like GDPR or CCPA.

Troubleshooting datarelated issues and providing timely resolution.

Participating in code reviews documentation and knowledge sharing sessions within the team.