We are AIDA Recruitment a technology and artificial intelligence-based employee search. For our client we are looking for a Data Engineer.
We are seeking a highly skilled Data Engineer who thrives in working with complex data ecosystems. The ideal candidate will be responsible for developing data pipelines preparing data for machine learning workflows optimizing data storage and providing insightful visualizations and analyses. This role requires a strong foundation in SQL data engineering best practices and cloud platforms.
Responsibilities:
- Design implement and maintain scalable ETL pipelines and data infrastructure to support analytics reporting and ML pipelines.
- Write optimized complex SQL queries (e.g. JOINs nested SELECTs index creation) across various database systems like MySQL PostgreSQL and MSSQL.
- Build and maintain dashboards data reports and visualization tools to deliver actionable insights.
- Conduct exploratory data analysis (EDA) to identify trends detect anomalies and recommend improvements.
- Collaborate with cross-functional teams (engineering product business) to gather data requirements and deliver solutions.
- Ensure high standards of data quality consistency and governance.
- Use Python or R to develop data automation scripts and perform advanced data analysis.
- Participate in the optimization and scaling of data storage and retrieval mechanisms.
- Document architecture data models and pipeline logic for team knowledge sharing.
Requirements:
- Proven experience with large datasets and relational databases (MySQL PostgreSQL MSSQL).
- Advanced SQL skills including performance tuning query optimization and indexing strategies.
- Solid experience in Python or R for scripting and data analysis.
- Knowledge of ETL tools and orchestration frameworks such as Airflow dbt or Apache NiFi.
- Experience with BI and data visualization tools like Tableau Power BI or Looker.
- Understanding of data modeling warehousing and architecture principles.
- Familiarity with cloud data platforms (AWS Redshift Google BigQuery Snowflake).
- Strong problem-solving mindset with a high attention to detail.
- Excellent communication skills and the ability to present technical data findings to non-technical stakeholders.
- Bachelors degree in Computer Science Data Science Statistics Engineering or a related field (or equivalent experience).
Work Conditions:
- Contract Type: B2B
- Locations-Poland
- Remote status-Fully Remote
- Employment type - Part-time