Data Engineer
Share
Job Location:
Monthly Salary:
Posted on:
13 hours ago
Vacancies:
1 Vacancy
Job Summary
Who We Are
We are Apilia - a Poznań-based Software House founded by two passionate Java developers. Since 2009 weve been thriving in the IT market delivering high-quality software and building lasting partnerships with Polands top brands.
Position: Data Engineer
Location & Work Mode: Warsaw Office - Hybrid (3 days remote 2 days in office)
Rate: up to 160 PLN/h on B2B
Contract duration: long-termn
Role & Responsibilities
For one of our clients you will take responsibility for software delivery ensuring that quality standards and scope expectations are consistently met. You will contribute to and take ownership of the technical design making sure all aspects of the system architecture are well-documented. This role involves close collaboration with partner technology teams and effective cooperation across multiple projects.
Required Technical Skills (35 years of experience)
- Strong experience with Python PySpark Pandas and JupyterLab (working with notebooks).
- Experience using the AWS platform.
- Hands-on experience with continuous integration and continuous delivery tools such as Git Jenkins etc.
- Knowledge of Agile development practices and software lifecycle management.
- Familiarity with BI tools such as Qlik Tableau Power BI etc.
Nice to have:
- Experience with Kafka.
- Experience with SQL Hive Hadoop.
- Experience running Spark clusters on AWS using EMR (Elastic MapReduce).
- Knowledge of Terraform.
- Experience with Ansible Bash scripting and boto3.
- Experience configuring CI/CD pipelines and related tools.
What You Get (Besides a Warm Hi on Slack Every Morning)
Equipment You bet. Either we or the client will provide everything you need - no coding with sticks in the sand!
Co-financing for:
Multisport membership - because a good stretch after coding never hurt anyone.
Life insurance - lifes unpredictable and we prefer it that way but in a good way.
Private healthcare - because your health comes first (and nobody likes queues).
And thats not all:
A cozy office in Poznań at Kłosowa 27 - complete with a garden and grill for sunny lunch breaks.
A great team - seriously were awesome. We share memes support each other and enjoy working together.
Board games after hours - from silly games like Dobble to strategic ones like Terraforming Mars.
Team events & parties - we like to hang out outside of work too whether its for a beer or a barbecue.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
