Big Data Engineer 2025TA0201x110682
Big Data Engineer 2025TA0201x110682
Posted on :
08-02-2025
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Our Customer is looking for a Big Data Engineer located in Warsaw d Wroc aw Pozna or Krak w who will be obliged to visit one of the clients offices twice per week
Additional information: Please add the city while applying
Verification process: at least 2 interviews (one with our client and one with the end client)
Background check: required preonboarding
- Hadoop Ecosystem Expertise:
- Design develop and optimize data pipelines and workflows using Hadoop technologies such as HDFS YARN Spark HBase Impala and Hive.
- Java Development for APIs and Batch Processes
- Develop and deploy RESTful APIs using Java Spring Boot for seamless data integration across systems.
- Design and manage batch processes in Java ensuring efficient execution of data workflows and business logic.
- Implement robust error handling logging and monitoring mechanisms.
- Database Management
- Maintain and enhance relational database solutions particularly with Oracle DB.
- Write complex and optimized SQL and Spark SQL queries for improved database performance.
- Performance Optimization and Troubleshooting
- Monitor troubleshoot and enhance the efficiency of data processes.
- Ensure data integrity quality and security.
- Collaboration and Agile Participation
- Engage in Agile methodologies including daily standups and retrospectives to facilitate project success.
- Contribute to code reviews design discussions and team collaborations to uphold high development standards.
Must have:
- Minimum of 2 years of handson experience as a Data Engineer in a commercial setting.
- Minimum of 2 years of commercial experience in Java and Hadoop
- Strong proficiency in SQL.
- Experience working with the Hadoop ecosystem including HDFS YARN Spark HBase Impala and Hive.
- Skilled in distributed computing frameworks and largescale data processing.
- Familiarity with ETL pipeline development and data modeling.
- Solid knowledge of cluster management big data troubleshooting and API development using Java Spring.
- Strong analytical and problemsolving skills with keen attention to details
Java Data Engineering Hadoop ETL & Data Management Tools API Spark BigTable (HBase) Hive SQL
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
