Job Description:
We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python Spark and Scala. This is an active position with a high priority offering a competitive rate and the opportunity for a longterm engagement.
Key Responsibilities:
- Design develop and maintain Big Data solutions and applications.
- Implement data pipelines and ETL processes using Python Spark and Scala.
- Optimize and troubleshoot Big Data solutions for performance and scalability.
- Collaborate with crossfunctional teams to gather requirements and deliver solutions that meet business needs.
- Perform data analysis and provide insights to support decisionmaking processes.
- Stay updated with emerging technologies and best practices in Big Data engineering.
Requirements:
- Bachelors degree in Computer Science Engineering or a related field.
- Proven experience as a Big Data Engineer or similar role with at least 5 years of relevant work experience.
- Proficiency in Python Spark and Scala is a must.
- Strong understanding of Big Data technologies and architectures.
- Experience with distributed computing frameworks such as Hadoop or Apache Flink.
- Familiarity with cloud platforms like AWS Azure or Google Cloud Platform.
- Excellent problemsolving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and manage priorities in a remote environment.
- Prior experience working in Agile/Scrum methodologies is preferred.
Duration:
- This is a fulltime position with a duration of 3 months with the possibility of extension based on performance and project needs.
data,big data,python,scala,spark,cloud,data solutions,skills,big data technologies,aws