Big data Engineer

Job Description: TECH

***Max rate $90/hr
***Onsite Raleigh NC

Primary & Secondary skill set: Spark & Hadoop
Experience 8 yrs

Job description :
Experience building scalable distributed systems in a commercial software development environment.
A track record of success in developing and maintaining ETL pipelines with large distributed systems in an agile environment (Apache Spark Hadoop or similar).
Experience working with containerized platforms and tools: Docker and Cloud orchestration platforms such as Kubernetes are a plus.
Experience in development languages including but not limited to: Java / Scala ECL Python XML XSLT and JSON.
Experience in designing and working with complex data models.
Experience with data manipulation languages including optimization techniques.
Experience with CI/CD pipelines with Jenkins or similar; Source code management tools.
Ability to partner with internal and external technology resources in solving complex business needs.
Implement development processes and coding best practices and conduct code reviews to ensure quality reliability and performance in our content processing pipelines.
Strong interpersonal communication and presentation skills and knowledge of industry best practices in development.
The position requires frequent interaction with the product owners engineering teams and other crossfunctional technology teams to troubleshoot problems related to content enrichment and delivery.
Additional Sills: Skills: No items to display.