Big Data Developer

Job Description

• Specifies, designs, implements, tests, and maintains platform-independent, complex software system components and applications.
• Duties involve working on existing source code to incorporate new features; ensure that the piece of code written is bug-free.
• Works under direct supervision on assigned team, project components, and or develop and modify existing source code. Duties also involve working on, or integrating with other path solutions product components and applications.
• Works to fix bugs and conducts unit testing, make necessary changes to source code and document them.
• Ensure that Path Solutions development standards & QMS are followed.
• Designs and implements algorithms for assigned tasks.
• Executes development assignments to include design of conceptual approach, coding and debugging.
• Determines the time estimates and work plan necessary to achieve the goals for building, testing and maintaining quality software to general specification.
• Communicates information directly and clearly. Checks for clarity and understanding during a conversation using active feedback, reflection, and other communication techniques.
• Facilitates and moderates issue identification and resolution. Identifies, communicates and resolves conflicts with the individuals involved.
• Acts with a perspective of achieving continuous improvements.

Job Requirements

• B.Sc. in Computer Science or equivalent
• Minimum 5 years of experience in Big Data Technologies.
• Familiar with the Hadoop Ecosystem, specifically Sqoop, Flume, Oozie
• Knowledgeable in Hadoop administration
• Experienced in working with Spark
• Experienced in Python statistical modelling techniques and Python libraries.
• Programming using Python or Scala
• Experienced programming in Java and rest APIs
• Familiar with UNIX shell commands
• Familiar with Microsoft Azure and/or Hortonworks Data Platfom
• Machine Learning Algorithms (a plus)
• Statistical expertise (statistical tests, t-test, F-test, Profiling techniques, etc.)
• Proficiency in English is a must