Req ID : 1683545
Job Title: Big data Senior developer
Work Location & Reporting Address: Philadelphia, PA 19103 (Open to remote but candidate should be willing to relocate to client's location)
Contract duration: 12
Job Details:
Must Have Skills
Big Data HadoopHivePigSqoop
Apache Spark
Phyton
Scala
Nice to have skills
Sqoop
Oozie
Detailed Job Description
Strong experience in Big Data and Java/J2EE technologies such as Apache Spark, Hadoop, Hive, Pig, Sqoop, Oozie, HBase, Zookeeper, Python & Scala.
Experience in Spark Core, Spark SQL, Java MapReduce, Spark on Java Applications implementation
Experience in real-time data processing using Spark Streaming and Kafka.
Experience in Apache Spark, Hive and Pig's analytical functions
Experience in analyzing large amounts of data sets writing PySpark scripts and Hive queries.
Experience in performing ETL using Spark, Spark SQL.
Experience in installing backup, recovery, configuration and development on multiple Hadoop distribution platforms Cloudera and Hortonworks including cloud platforms Amazon AWS and Google Cloud.
Experience in Agile / Scrum Methodologies
Strong UNIX/Linux systems administration skills, including configuration, troubleshooting and automation
Minimum years of experience
>10 years
Certifications Needed: No