Data Engineer

Position: Data Engineer

Location: Tampa FL

Duration: Full Time

Experience: 6 8years

Salary: $90k110k/yr

Technical/Functional Skills:

• Frameworks: Spark PySpark Python Apache Airflow and Cassandra Sprint Boot Micro Services Apache Camel Angular 6 UI Framework
• DB: Postgres DB Oracle
• DevOps: GITLAB Jenkins Maven Confluence Jfrog Artifactory SONARQUBE JIRA

Experience Required:

• Must have strong experience in Spark PySpark Python Apache Airflow and Cassandra.
• Must have strong experience in Apache Flink Python Apache Kafka and Cassandra
• Build near real time data pipeline with Apache Spark Pyspark & Python to extract data from NoSQL DBs and Load it into Cassandra Data Enterprise Graph
• Build real time data pipeline with Apache Flink Apache Kafka and Python to extract data from Relational and NoSQL DBs and Load it into Cassandra Data Enterprise Graph

Roles & Responsibilities:

• Ability to translate application storyboards and use cases into functional applications
• Build near real time data pipeline with Apache Spark Pyspark & Python to extract data from NoSQL DBs and Load it into Cassandra Data Enterprise Graph
• Build real time data pipeline with Apache Flink Apache Kafka and Python to extract data from Relational and NoSQL DBs and Load it into Cassandra Data Enterprise Graph
• Design build and maintain efficient reusable and reliable Java code
• Ensure the best possible performance quality and responsiveness of the applications
• Help maintain code quality organization and automatization
• Strong debugging problem solving and investigative skills. Ability to assimilate disparate information (log files error messages etc.) and pursue leads to find root cause of problems
• Experience in Agile/Scrum methodology
• Proven ability to create innovative solutions.
• Strong agile/scrum development experience
• Expertise developing web applications and APIs using Micro Services with demonstrable productionscale experience.
• Web applications development using Java HTML5 CSS3 JavaScript jQuery Angular JS Spring Boot.
• Skilled n Version control tools e.g. GIT SVN etc. to maintain common source Create testing and validation scripts for the features developed.
• Develop the Automation Script for endtoend verifications
• Create enhance debug and execute the Test cases
• Writing unit / Integration tests using JUnit / Mockito for code coverage as per the standards and Log4j 2 for logging.
• Expert in database scripts stored procedures functions triggers etc

Desired Skills:

• Python Spark Apache