Spark Jobs in Durham

Role Description: 1 Data transformation using strem sets Spark knowledge2 Designing and implementing data ingestion pipelines from multiple sources using Azure Data bricks3 Developing scalable and reusable frameworks for ingestion datasets4 Linux commands and Shell/Pearl Scripti More...

Keywords: Pyspark Spark EMR Scripting Language Experience Cloud Engineer Job Description: 9 Years DevOps/SRE experience required on OnPrem to AWS migration of Infra(EC2 EKS) Application and Databases (S3 RDS Dynamo etc.) 5 Years of Solid Experience in Coding language like Python Ba More...

AWS Data Engineer Qualifications: Locations: Raleigh NC or Foster city CA United States. This position requires a Bachelors Degree in Computer Science or a related technical field and 5 years of relevant employment experience 5 years of work experience with ETL Data Modeling and Data More...

Job Description: TECH***Max rate $90/hr***Onsite Raleigh NCPrimary & Secondary skill set: Spark & HadoopExperience 8 yrsJob description : Experience building scalable distributed systems in a commercial software development environment. A track record of success in develop More...

Tableau Developer Location Newyork city NY (Number of days onsite3) Mandotory Skill Tabluae Data Engineering AWS or Azure Tableau Developer with below job requirements: work experience 3 years of experience in data engineering preferably with Databricks and Spark Pro More...

Expert level Programming with 1214 years of experience Python PySpark programming experience Experience with pandas Experienced with SQL/Presto/HIVE/Spark Experience with Key AWS services/components: EMR Lambda Glue ETL Step Functions s3ECS IAM RDS PostgreSQL CloudWatch Event More...

Client : Highmark Remote Opportunity Healthcare Experience required Rate : Market Rate Please find below JD: Need Profiles ASAP Strong experience with HL7 FHIR concepts and terminology Strong experience with Google Cloud Healthcare Data Engine Whistle and BigQuery Strong experienc More...

Requirements: Must have Experienced in Java Golang development. Experienced in AWS ecosystem. Experienced with CICD development processes / pipelines. Proficient in SQL and NoSQL databases. Excellent analytical and problemsolving skills. Strong verbal/written communication More...

Needs: PYTHON SPARK Nice to Haves: Tableau GCP Job Description: Work With the Pricing Team. The team is responsible for all the Anomaly Detection. They build algorithms and Pricing Models to show where anomalies are occurring. They also do platform development for specific Platforms More...

GCP Data Architect Job Description: Mandatory Skills: 1. Extensive experience working with GCP Datarelated Services such as Cloud Storage Dataflow Dataproc BigQuery Bigtable 2. Very strong experience with Google Composer and Apache Airflow; ability to set up monitor and debug a More...

POSITION Data Engineer LOCATION Remote DURATION 6 months contract INTERVIEW TYPE Video REQUIRED SKILLS Must Have: Apache Airflow Apache Spark BigQuery GCP/Google Cloud/Terraform Scala

Role name: Apache Solr System Administrator Role Description: Experience in administering large scale SOLR clusters. Data Modelling NO SQL (Like MangoDB or Cassandra) Experience in Apache Solr Administration administration patching upgradation and migration. Understanding of Li More...

Role Description: Big Data Engineer with ETL Big Data / Data Warehousing Expert in SQL and Data warehousing concepts.Handson experience with public cloud data warehouse (GCP Azure AWS). GCP certification will be very good to have. Strong Hands on experience with one or more pr More...

Machine Learning OPS Engineer Required: NLP / NLU / LLM (ChatGPT / LLama / Falcon / Vicuna / Bard etc.) for AI ML Development Azure CICD GIT Terraform. Responsibility: Collaborate with data scientists to build and automate deploy endtoend production grade machine learning mode More...

Required Skills Min 5 years of experience AWS S3 Python Spark Data/Backend Data Processing Data flow handling large data Project is about Generating financial statement. Summary Executes creative software solutions design development and technical troubleshooting with More...

BS/BA degree or equivalent experience General: Strong organizational problemsolving and critical thinking skills; Strong documentation skills Coding: Proficiency in Java (Preferable) & Python Cluster Computing frameworks: Proficiency in Spark AWS Data Services: Proficiency in Lake fo More...

Title: Data Engineer Location: Remote W2 only Key skills: Python SQL (expert level) Spark and Scala (intermediate). Expertise: 59 years of relevant industry experience with a BS/Masters or 2 years with a PhD Experience with distributed processing technologies and frameworks More...

Job Title: GCP Engineer / Lead & Architect Locations: 100% Remote Type of hire: Fulltime Job Description: Must Have Experience in data proc data flow data lake on gcp ingestion Data Lake creation Spark Python GCP Dataproc Google Cloud Storage At least 2 years of Experience with the G More...

Required Skills: Key Skills: Spark Scala AWS Hadoop python Strong Project Management skills Strong communication skills Able to handle fast paced and ambiguously defined projects with multiple customers and partners. Strong conceptual understanding of data and data analytics Som More...

DevOps Enginer New York (NYC/NJ) Charlotte (NC) and Texas US Bank Hybrid based on location Team is in Hopkins (MSP) New York (NYC/NJ) Charlotte (NC) and Texas. Summary of the project/initiatives which describes whats being done Team member will be working on Tech Mod Financi More...