Spark Jobs in New

Location: Remote Mid to senior level with 3 to 5 years of min. Experience needed on Data Engineering skills on Azure Cloud Responsibilities Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark More...

Required Skills Min 5 years of experience AWS S3 Python Spark Data/Backend Data Processing Data flow handling large data Project is about Generating financial statement. Summary Executes creative software solutions design development and technical troubleshooting with More...

Job Title: GCP Engineer / Lead & Architect Locations: 100% Remote Type of hire: Fulltime Job Description: Must Have Experience in data proc data flow data lake on gcp ingestion Data Lake creation Spark Python GCP Dataproc Google Cloud Storage At least 2 years of Experience with the G More...

DevOps Enginer New York (NYC/NJ) Charlotte (NC) and Texas US Bank Hybrid based on location Team is in Hopkins (MSP) New York (NYC/NJ) Charlotte (NC) and Texas. Summary of the project/initiatives which describes whats being done Team member will be working on Tech Mod Financi More...

Engineer SummaryWe are looking for a Machine Learning Engineer who has handson experience in machine learning system development Cloud computing backend development and AI/ML. Candidate must have NLP exp Automate endtoend ETL/ML pipelines with structural understanding of data More...

Requirements: Key Skills: Spark Scala AWS Hadoop python Strong Project Management skills Strong communication skills Able to handle fast paced and ambiguously defined projects with multiple customers and partners. Strong conceptual understanding of data and data analytics Someone More...

Role: Hadoop Developer Locations: Plano TX / Jersey City NJ / Charlotte NC / Newark DE Duration: Contract/Fulltime (Hybrid role from Day1) W2 only Position Overview: The Senior Engineer is a hybrid role with experience in database management clustered compute operating system inte More...

Data Scientist Role Job Locations: Cupertino CA Duration: Full Time. Required Experience: 5 8 Years Skills : AI ML Python SQL XGBoost Required Experience: 5 8 Years Responsibilities: Building Machine Learning (ML) models and deploying them to production on a giant scale (w More...

Data Warehouse Developer Plano TX Hybrid Job Description: Must Have skills: 5 years Python programming 7 years CI/CD Previous data pipeline experience with data migration projects 3 years Good SQL experience (data validations to ensure everything is accurate to compare data) Shell More...

Skills Required: Years of Experience Required: 4 overall years of experience in the field. Degrees or certifications required: College or bachelors degree in any field (computer science degree preferred) is required to be eligible for this role. Disqualifiers: Candidates w More...

Job title: AWS Developer / Lead & Architect Locations: 100% Remote Type of hire: Fulltime Qualifications: Hands on Experience on AWS Big Data Services like AWS S3 / Glue / EMR / DynamoDB / ECS Fargate / Redshift / RedShift Spectrum Hands on Experience in AWS Debugging / Triaging More...

Description: 8 yrs of Apache Spark Configuration and Administration 8 yrs of Query optimization Optimizing Stored procedures in SQL Server or Oracle 5 yrs programming experience in Python 5 yrs of BI Tools like PowerBI Cognos Tableau Knowledge of Azure Kubernet More...

GCP Data Architect Location: Remote Key Responsibilities: Lead the requirement gathering process and create comprehensive technical designs (highlevel and detailed). Develop a robust data ingestion framework for diverse data sources. Participate actively in architectural discussions More...

Position:Druid Specialist Type: Contract Location:Basking Ridge NJ (Hybrid) Job Description: 5 years of handson experience with Apache Druid Applied Druid to perform realtime analytics on streaming data from multiple sources. Worked on Druids realtime streaming capabili More...

Role Title: Big Data Engineer Location: Remote Type: FTE (Fulltime Employment) Bachelors degree in Computer Science Engineering or equivalent. Bigdata: 56 years of Handson experience in Hadoop / Spark (Scala or Python) Hbase Hive Sqoop. Knowledge on Database architectures of RDBMS More...

Description: Designs develops and implements Hadoop ecosystem based applications to support business requirements. Follows approved life cycle methodologies creates design documents and performs program coding and testing. Resolves technical issues through debugging research and in More...

Must have Technical Skills: 5 years experience in backend development and/or big data management and solutions. 5 years of experience with advanced SQL and/or NoSQL distributed databases: Postgres Redis NoSQL or NewSQL Expertise in any programming language such as Python J More...

Job Description: Create and maintain optimal data pipeline architecture assemble large complex data sets that meet functional / nonfunctional business requirements. Collaborate with and across Agile teams to design develop test implement and support technical solutions in fullstack de More...

Role: Python Data Engineer Workplace Type: 100% Remote Account Name: Finra Regulation Inc. Duration: 18 months Enterprise Required Skills: Python Spark ETL AWS (S3 RDS EMR) MongoDB REST API Daiss Job Title: Python Data Engineer Top Skills Details: MidSenior Python Data Engineer hyb More...

Title: Data Engineer Positions: 2 Company/Department: Location: NJ Newark 07102 Rate: $60 $65/Hour Experience Level: Start Date End Date: 03/12/2024 09/13/2024 AtaGlance: Are you ready to build your career by joininga global financial company If so our client More...