Data Pipeline Engineer
Share
Job Location:
Mountain View, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
The team is seeking world-class server software engineers with experience in Big Data Infrastructure and Data warehousing to join their technology innovation group which focuses on rapidly developing AI-driven cloud-based end-to-end mobile applications and services.
Data Pipeline Engineer IV involves building & managing pipelines and ETLs requiring expertise with Spark Iceberg and Python coding as the main requirements.
Work Location:Mountain View CA(Hybrid role 4 days/week onsite mandatorily)
Duration:12-monthcontract with potential to convert depending on the candidates performance
Pay Range:$85/hr to $95/hr
**No C2C resumes are considered**
Responsibilities:
- Implement maintain and evolve the big data platform and infrastructure
- Responsible for designing implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling Machine Learning Personalization Recommendation and Business Intelligence systems
- Perform extensive research and analysis to make optimal architecture and design decisions
- Write large amounts of code perform code reviews write unit tests and documentation
- Interface with other groups including Product Management QA and Operations Create quick proof-of-concept prototypes
- Work in a scrum team with ML & Cloud Engineers
- Minimum of 4years of hands-on experience in Big Data technologies like Apache Iceberg Spark Spark ML & KafkaAnA
- Mastersin Computer Science or equivalent experience is preferred
- Expertise with Spark and Iceberg aremandatory to have
- Strong skills in statistical analysis: correlation analysis regression analysis univariate and multivariate analysis
- Programming Language: Python coding expertise is required
- Strong skills in algorithms Data structures UNIX/Linux Scripting Machine Learning (especially classification and unsupervised clustering) Data Modeling Data warehousing and Networking
- Hands-on experience in building REST APIs
- Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
- Desire to learn fast and pick up the latest and greatest technologies
Preferred qualifications:
- Preferred 7 years of experience in Big Data Technologies: AWS EMR Iceberg Spark Kafka & YARN
- Machine Learning: PyTorch TensorFlow Spark ML
- REST API: Flask FastAPI or Django
- Data Quality tools such as Monte Carlo Great Expectations or Databand
- Experience with teams using MLflow
**No C2C resumes are considered**
Thank you!
FocusKPI Hiring Team
Founded in 2010 FocusKPI Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley California with an East Coast office in Boston Massachusetts.
NOTICE: Please be aware of fraudulent emails regarding job postings job offers and fake checks. FocusKPIs recruiting team will strictly reach out via @ email domain. If you have received fraudulent emails now or in the past please report it to .
The domain @ is fraudulent and not related to FocusKPI. Please do not not reply or communicate to anyone with @.
Required Experience:
Manager
Key Skills
- Continuous Integration
- Docker
- Jenkins
- Kubernetes
- Build Automation
- S3
- ASME Codes & Standards
- Redshift
- Spark
- CI/CD
- Kafka
- Scala
About Company
FocusKPI offers custom marketing analytics solutions and specialized data science support to fit your timeline and budget. Among our areas of expertise are: personalization solutions, measurement (MMM & MTA), and customer sentiment analysis.
