Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Our internal team is looking for anontraditional Data Engineer (DE)one that blendsData Engineering (DE) and Data Science (DS). This person needs to develop and optimize data architectures that support business intelligence predictive analytics and AI/ML applications. This role involves designing and structuring data pipelines that connect SAP Databricks and Microsoft CRM enabling trend analysis forecasting models and AIdriven focus is not just onETL pipelinesbut onbuilding a feature storerather than traditional data models.
This role requires a deep understanding of how data should be organized to support efficient reporting historical trend analysis and advanced analytics.
Given our global operations fluency in both English and Chinese is highly beneficial
Duration: 9 months contract
Pay Range:$60/hr to $85/hr (on basis of experience level)
Responsibilities:
- Develop and implement scalable data models that link SAP Databricks and Microsoft CRM ensuring they support business intelligence forecasting and AIdriven analytics.
- Build robust data pipelines to extract process and structure information from SAP HANA SAP BW OData and Microsoft CRM ensuring accuracy and usability for analytical tools.
- Design data schemas that enhance historical trend analysis predictive modeling and performance monitoring rather than simply storing raw transactional data.
- Construct data warehouses and structured datasets that allow for efficient querying and insightful analysis reducing the need for complex transformations downstream.
- Ensure data processing frameworks can accommodate both realtime updates and scheduled batch processing supporting diverse analytical needs.
- Work closely with stakeholders across business functions to align data structures with operational goals ensuring usability and relevance.
- Automate data ingestion and transformation using Python SQL and cloudbased technologies streamlining data workflows.
- Implement data governance policies ensuring compliance with security protocols access management and audit logging.
- Maintain and troubleshoot data pipelines minimizing downtime and ensuring smooth data availability for reporting and analytics teams.
- Develop metadata and lineage tracking strategies improving data transparency and usability across the organization.
Candidates Persona:
1. Strong Data Engineering (DE) Background
- Experience inSQL Python ETL and data modeling
- Handson withDatabricksincluding Delta Lake storage efficient partitioning strategies and query performance tuning
- Familiar withApache Airflowfor orchestration
- Experience withDBT(nice to have)
2.Experience in Feature Engineering & Data Science (DS)
- Some exposure todata modeling and ML feature engineering
- Experience withfeature store developmentis aplus or it can be described as support predictive modeling
- Proficiency inPythonfor data manipulation & ML
- Familiarity with ML libraries likescikitlearn
- Experience withML platforms
- Prior exposure to predictive modeling/propensity modeling is a plus
3.Business Acumen & Predictive Feature Design
- Strongunderstanding of SAP and CRM data
- Ability to identifyfeatures with predictive power
- Experience in creating businessrelevant features e.g.RFM (Recency Frequency Monetary) modeling
- Familiarity with Microsoft CRM (preferably Dynamics) and its underlying data structures for business analysis.
- 36 years of experience in data engineering with a strong background in data modeling and integration.
- Proficiency in Python and SQL for data transformation pipeline automation and performance tuning.
- Deep knowledge of Databricks
- Expertise in SAP data structures including SAP HANA SAP BW OData BAPI and IDocs.
- Handson experience designing optimized data architectures that support trend analysis forecasting models and AIpowered insights.
- Experience structuring data to facilitate business intelligence reporting advanced forecasting and predictive modeling.
- Ability to manage largescale data pipelines optimizing them for performance and scalability.
- Strong understanding of workflow orchestration tools (e.g. Apache Airflow Prefect or Azure Data Factory) to automate and schedule data tasks.
- Prior experience implementing security controls access management and governance frameworks to maintain data integrity.
- Bilingual proficiency in Chinese and English is highly preferred.
- Businessoriented mindset with the ability to align data structures with operational and strategic goals.
- Experience in forecasting predictive analytics or AI/ML model withautomated ML pipelines
- Familiarity with CI/CD pipelines for managing and deploying data infrastructure.
- MLOps DevOps Cloud Services skills
- Exposure to cloudbased data lake architectures optimizing storage for cost and performance.
- Knowledge of metadatadriven data engineering improving discoverability and tracking across datasets.
- Advanced education MBA MA or Ph.D. is a plus as we welcome professionals with strong analytical backgrounds
**No C2C profiles are accepted**
Thank you!
FocusKPI Hiring Team
Founded in 2010 FocusKPI Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley California with an East Coast office in Boston Massachusetts.
NOTICE: Please be aware of fraudulent emails regarding job postings job offers and fake checks. FocusKPIs recruiting team will strictly reach out via @focuskpi email domain. If you have received fraudulent emails now or in the past please report it to .
The domain @focuskpijobs is fraudulent and not related to FocusKPI. Please do not not reply or communicate to anyone with @focuskpijobs.
Required Experience:
Manager
Employment Type
Contract
