Employer Active
# of requirements
4
Job Title
Data Science Engineer
Relevant Experience
(in Yrs)
6-8 yrs
Technical/Functional Skills
7+ years of work experience with ETL(AWS Glue / EMR), Data Modeling, and Data Architecture.
Expert-level skills in writing and optimizing SQL (Spark SQL, Databricks SQL etc.).
Experience with Big Data technologies such as Hadoop/Hive/Spark,EMR/Databricks. (Databricks experience is a must have skill set)
Solid Linux skills.
Experience operating very large data warehouses (Snowflake - Preferred & Redshift) or data lakes (S3 & DeltaLake).
Proficient in ETL optimization, designing, coding, and tuning big data processes using Apache Spark, R, and airflow.
Experience with building data pipelines and applications to stream and process large datasets at low latencies.
Demonstrate efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
Knowledge of Data Security, Engineering and Operational Excellence using standard methodologies.
Experience Required
6-8 Years
Roles & Responsibilities
Domain expertise Pharmacy experience
Responsible for product architecture, manage dependencies, feature prioritization, reviews and suggestion for solution Implementation. Key activities includes
Responsible for Product Architecture of specific work streams and the domains within them
Responsible for product backlog prioritization Functional and Non-Functional
-Responsible for Architecture output from each work stream
Manage dependencies within and outside of the work stream
Accountable for Product Quality
Ensure adoption of reusable components, flag issues and shortfalls
Generic Managerial Skills
Working with teams
Offshore-Onshore model experience
Education
Bachelors Degree
Start date (dd-mmm-yy)
ASAP
Duration of assignment (in Months)
12+ Months
Work Location (State, City and Zip)
Boston, MA or Durham, NC
Full Time