DataOS Data Engineer

Description -

DataOS Data Engineer collaborating on cutting edge advances in scalable solutions for data ingestion manipulation and end to end integration of data building blocks to support business driven data products.

Applies developed subject matter knowledge to solve common and complex business issues within established guidelines and recommends appropriate alternatives. Works on problems of diverse complexity and scope. May act as a team or project coach providing direction to team activities and facilitates information validation and team decision making process. Exercises judgment within generally defined policies and practices to identify and select a solution. Ability to handle most unique situations. May seek advice in order to support complex business issues.

Responsibilities

• Designs and establishes secure and performant data architectures enhancements updates and programming changes for portions and subsystems of data product pipelines repositories or models forstructured/unstructureddata. Focusing on developing sharable libraries that reduce development time and maintenance
• Analyzes design and determines coding programming and integration activities required based on general objectives and knowledge of overall architecture of product or solution.
• Writes and executes complete testing plans protocols and documentation for assigned portion of data system or component; identifies and debugs and creates solutions for issues with code and integration into data system architecture.
• Leads a project team of other data engineers to develop reliable cost effective and high-quality solutions for assigned data system model or component.
• Collaborates and communicates with project team regarding project progress and issue resolution. Supports co-development processes and tools to promote common approaches to solve complex problems.
• Represents the data engineering team for all phases of larger and more-complex development projects.
• Provides guidance and mentoring to less experienced staff members. Strong technical Leadership is required.

Knowledge & Skills

• Using data engineering tools languages (Python is a must. DBT is a plus) frameworks to mine cleanse and explore Large Data Sets.
• Fluent in SQL & Cloud based data systems. Relational data modeling.
• Fluent in complex distributed and massively parallel cloud systems (AWS GCP AZURE).
• Strong analytical and problem-solving skills with ability to represent complex algorithms in software.
• Designing data systems/solutions to manage complex data that are highly scalable and performant.
• Ability to performance tune Spark code.
• Strong understanding of database technologies and management systems.
• Strong understanding of cloud-based systems/services. Differentiate benefits for big data Lake House vs. Warehouse.
• Experience with workflow orchestration tools (Airflow Jenkins)
• Strong Notebooks environment experience (Jupyter DataBricks)
• Experience collecting requirements from Partners and choosing the right technologies to meet end to end data flow requirements that are required. (Data size delivery times: hourly daily monthly or real-time approaches)
• Database architecture testing methodology including execution of test plans debugging and testing scripts and tools.
• Excellent written and verbal communication skills; mastery in English and local language.
• Ability to effectively communicate product architectures design proposals and negotiate options at management levels.

Scope & Impact

• Collaborates with peers junior engineers data scientists and project team.
• Typically interacts with high-level Individual Contributors Managers and Program Teams.
• Leads a project requiring data engineering solutions development.

Education & Experience

• Bachelors or Masters degree in Computer Science Data Engineering Information Systems Engineering or equivalent.
• Typically 4-6 years experience.

Disclaimer

This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties skills responsibilities knowledge etc. These may be subject to change and additional functions may be assigned as needed by management.

Salary

The pay range for this role is$105050to$161800USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location job-related knowledge skills and experience.

Benefits:

HP offers a comprehensive benefits package for this position including:

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies including;
• 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave (US benefits overview)

The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time with or without notice subject to applicable law.

Job -

Schedule -

Shift -

Travel -

Relocation -

Equal Opportunity Employer (EEO) -

HP Inc. provides equal employment opportunity to all employees and prospective employees without regard to race color religion sex national origin ancestry citizenship sexual orientation age disability or status as a protected veteran marital status familial status physical or mental disability medical condition pregnancy genetic predisposition or carrier status uniformed service status political affiliation or any other characteristic protected by applicable national federal state and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

For more information review HPsEEO Policy or read about your rights as an applicant under the law here: Know Your Rights: Workplace Discrimination is Illegal