Senior Data Engineer

Description -

The Senior Data Engineer will design build and operate high-performance BI-centric solutions utilizing the comprehensive capabilities of the companys analytics this role you will enable and support the intelligence strategy support sustainable effective and efficient solutions collaborate on data solutions and support intellectual curiosity and continuous learning to meet individual and team development goals.

Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors. Leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives. Acts as an expert providing direction and guidance to process improvements and establishing policies. Frequently represents the organization to external customers/clients. Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives. May provide mentoring and guidance to lower level employees.

Job Type : Hybrid/Flexible work culture

Responsibilities

• Leads one or more project teams of other data engineers for all stages of design and development for complex secure and performant data solutions and models including design analysis coding testing and integration of structured/unstructured data.
• Reviews and evaluates designs and project activities for compliance with architecture security and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.
• Drives innovation and integration of new technologies into projects and activities in the big data space.
• Create and maintain optimal data pipeline/ETL architecture.
• Collaborate with businesses application and process owners and product team members to define requirements and design solutions for the companys big data and analytics solutions.
• Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using Databricks and other technologies.
• Perform data modeling and prepare data in databases for use in various analytics tools and configure and develop data pipelines to move and optimize data assets.
• Provide necessary technical support through all phases of the solution life cycle.
• Independently handle complex issues with minimal supervision while escalating only the most complex issues to appropriate staff

Knowledge & Skills

Must Have

• Databricks for data engineering analytics and machine learning workflows
• Python and SQL programming and advanced ETL pipelines
• Lakeflow and Spark-based big data processing and orchestration on Databricks
• GitHub CI/CD Databricks Asset Bundles and modern software engineering practices applied to data engineering
• Strong analytical and problem-solving skills

Nice to Have

• BI and reporting tools (Tableau)
• Collaboration and Agile (Jira Confluence Scrum Kanban)
• Experience with NoSQL and relational systems
• A current Databricks Certified Data Engineer certification
• Team Leadership and Data Ops skills

Experience Highlights

• Designing and deploying scalable data solutions on Databricks and cloud ecosystems
• Building and optimizing distributed data pipelines for complex high-volume environments
• Implementing BI solutions and enabling data-driven decision-making
• Communicating architecture and design proposals effectively to senior stakeholders
• Working at a complex high-stakes startup-like environment

Scope & Impact

• Collaborates with peers Data engineers data scientists and the project team.
• Typically interacts with high-level Individual Contributors Managers Directors and Program Core Teams.
• Leads multiple projects requiring data engineering solutions development.
• Drives design innovation.

Prior Beneficial Experiences

• Experience and skills with application programming interface development.
• Applied experience in reporting tools.
• Applied experience with cloud platforms.

Education & Experience

• Bachelors or Masters degree in Computer Science Information Systems Engineering or equivalent.
• Typically 6-10 years experience.

#LI-POST

Job -

Schedule -

Shift -

Travel -

Relocation -

Equal Opportunity Employer (EEO) -

HP Inc. provides equal employment opportunity to all employees and prospective employees without regard to race color religion sex national origin ancestry citizenship sexual orientation age disability or status as a protected veteran marital status familial status physical or mental disability medical condition pregnancy genetic predisposition or carrier status uniformed service status political affiliation or any other characteristic protected by applicable national federal state and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

For more information review HPsEEO Policy or read about your rights as an applicant under the law here: Know Your Rights: Workplace Discrimination is Illegal