Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Description
Job Summary
We are looking for a Senior Analytics Engineer to drive data excellence and innovation in our organization. As a thought leader in data engineering and analytics principles you will be responsible for designing building and optimizing our data infrastructure while ensuring cost efficiency security and scalability. You will play a crucial role in managing Databricks and AWS usage ensuring budget adherence and taking proactive measures to optimize costs. This role also requires expertise in ETL processes largescale data processing analytics and datadriven decisionmaking along with strong analytical and leadership skills.
Responsibilities
- Act as a thought leader in data engineering and analytics driving best practices and standards.
- Oversee cost management of Databricks and AWS ensuring resource usage stays within allocated budgets and taking corrective actions when necessary.
- Design implement and optimize ETL pipelines for incremental data loading ensuring seamless data ingestion transformation and performance tuning.
- Lead migration activities ensuring smooth transitions while maintaining data integrity and availability.
- Handle massive data loads efficiently optimizing storage compute usage and query performance.
- Adhere to Git principles for version control ensuring best practices for collaboration and deployment.
- Implement and manage DSR (Airflow) workflows to automate and schedule data pipelines efficiently.
- Ensure data security and compliance especially when handling PII data aligning with regulations like GDPR and HIPAA.
- Optimize query performance and data storage strategies to improve cost efficiency and speed of analytics.
- Collaborate with data analysts and business stakeholders to enhance analytics capabilities enabling datadriven decisionmaking.
- Develop and maintain dashboards reports and analytical models to provide actionable insights for business and engineering teams.
Required Skills & Qualifications:
- Fouryear or Graduate Degree in Computer Science Information Systems or any other related discipline or commensurate work experience or demonstrated competence.
- 611 years of experience in Data Engineering Analytics Big Data or related domains.
- Strong expertise in Databricks AWS (S3 EC2 Lambda RDS Redshift Glue etc. and cost optimization strategies.
- Handson experience with ETL pipelines incremental data loads and largescale data processing.
- Proven experience in analyzing large datasets deriving insights and optimizing data workflows.
- Strong knowledge of SQL Python PySpark and other data engineering and analytics tools.
- Strong problemsolving analytical and leadership skills.
- Experience with BI tools like Tableau Looker or Power BI for data visualization and reporting.
Preferred Certifications
Certified Software Systems Engineer (CSSE)
Certified Systems Engineering Professional (CSEP)
CrossOrg Skills
Effective Communication
Results Orientation
Learning Agility
Digital Fluency
Customer Centricity
Impact & Scope
Impacts function and leads and/or provides expertise to functional project teams and may participate in crossfunctional initiatives.
Complexity
Works on complex problems where analysis of situations or data requires an indepth evaluation of multiple factors.
Disclaimer
This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties skills responsibilities knowledge etc. These may be subject to change and additional functions may be assigned as needed by management.
Job
SoftwareSchedule
Full timeShift
No shift premium (India)Travel
Relocation
Equal Opportunity Employer (EEO)
HP Inc. provides equal employment opportunity to all employees and prospective employees without regard to race color religion sex national origin ancestry citizenship sexual orientation age disability or status as a protected veteran marital status familial status physical or mental disability medical condition pregnancy genetic predisposition or carrier status uniformed service status political affiliation or any other characteristic protected by applicable national federal state and local law(s).
Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.
If youd like more information about HPsEEO Policyor your EEO rights as an applicant under the law please click here:Equal Employment Opportunity is the LawEqual Employment Opportunity is the Law Supplement
Employment Type
Full-Time
