Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Classification:
Technology Engineering & CloudLead Data Engineer (The Prudential Insurance Company of America Newark NJ):
Design and develop highly scalable and efficient data architectures that align with business requirements and support analytical usecases. Provide technical expertise to the data engineering team offering guidance on best practices coding standards and architectural designs. Design and implement robust ETL/ELT pipelines leveraging AWS Cloud Big Data technologies (Spark & Python) and Snowflake for seamless data ingestion transformation and loading from diverse sources. Demonstrate expertise in AWS data services including S3 Glue Redshift EMR Kinesis Lambda and showcase strong knowledge in Snowflake services such as external stage security assisted engineering and the Snowflake marketplace. Create automations and CI/CD pipelines using tools like BitBucket Jenkins and Cloud Formation to streamline development and deployment processes. Optimize data storage query performance and costs on AWS and Snowflake resources to enhance operational efficiency. Ensure the implementation of data security best practices encryption measures and access controls to meet industry standards and regulations. Collaborate with data scientists analysts and other stakeholders to understand business requirements and deliver actionable insights. Maintain comprehensive documentation of data engineering processes data models and infrastructure configurations to ensure transparency and ease of knowledge transfer.
Telecommuting permitted up to 3 day(s) per week.
Full time employment Monday Friday 40 hours per week.
MINIMUM REQUIREMENTS:
Must have a Bachelors degree or foreign equivalent in Computer Science Information Technology or a related field and 5 years of progressive postbaccalaureate related work experience. Alternatively employer will accept a Masters degree or foreign equivalent in Computer Science Information Technology or a related field and 3 years of related work experience.
Must have 3 years of experience in each of the following:
- ExtractTransformLoad Experience;
- Python;
- Spark Hadoop Hive and Pyspark;
- Database including SQLServer Snowflake and Redshift;
- Job Orchestrations including Step Function and Airflow;
- Version Control Tools such as BitBucket Github or Gitlab;
- CI/CD Pipelines specifically Jenkins or flyway pipelines; and
- Infrastructure as Code including CloudFormation CDK or Terraform.
Telecommuting permitted up to 3 day(s) per week.
TO APPLY: Please click Apply Button. Should you have any difficulty in applying for this position through our website please contact for assistance in the application process.
What we offer you:
Market competitive base salaries with a yearly bonus potential at every level.
Medical dental vision life insurance disability insurance Paid Time Off (PTO) and leave of absences such as parental and military leave.
401(k) plan with company match (up to 4.
Companyfunded pension plan.
Wellness Programs including up to $1600 a year for reimbursement of items purchased to support personal wellbeing needs.
Work/Life Resources to help support topics such as parenting housing senior care finances pets legal matters education emotional and mental health and career development.
Education Benefit to help finance traditional college enrollment toward obtaining an approved degree and many accredited certificate programs.
Employee Stock Purchase Plan: Shares can be purchased at 85 of the lower of two prices (Beginning or End of the purchase period) after one year of service.
Eligibility to participate in a discretionary annual incentive program is subject to the rules governing the program whereby an award if any depends on various factors including without limitation individual and organizational performance. To find out more about our Total Rewards package visit Work Life Balance Prudential Careers. Some of the above benefits may not apply to parttime employees scheduled to work less than 20 hours per week.
Prudential Financial Inc. of the United States is not affiliated with Prudential plc. which is headquartered in the United Kingdom.
Prudential is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color religion national origin ancestry sex sexual orientation gender identity national origin genetics disability marital status age veteran status domestic partner status medical condition or any other characteristic protected by law.
If you need an accommodation to complete the application process please email .
If you are experiencing a technical issue with your application or an assessment please email to request assistance.
Employment Type
Full Time
