Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
As the Lead Data Engineeryou will report to the
Engineer Manager (Data Services) and continuously collaborate closely with key stakeholders across the business to solve critical technical challenges.
Key Responsibilities:
Take ownership for achieving objectives and key results for your team oversee & own technical solutions communicate schedule status and milestones
Collaborate with cross functional partners (Product Managers Data Scientists Machine Learning Engineers Software Engineers and Business teams) to build data products
Communicate effectively with both technical and non-technical stakeholders. Translate technical concepts into clear accessible terms.
Develop optimize and maintain complex ETL processes for data movement and transformation
Review code and provide technical guidance to ensure adherence to high-quality standards and best practices in data engineering
Develop APIs and microservices to expose and integrate data products with software systems
Implement monitoring logging and alerting systems to proactively identify and resolve issues
Ensure data quality security and compliance with relevant regulations and standards
Stay current with industry trends emerging technologies and best practices in data engineering. Foster a culture of continuous learning and skill development within the team
Qualifications :
Required Experience & Skills
- BS MS or PhD in Computer Science Mathematics Statistics Engineering Operations Research or a related quantitative field
- 7 years of experience as a Data Engineer or Software Engineer developing and maintaining data pipelines infrastructure and architecture
- Strong programming skills in Python with a solid understanding of core computer science principles
- Knowledge of relational and dimensional data modeling for building data products.
- Experience with data quality checks and data monitoring solutions.
- Experience orchestrating complex workflows and data pipelines using Airflow or similar tools
- Proficiency with Git CI/CD pipelines Docker and Kubernetes
- Experience architecting solutions on AWS or equivalent public cloud platforms
- Experience developing data APIs microservices and event-driven systems to integrate data products
- Strong interpersonal and verbal communication skills
- Proven leadership experience with the ability to mentor and guide a team
- Preferred Experience & Skills:
- Familiarity with data mesh concepts.
- Domain knowledge in recommender systems fraud detection personalization and marketing science.
- Understanding of vector databases knowledge graphs and other advanced data organization techniques.
- Hands-on experience with tools such as Snowflake Postgres DynamoDB Kafka Fivetran dbt Airflow Docker Kubernetes SageMaker Datadog PagerDuty data observability tools and data governance tools.
Additional Information :
Applicable only to applicants applying to a position in any location with pay disclosure requirements under state or local law:
The compensation range described below is the range of possible base pay compensation that the Company believes in good faith it will pay for this role at the time of this posting based on the job grade for this position. Individual compensation paid within this range will depend on many factors including geographic location and we may ultimately pay more or less than the posted range. This range may be modified in the future.
We offer a comprehensive package of benefits including paid time off (vacation holidays sick) medical/dental/vision insurance and 401(k) to eligible employees.
This job is eligible to participate in our short-term incentive programs.
This job is eligible to participate in our long-term incentive programs
Note: No amount of pay is considered to be wages or compensation until such amount is earned vested and determinable. The amount and availability of any bonus commission incentive benefits or any other form of compensation and benefits that are allocable to a particular employee remains in the Companys sole and absolute discretion unless and until paid and may be modified at the Companys sole and absolute discretion consistent with applicable law.
AbbVie is an equal opportunity employer and is committed to operating with integrity driving innovation transforming lives and serving our community. Equal Opportunity Employer/Veterans/Disabled.
US & Puerto Rico only - to learn more visit & Puerto Rico applicants seeking a reasonable accommodation click here to learn more:
Yes
Employment Type :
Full-time
Employment Type
Remote
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
