Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
WM a Fortune 250 company is the leading provider of comprehensive waste and environmental services in North America. We are strongly committed to a foundation of operating excellence professionalism and financial strength. WM serves nearly 25 million customers in residential commercial industrial and municipal markets throughout North America through a network of collection operations transfer stations landfills recycling facilities and waste-based energy production projects.
I. Job Summary
This position is responsible for developing Python modules using Numpy Pandas and dynamic programming in AWS and Snowflake. They will expand and optimize our ETL and data pipeline architecture and data flow across our Business Portfolio. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our data product owners developers data architects data analysts and data scientists on BI and Analytic initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our companys data architecture to support our next generation of products and data initiatives.
The candidate will also assist in issue resolution job orchestration automation and continuous improvement of our data integration processes.
II. Essential Duties and Responsibilities
To perform this job successfully an individual must be able to perform each duty satisfactorily. Other ancillary duties may be assigned.
- Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using Cloud Integration ETL Tools Cloud Data Warehouse SQL and AWS.
- Design and develop ELT ETL event-driven data integration architecture solutions.
- Work with Data Analysts Data Architects BI Architects Data Scientists and Data Product Owners to establish an understanding of source data and determine data transformation/integration requirements.
- Troubleshoot and tune complex SQL queries.
- Utilize On-Prem and Cloud-based ETL platforms Cloud Data Warehouse AWS GitHub various scripting languages SQL querying tools data quality tools and metadata management tools.
- Develop data validation processes to ensure data quality.
- Demonstrated ability to work individually and as part of a team in a collaborative manner.
- Mentors and fosters growth of peers and team members.
- May work on-call shifts on a rotation basis.
III. Supervisory Responsibilities
May coach and mentor less-experienced analysts and act as team leader on systems projects.
IV. Qualifications
The requirements listed below are representative of the qualifications necessary to perform the job.
A. Education and Experience
- Education: Bachelors Degree in Computer Science MIS or similar area of study
- Experience: Five (5) years of previous experience (in addition to education requirement).
B. Certificates Licenses Registrations or Other Requirements
- None required.
C. Other Knowledge Skills or Abilities Required
Advanced knowledge or skills in one or more of the following is required:
- Advanced working SQL knowledge and experience working with relational databases query authoring (SQL) and familiarity with a variety of databases.
- Experience working with Cloud Data Warehouses like Snowflake Google BigQuery Amazon Redshift.
- Experience with Cloud Integration Tools like Matillion Dell Boomi Informatica Cloud Talend AWS Glue.
- Experience with AWS cloud services: EC2 S3 Lambda SQS SNS etc.
- Experience with GitHub and its integration with ETL tools for version control.
- Familiarity with modern data management tools and platforms including Spark Hadoop/Hive NoSQL APIs Streaming and other analytic data platforms.
- Experience with object-oriented/object function scripting languages: Python Java Scala etc. is a plus.
- Experience with Agile/Scrum methodologies is valuable.
- Ability to lead a group to consensus solve problems and accomplish tasks.
- Ability to mentor and train less knowledgeable peers and individuals.
- Excellent interpersonal and communication skills (both written and verbal).
- Ability to multitask meet deadlines and work in a fast-paced environment.
- Ability to adapt to change.
- General business knowledge and concepts.
- Ability to multitask meet deadlines and work in a fast-paced environment.
- Demonstrate flexibility and a willingness to undertake a wide variety of challenging tasks.
- Extraordinary attention to detail and accuracy.
D. Other Knowledge Skills or Abilities that Contribute to Success
May require advanced skills in one or more of the following:
- Web application development imaging technology.
- Ability to multitask meet deadlines and work in a fast-paced environment.
- Demonstrate flexibility and a willingness to undertake a wide variety of challenging tasks.
V. Work Environment
Listed below are key points regarding environmental demands and work environment of the job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.
- Required to use motor coordination with finger dexterity (such as keyboarding machine operation etc.) most of the work day;
- Required to exert physical effort in handling objects less than 30 pounds rarely;
- Required to be exposed to physical occupational risks (such as cuts burns exposure to toxic chemicals etc.) rarely;
- Required to be exposed to physical environment which involves dirt odors noise weather extremes or similar elements rarely;
- Normal setting for this job is an office setting.
Benefits
At WM each eligible employee receives a competitive total compensation package including Medical Dental Vision Life Insurance and Short Term Disability. As well as a Stock Purchase Plan Company match on 401K and more! Our employees also receive Paid Vacation Holidays and Personal Days. Please note that benefits may vary by site.
If this sounds like the opportunity that you have been looking for please click Apply.
Required Experience:
Senior IC
Employment Type
Full-Time
