SeniorLead Data Engineer
SeniorLead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
NiX is looking for a Senior Data/Lead Engineer to join our team!
About the project:
Our customer is the leading school transportation provider in North America being the owner of more than a half of all yellow school buses in the United States. Every day the company completes 5 million student journeys moving more passengers than all U.S. airlines combined and delivers reliable quality services for 1100 school districts.
NiX has built a successful cooperation with the client delivering a range of complex initiatives. As a result NiX has been selected as a strategic longterm partner to drive the digital transformation on an enterprise level fully remodeling the technology landscape for 55000 employees and millions of people across North America.
Responsibilities:
- Design complex ETL processes of various data sources in the data warehouse
- Build new and maintain existing data pipelines using Python to improve efficiency and latency
- Improve data quality through anomaly detection by building and working with internal tools to measure data and automatically detect changes
- Identify design and implement internal process improvements including redesigning infrastructure for greater scalability optimizing data delivery and automating manual processes
- Perform data modeling and improve our existing data models for analytics
- Collaborate with SMEs architects analysts and others to build solutions that integrate data from many of our enterprise data sources
- Partner with stakeholders including data design product and executive teams and assist them with datarelated technical issues
Requirements:
- Proficiency in Python and SQL
- 35 years of commercial experience in building and maintaining a Data Lake
- Good knowledge of AWS cloud services including the Glue framework
- Experience maintaining Apache Kafka
- Knowledge of job scheduling and orchestration using Airflow
- Wellversed in the optimization of ETL processes
- Steady expertise in data processing tools including Elasticsearch Apache Spark Apache Hive Apache HBase Apache Flink Apache Hudi Presto.
- Decent knowledge of CI/CD (Docker Jenkins Terraform Git)
- Good understanding of algorithms and data structures
- Excellent communication skills both written and verbal
Nice to have:
- Experience in the schema and dimensional data design
- Collaboration within a scaled team using Agile methodology
We offer:
- Flexible working format remote officebased or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program tech talks and trainings centers of excellence and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other locationspecific benefits
Required Experience:
Senior IC
Employment Type
Full Time
