Senior Data Engineer
Senior Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Since our founding in 2012 Lotlinx has consistently pioneered advancements in the automotive landscape. We specialize in empowering automobile dealers and manufacturers by providing cuttingedge data and technology delivering a distinct market advantage for every single vehicle transaction. Today we stand as the foremost automotive AI and machine learning powered technology excelling in digital marketing risk management and strategic inventory management.
Lotlinx provides employees with a dynamic work environment that is challenging teamoriented and full of passionate people. We offer great incentives to our employees such as competitive compensation and benefits flex time off and career development opportunities.
Job Summary
The Senior Data Engineer will be responsible for the development and deployment of cloudfirst ETL processes Data management Data Warehousing and more in the Automotive Digital Advertising industry. LotLinx is looking for a candidate who thrives in a fastpaced collaborative environment and can utilize data to improve optimize and lead further development of our data aggregation processes.
This hybrid position is located in either ourWinnipeg or Hamilton office locations.
Key Responsibilities
- Design build and maintain robust scalable and efficient data pipelines to process largescale datasets from multiple sources.
- Develop and manage ETL/ELT workflows for data ingestion transformation and loading into data lakes and warehouses.
- Architect and implement cloudbased solutions (AWS GCP) to ensure data security scalability and high availability.
- Work with stakeholders including Analytics Product and Design teams to assist with data related technical issues and support their data infrastructure needs.
- Partner with DevOps and Security teams to ensure compliance with data governance privacy and security standards.
- Engineer solutions for large data storage management.
- Proactively identify and resolve performance bottlenecks scaling challenges and technical issues.
- Explore available technologies and design solutions to continuously improve our data quality workflow reliability scalability while reporting performance and capabilities.
- Act as an internal expert in each of the data sources so that you can own overall data quality.
Qualifications:
- 5 years of experience in data engineering or a similar role with a focus on designing and managing scalable data systems.
- Proven expertise with cloud platforms specifically AWS and/or GCP.
- Proficiency in SQL including advanced query optimization and data modeling techniques.
- Strong programming skills in Python Scala or Java with a focus on developing data processing applications.
- Experience with Data Engineering tools such as Airflow Dataflow DBT.
- Experience with big data frameworks like Apache Spark Hadoop or Beam.
- Handson experience with realtime data streaming platforms such as Apache Kafka Pub/Sub or Kinesis.
- Knowledge of CI/CD pipelines version control systems (e.g. Git) and containerization technologies (e.g. Docker Kubernetes).
- Experience managing data warehouses and lakes using modern platforms such as Snowflake BigQuery or Redshift.
- Familiarity with data governance frameworks security best practices and compliance standards.
- Demonstrated ability to solve complex technical challenges think creatively and innovate within cloud and data ecosystems.
The salary range for this position is $108000 $162000.
Lotlinx is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race color religion gender gender identity or expression sexual orientation national origin genetics disability age or veteran status.
Lotlinx is not currently able to offer sponsorship for employment visa status.
Lotlinx is headquartered in Peterborough NH and has locations in Holmdel NJ Manitoba Ontario and British Columbia Canada in addition to a large team spanning from the US to Canada.
Our success relies heavily on our customers but also our dedicated talent that continuously moves our platform forward. We value our employees their abilities and seek to foster an open cooperative dynamic environment where the team and company alike can thrive.
Required Experience:
Senior IC
Employment Type
Full Time
