Senior Data Engineer (AWS / Python / SQL / Snowflake) -
Senior Data Engineer (AWS / Python / SQL / Snowflake) -
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
*Remote Contract-to-Hire Opportunity*
Lighthouse Technology Services is partnering with our client to fill their Senior Data Engineer (AWS / Python / SQL / Snowflake) position! This is a 6 month contract-to-hire opportunity. This role can be remote within the United States with quarterly travel to Charlotte NC. This role will be a W2 employee of Lighthouse Technology Services.
Position Overview
We are looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing building and maintaining our data infrastructure focusing on creating scalable pipelines ensuring data integrity and optimizing performance.
What Youll Be Doing:
- Design build test and implement scalable data pipelines using Python and SQL.
- Maintain and optimize our Snowflake data warehouses performance including data ingestion and query optimization.
- Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow.
- Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
- Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones.
- Maintain code via CI/CD processes as defined in our Azure DevOps platform.
What Youll Need to Have:
- Senior level hands on Data Engineering roles with a focus on building and implementing scalable data pipelines for data ingestion.
- Performance Tuning experience
- Expertise in Snowflake including data ingestion and performance optimization.
- Strong SQL skills for writing efficient queries and optimizing existing ones.
- Advanced Python skills for data extraction from APIs using AWS Lambda Glue etc.
- Experience with AWS services such as Lambda Airflow Glue S3 SNS Coudwatch etc.
- CI/CD pipeline expertise beyond ADO.
- Understanding of deployment strategies.
- Knowledge of maintaining and optimizing data warehouses.
- Experience working in a SAFe Agile/SCRUM environment.
- Familiarity with ETL/ELT processes.
- Experience with Fivetran and DBT is a plus.
Pay Range:$84-$89/hr
Required Experience:
Senior IC
Employment Type
Hourly
