Sr. Data Engineer (USC & GC only No C2C)

Not Interested
Bookmark
Report This Job

profile Job Location:

Charlotte, VT - USA

profile Monthly Salary: Not Disclosed
Posted on: 3 days ago
Vacancies: 1 Vacancy

Job Summary

US Citizen and GC only at this time on W2 No C2C

Key skills include strong Snowflake expertise advanced SQL proficiency data extraction from APIs using Python and AWS Lambda and experience with ETL/ELT processes. Workflow automation using AWS Airflow is essential and experience with Fivetran and DBT is a plus.


Job Summary:
We are looking for a hands-on Senior Data Engineer with expertise in developing data ingestion pipelines. This role is crucial in designing building and maintaining our data infrastructure focusing on creating scalable pipelines ensuring data integrity and optimizing performance.

Job Responsibilities:

  • Design build test and implement scalable data pipelines using Python and SQL.
  • Maintain and optimize our Snowflake data warehouses performance including data ingestion and query optimization.
  • Extract data from APIs using Python and AWS Lambda and automate workflows with AWS Airflow.
  • Perform analysis and critical thinking to troubleshoot data-related issues and implement checks/scripts to enhance data quality.
  • Collaborate with other data engineers and architect to develop new pipelines and/or optimize existing ones.
  • Maintain code via CI/CD processes as defined in our Azure DevOps platform.

Job Qualifications:

  • 7 years of experience in Data Engineering roles with a focus on building and implementing scalable data pipelines for data ingestion.
  • Expertise in Snowflake including data ingestion and performance optimization.
  • Strong SQL skills for writing efficient queries and optimizing existing ones.
  • Proficiency in Python for data extraction from APIs using AWS Lambda Glue etc.
  • Experience with AWS services such as Lambda Airflow Glue S3 SNS etc.
  • Highly self-motivated and detail-oriented with strong communication skills.
  • Familiarity with ETL/ELT processes.
  • Experience with Fivetran and DBT is a plus.

Additional Information :

All your information will be kept confidential according to EEO guidelines.


Remote Work :

No


Employment Type :

Contract

US Citizen and GC only at this time on W2 No C2CKey skills include strong Snowflake expertise advanced SQL proficiency data extraction from APIs using Python and AWS Lambda and experience with ETL/ELT processes. Workflow automation using AWS Airflow is essential and experience with Fivetran and DBT...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala