Data Engineer

Merican Inc

Not Interested
Bookmark
Report This Job

profile Job Location:

Richmond, VA - USA

profile Monthly Salary: Not Disclosed
Posted on: 3 days ago
Vacancies: 1 Vacancy

Job Summary

Data Engineer

Mclean VA or Richmond VA

Hybrid

Responsibilities:

Key Responsibilities:

Design build and optimize ETL pipelines using Python PySpark and Spark

Develop scalable data solutions leveraging Databricks AWS Glue EMR and S3

Collaborate with cross-functional engineering and analytics teams to implement best practices in data ingestion transformation and storage

Support data quality performance tuning and process automation across the data lifecycle

Work in Agile environments with CI/CD and version control tools

Required Skills and Experience:

3 to 7 plus years of experience in data engineering preferably in cloud-based environments

Strong proficiency in Python PySpark Spark and SQL

Hands-on experience with AWS data services (S3 Glue EMR Redshift Lambda Athena)

Experience with Databricks or equivalent data lake platforms

Familiarity with modern DevOps practices (Git Jenkins Terraform Airflow etc.)

Data Engineer Mclean VA or Richmond VA Hybrid Responsibilities: Key Responsibilities: Design build and optimize ETL pipelines using Python PySpark and Spark Develop scalable data solutions leveraging Databricks AWS Glue EMR and S3 Collaborate with cross-functional engi...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala