(Data Engineer)

Not Interested
Bookmark
Report This Job

profile Job Location:

McLean, MD - USA

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

Position : Sr. Data Engineer

Location : McLean VA Onsite

Experience : 12 months

Key Responsibilities:

  • Design develop and maintain scalable data pipelines and architectures using Python PySpark and AWS services.
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions.
  • Optimize data workflows for performance and reliability.
  • Implement and manage data storage solutions utilizing DynamoDB S3 and other AWS services.
  • Develop and deploy serverless applications using Lambda and Glue.
  • Work with Spark-based data processing frameworks such as Databricks.
  • Maintain and improve existing data infrastructure ensuring security compliance and best practices.
  • Sit onsite in McLean VA to coordinate with onsite teams.

Required Skills & Experience:

  • Proven experience with Python PySpark and .
  • Extensive experience with AWS services including EMR Glue Lambda S3 SNS DynamoDB.
  • Strong understanding of data warehousing ETL/ELT processes and big data technologies.
  • Prior experience working in or with Capital One is highly preferred.
  • Excellent problem-solving skills and ability to work independently.
  • Good communication and team collaboration skills.

Nice to Have:

  • Knowledge of financial data domain and regulatory compliance.
  • Experience with Databricks platform.
  • Prior on-site work experience in McLean.

Thanks & Regards

Himanshu Sharma

Recruitment Lead

Email :

Position : Sr. Data Engineer Location : McLean VA Onsite Experience : 12 months Key Responsibilities: Design develop and maintain scalable data pipelines and architectures using Python PySpark and AWS services. Collaborate with cross-functional teams to gather requirements and deliver data solut...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala