Job: Sr Data Engineer
Duration: 6 months
Location: Candidate has to be local in DMV area and be able to go to client office as needed in either Suitland MD or Washington DC office.
Hands-on Data Engineer capable of leading projects and collaborating directly with clients to design and develop solutions with strong communication skills.
Experience : 8Years
Responsibilities
- Build and manage data pipelines using Python Pyspark SQL for batch and streaming processes.
- Use AWS services like Glue S3 Redshift Lambda and EMR to create scalable data solutions.
- Develop efficient data models and administer databases with schema optimization and performance tuning.
- Create analytical databases with Redshift or Snowflake and implement ETL best practices.
- Optimize query performance and ensure pipeline reliability with monitoring tools like CloudWatch.
- Adhere to security and compliance standards (e.g. GDPR HIPAA) and automate deployments using IaC tools like CloudFormation or Terraform.
- Collaborate with data scientists analysts and stakeholders to meet data needs and stay updated on AWS advancements.
Skills
- Strong technical expertise in AWS services data engineering data modeling and performance optimization.
- Excellent communication and teamwork abilities for client and cross-functional collaboration.