AWS Data Engineer W2 role
Share
Job Location:
McLean, MD - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
We have 2 openings for this and urgently need candidates. Must be Cap One former
Job Title
- Lead data engineer
6 month extensions
Remote
Worksite Location
- 1680 Capital One Dr Mclean VA 22102 USA or REMOTE
Top Skills - Must Haves
- Python
- Sql
- Aws
- Data
- Etl
- Integration
- Big data
- Agile
- snowflake
- databricks
- EMR
- Glue
- Lambda
- cloudwatch
- S3
Top Skills Details
Discovers historical credit card data will be in the Capital One ecosystem in OneStreams OneLake location and these Engineering teams will be responsible for picking the data up transforming and loading into target state which could be Snowflake or AWS S3
6 Data Engineering teams with 2 Midlevel Data Engineers each (Capital One formers required)
- Able to work independently
Tech Stack: Must Have / Nice to Have
Must Have
AWS(EMR/Glue S3 Lambda Cloudwatch) Python/Java Spark Databricks SQL Bash)
Python use: scripting building new data pipelines (not app dev)
Data warehousing experience (Snowflake)
APIs
Agile engineering practices & JIRA usage
Nice to Have
- Kafka Airflow Open Table formats (Delta Hudi Iceberg) Splunk NewRelic Github Jenkins prior Capital One experience highly preferred
Can be remote or located in Capital One core locations (listed in order of preference)
- Chicago
- McLean
- Richmond
- Plano
Secondary Skills - Nice to Haves
- kafka
- airflow
Job Description
Tech Stack: Must Have / Nice to Have
Must Have
AWS(EMR/Glue S3 Lambda Cloudwatch) Python/Java Spark Databricks SQL Bash)
Python use: scripting building new data pipelines (not app dev)
Data warehousing experience (Snowflake)
APIs
Agile engineering practices & JIRA usage
Nice to Have
- Kafka Airflow Open Table formats (Delta Hudi Iceberg) Splunk NewRelic Github Jenkins
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
