Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Job Alert
You will be updated with latest job alerts via email
Job Description
Data Engineer
TECHNICAL SKILLS:
-
Python 3
-
Numerical analysis using Pandas
-
PostgreSQL / Amazon Redshift integration and management
-
Psycopg for Python 3
-
Protobuf
-
HTML data formatting for email reports
-
AWS integration with Boto3
-
Creating, deploying, and monitoring AWS Lambda actions
-
Scheduling and monitoring jobs with Apache Airflow
-
Constructing Docker containers
-
Deploying Docker containers to a Kubernetes cluster
RESPONSIBILITIES:
-
Extract, analyze, store, and send data from PostgreSQL on AWS Redshift and Protobuf and JSON files hosted on AWS S3.
-
Using data in Redshift, construct HTML summaries of product performance to inform future engineering decisions.
-
Support teams reliant on the data in S3 and Redshift -- R&D, Operations, Customer
Service -- by creating new reports and tools to simplify data queries. Work with DevOps to manage the underlying infrastructure on AWS.
Employment Type
Full Time
Key Skills
