Moving forward heavy SQL and data transformation are the #1 priority. Python development would be nice at this point. This is more of a Data Engineer function than a developer function.
New details leverage SQL outside of an ORM semantic versioning FastAPI experience asynchronous operations Moving forward the focus should be on data engineering with some python/microsvcs expertise. A former DBA would probably be a pretty good fit. Any future candidates will need to have the below at a minimum in addition to being skillmapped against the JD from yesterday. This is going to be a challenge to fill in a timely manner. Fun times! Has midlevel experience leverage SQL/data modeling outside of an ORM Familiarization with semantic versioning FastAPI Django and/ or Flask (microsvcs dev experience) ARQ/Redis experience Has used asynchronous operations Developed microsvcs using Jango Flask or some other mechanism As mentioned before experience with DBT (Data Build Tool) would be HUGE however probably a needle in the haystack.
Relevant Experience(in yrs)
510 Years
Technical/Functional Skills
Primary Skills:
Validate cleanse and transform data with SQL
create pythonic microservices to
execute jobs
coordinate jobs
move data
enrich data
API Servers
Support a UXUI
Support microservices (no UXUI)
Common service modules:
Pandas databases requests asyncio
Common test modules:
tox pytest panda pycodestyle black pylint
Frameworks and platforms
DBT FastApi Liquibase Arq
Additional Skills and Patterns:
Data Processing Transformation and Validation
Configuration management
Job Queues and Workers
Connector Patterns
- Data Messaging and Change Data Capture
- Asynchronous programming
- Metadata management
Database Skills:
Postgres Redis
OPS
Git Ansible Bash Make
Experience Required
510 Years of overall experience
Roles & Responsibilities
Analyze design code test configure and modify software for our platform integrations and services using various programming languages technologies and development methodologies.
Design develop test debug and implement platforms pipelines solutions and/or software tools and utilities for the purpose of assuring acceptable performance and service levels.
Participate in the automated delivery of software using source control IaC throughout the entire delivery model
Ensures that implemented platforms pipelines and solutions are optimally monitored with relevant alerts logging and tracing that guarantees the durability availability and performance of our services.
Complete documentation that contributes value including but not limited to testing training and software delivery
Senior Data Engineer- Remote
