Data Engineer
Job Summary
About Karya
Karya provides AI-enabled earning and learning opportunities to economically underserved communities and
high-quality ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20
times the local minimum wage. The platform has delivered over 40 million tasks.
About the role
This role runs live client projects on the Karya platform. The work is the execution layer above the core product:
project workflows data jobs checks reports and delivery.
You will work with Operations and client teams on questions of progress quality pay and files and with platform
engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks
right.
Responsibilities
Run and monitor data jobs on remote Linux servers and recover failed jobs from logs and process state.
Configure project workflows including the handoff from automated processing to human tasks and track what
is in progress held or ready to deliver.
Write PostgreSQL and ClickHouse queries for throughput completion quality pay and delivery status.
Apply completion and quality rules to access pay and delivery decisions after a sample check.
Write Python SQL or Bash scripts for those checks and decisions and keep them in the repository.
Package datasets to client specifications move them through cloud object storage and record what has shipped.
Read the TypeScript / codebase to follow tasks assignments payments and file storage.
Reply to Operations and client teams with the finding the change made and what is still open.
Report repeated manual work to platform engineering with an example.
Requirements
PostgreSQL including joins aggregates and JSON fields.
Scripts in Python Bash or TypeScript checked into git.
Ability to read a TypeScript codebase and a relational schema.
Linux for running jobs: SSH logs long-running processes and disk.
Ability to write technical updates that give non-technical teammates a clear picture of the situation.
Queries or scripts already run against real project or production data.
Good to have
Cloud object storage (Google Cloud Storage S3 or Azure Blob).
Experience with collected datasets such as speech text or images.
ClickHouse Metabase or a similar reporting tool.
Perks
Flexible leave with remote or hybrid work.
Health insurance.
Direct work on data collection that determines worker earnings and client deliverables.
Karya is an equal opportunity employer. Applicants are considered without regard to race religion gender identity sexual orientation
disability or any other protected status. For accommodations contact
Required Experience:
IC