Software Engineer II Python and Data pipelines
Software Engineer II Python and Data pipelines
Posted on :
09-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
At Scribd (pronounced scribbed) our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge democratize the exchange of ideas and information and empower collective expertise through our three products: Everand Scribd and Slideshare.
We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.
When it comes to workplace structure we believe in balancing individual flexibility and community connections. Its through our flexible work benefit Scribd Flex that employees in partnership with their manager can choose the daily workstyle that best suits their individual needs. A key tenet of Scribd Flex is our prioritization of intentional inperson moments to build collaboration culture and connection. For this reason occasional inperson attendance is required for all Scribd employees regardless of their location.
So what are we looking for in new team members Well we hire for GRIT. The textbook definition of GRIT is demonstrating the intersection of passion and perseverance towards long term goals. At Scribd we are inspired by the potential that this can unlock and ask each of our employees to pursue a GRITty approach to their work. In a tactical sense GRIT is also a handy acronym that outlines the standards we hold ourselves and each other to. Heres what that means for you: were looking for someone who showcases the ability to set and achieve Goals achieve Results within their job responsibilities contribute Innovative ideas and solutions and positively influence the broader Team through collaboration and attitude.
About the team:
The ML Data Engineering team is at the heart of metadata extraction and enrichment for all of our brands managing and processing hundreds of millions of documents billions of images and serving millions of users. We operate at an unparalleled scale handling diverse datasets including UGC documents ebooks audiobooks and more. Our goal is to build robust systems that drive content discovery trust and structured metadata across our platforms.
Role Overview:
We are seeking a Software Engineer II with a strong background in data engineering software development and scalable systems. As part of the ML Data Engineering team you will work on designing building and optimizing systems that extract enrich and process metadata at scale. Youll collaborate closely with machine learning teams product managers and other engineers to ensure the smooth integration and processing of vast amounts of structured metadata.
Tech Stack:
Our team uses various technologies. The following are the ones that we use on a regular basis: Python Scala Ruby on Rails Airflow Databricks Spark HTTP APIs AWS (Lambda ECS SQS ElastiCache Sagemaker Cloudwatch Datadog) and Terraform.
Responsibilities
- Design and develop data pipelines to extract enrich and process metadata from millions of documents images and other content types.
- Collaborate with crossfunctional teams including ML engineers and product managers to deliver scalable efficient and reliable metadata solutions.
- Build and maintain systems that operate at a massive scale handling hundreds of millions of documents and billions of images.
- Optimize and refactor existing systems for performance scalability and reliability.
- Ensure data accuracy integrity and quality through automated validation and monitoring.
- Participate in code reviews ensuring best practices are followed and maintaining highquality standards in the codebase.
- Manage and maintain data pipelines security and infrastructure.
Requirements
- 4 years of experience in backend software engineering with handson work in developing data pipelines and building and deploying your own infrastructure
- Proficient in one or more programming languages such as Python Ruby or similar
- Experience working with a public cloud provider (AWS Azure or Google Cloud)
- Handson experience with building deploying and optimizing solutions using ECS EKS or AWS Lambdas
- Experience with queueing and streaming technologies like SQS Sidekiq Kafka or Kinesis
- Experience working with systems at scale such as External APIs and data transformations
- Proven ability to test and optimize systems for performance and scalability.
- Bachelors in CS or equivalent professional experienceBonus points if you have experience working with Machine Learning systems
At Scribd your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role level and geographic location. San Francisco is our highest geographic market in the United States. In the state of California the reasonably expected salary range is between $126000 minimum salary in our lowest geographic market within California to $196000 maximum salary in our highest geographic market within California.
In the United States outside of California the reasonably expected salary range is between $103500 minimum salary in our lowest US geographic market outside of California to $186500 maximum salary in our highest US geographic market outside of California.
In Canada the reasonably expected salary range is between $131500 CADminimum salary in our lowest geographic market to $174500CADmaximum salary in our highest geographic market.
We carefully consider a wide range of factors when determining compensation including but not limited to experience; jobrelated skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership and a comprehensive and generous benefits package.
Benefits Perks and Wellbeing at Scribd
*Benefits/perks listed may vary depending on the nature of your employment with Scribd and the geographical location where you work.
Healthcare Insurance Coverage (Medical/Dental/Vision): 100 paid for employees
12 weeks paid parental leave
Shortterm/longterm disability plans
401k/RSP matching
Onboarding stipend for home office peripherals accessories
Tuition Reimbursement
Learning & Development programs
Quarterly stipend for Wellness Connectivity & Comfort
Mental Health support & resources
Free subscription to Scribd gift memberships for friends & family
Referral Bonuses
Book Benefit
Sabbaticals
Company wide events
Team engagement budgets
Vacation & Personal Days
Paid Holidays winter break)
Flexible Sick Time
Volunteer Day
Companywide Employee Resource Groups and programs that foster an inclusive and diverse workplace.
Want to learn more about life at Scribd www.linkedin/company/scribd/life
We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing accommodations @ scribd about the need for adjustments at any point in the interview process.
Scribd is committed to equal employment opportunity regardless of race color religion national origin gender sexual orientation age marital status veteran status disability status or any other characteristic protected by law. We encourage people of all backgrounds to apply and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.
Remote employees must have their primary residence in:Arizona California Colorado Connecticut DC Florida Georgia Hawaii Maryland Massachusetts Michigan Missouri New Jersey New York Ohio Oregon Tennessee Texas Utah Washington Ontario (Canada) British Columbia (Canada) or Mexico
#LIRemote
Employment Type
Full-Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
