Filevine is forging the future of legal work with cloud-based workflow tools. We have a reputation for intuitive streamlined technology that helps professionals manage their organization and serve their clients better. Were also known for our team of extraordinary and passionate professionals who love working together to help organizations thrive. Our success has catapulted Filevine to the forefront of our fieldwe are ranked as one of the most innovative and fastest-growing technology companies in the country by both Deloitte and Inc.
Our Mission
Filevine is building the seamless intersection between legal and business by creating a world- class platform to help professionals scale.
Role Summary:
Were a team of driven enthusiastic problem solvers with strong backgrounds in machine learning engineering product management legal and operations on a mission to help attorneys resolve cases faster for better outcomes. With two established ML teams pushing boundaries in transcription NLP and GenAI applications were now building a critical analytics layer to ensure operational excellence quality assurance and continuous improvement across all our AI systems.
Responsibilities
- Build ML operations analytics tracking pipeline health costs latency and quality metrics across all services
- Lead LLM evaluation initiatives using frameworks like Braintrust or Langfuse designing custom metrics quality monitoring and LLM observability in general
- Collaborate with our data annotation team on prompt engineering and evaluation dataset creation
- Aggregate and operationalize user feedback for model improvement
- Create actionable dashboards and insights for ML teams and leadership
- Help define SLAs cost optimization and failure prevention strategies for our ML pipelines
Qualifications
- 3 years in data science ML operations or analytics engineering
- Experience with LLM evaluation frameworks and quality metrics design
- Strong Python SQL and data visualization skills
- Knowledge of prompt optimization techniques
- Excellent communication skills in English to translate technical metrics into business insights
- Collaborative mindset with ability to work across machine learning teams
- Ability to meet periodically in our Prague office as we value in-person collaboration
This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.
This role is open exclusively to candidates currently residing in or willing to relocate to Czechia or Slovakia with the legal right to work in these countries. Unfortunately we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements
Privacy Policy Notice
Filevine will handle your personal information according to whats outlined in our.
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
Filevine is forging the future of legal work with cloud-based workflow tools. We have a reputation for intuitive streamlined technology that helps professionals manage their organization and serve their clients better. Were also known for our team of extraordinary and passionate professionals who lo...
Filevine is forging the future of legal work with cloud-based workflow tools. We have a reputation for intuitive streamlined technology that helps professionals manage their organization and serve their clients better. Were also known for our team of extraordinary and passionate professionals who love working together to help organizations thrive. Our success has catapulted Filevine to the forefront of our fieldwe are ranked as one of the most innovative and fastest-growing technology companies in the country by both Deloitte and Inc.
Our Mission
Filevine is building the seamless intersection between legal and business by creating a world- class platform to help professionals scale.
Role Summary:
Were a team of driven enthusiastic problem solvers with strong backgrounds in machine learning engineering product management legal and operations on a mission to help attorneys resolve cases faster for better outcomes. With two established ML teams pushing boundaries in transcription NLP and GenAI applications were now building a critical analytics layer to ensure operational excellence quality assurance and continuous improvement across all our AI systems.
Responsibilities
- Build ML operations analytics tracking pipeline health costs latency and quality metrics across all services
- Lead LLM evaluation initiatives using frameworks like Braintrust or Langfuse designing custom metrics quality monitoring and LLM observability in general
- Collaborate with our data annotation team on prompt engineering and evaluation dataset creation
- Aggregate and operationalize user feedback for model improvement
- Create actionable dashboards and insights for ML teams and leadership
- Help define SLAs cost optimization and failure prevention strategies for our ML pipelines
Qualifications
- 3 years in data science ML operations or analytics engineering
- Experience with LLM evaluation frameworks and quality metrics design
- Strong Python SQL and data visualization skills
- Knowledge of prompt optimization techniques
- Excellent communication skills in English to translate technical metrics into business insights
- Collaborative mindset with ability to work across machine learning teams
- Ability to meet periodically in our Prague office as we value in-person collaboration
This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.
This role is open exclusively to candidates currently residing in or willing to relocate to Czechia or Slovakia with the legal right to work in these countries. Unfortunately we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements
Privacy Policy Notice
Filevine will handle your personal information according to whats outlined in our.
We may use artificial intelligence (AI) tools to support parts of the hiring process such as reviewing applications analyzing resumes or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed please contact us.
Required Experience:
Senior IC
View more
View less