An experienced Data Engineer is needed to support our infrastructure initiatives within the legal team. This role focuses on designing building and maintaining high-complexity data pipelines and alerting systems to ensure robust monitoring and operational efficiency. The ideal candidate will bring a strong technical background excellent collaboration skills and a keen eye for security and privacy considerations.
Responsibilities:
- Develop modify and optimize complex SQL and Python-based data pipelines using tools such as DataSwarm Airflow and similar frameworks.
- Lead end-to-end projects for building scalable data warehousing solutions and high-precision monitoring and alerting systems.
- Collaborate effectively with cross-functional teams to gather requirements troubleshoot issues and implement data solutions that align with organizational goals.
- Ensure data privacy security and compliance are integrated into all data engineering practices.
- Maintain documentation provide technical mentorship and continuously seek opportunities to improve data infrastructure reliability and performance.
Required Skills and Qualifications:
- Minimum 5 years of professional experience in data engineering with a focus on SQL and Python pipeline development.
- Proven experience working on complex data warehousing projects and building/leading the development of high-complexity monitoring and alerting systems.
- Strong communication skills with the ability to navigate ambiguity collaborate across teams and clearly articulate technical concepts.
- Demonstrated tenacity curiosity and problem-solving skills especially in fast-paced or evolving environments.
- Knowledge of privacy security and compliance best practices related to data management.
- Based on the West Coast preferred with flexibility for occasional in-office presence in San Francisco.
Benefits:
- 401(k).
- Dental Insurance.
- Health insurance.
- Vision insurance.
- We are an equal-opportunity employer and value diversity equality inclusion and respect for people.
- The salary will be determined based on several factors including but not limited to location relevant education qualifications experience technical skills and business needs.
Additional Responsibilities:
- Participate in OP monthly team meetings and participate in team-building efforts.
- Contribute to OP technical discussions peer reviews etc.
- Contribute content and collaborate via the OP-Wiki/Knowledge Base.
- Provide status reports to OP Account Management as requested.
About us:
OP is a technology consulting and solutions company offering advisory and managed services innovative platforms and staffing solutions across a wide range of fields - including AI cybersecurity enterprise architecture and beyond. Our most valuable asset is our people: dynamic creative thinkers who are passionate about doing quality work. As a member of the OP team you will have access to industry-leading consulting practices strategies & and technologies innovative training & education. An ideal OP team member is a technology leader with a proven track record of technical excellence and a strong focus on process and methodology.
An experienced Data Engineer is needed to support our infrastructure initiatives within the legal team. This role focuses on designing building and maintaining high-complexity data pipelines and alerting systems to ensure robust monitoring and operational efficiency. The ideal candidate will bring ...
An experienced Data Engineer is needed to support our infrastructure initiatives within the legal team. This role focuses on designing building and maintaining high-complexity data pipelines and alerting systems to ensure robust monitoring and operational efficiency. The ideal candidate will bring a strong technical background excellent collaboration skills and a keen eye for security and privacy considerations.
Responsibilities:
- Develop modify and optimize complex SQL and Python-based data pipelines using tools such as DataSwarm Airflow and similar frameworks.
- Lead end-to-end projects for building scalable data warehousing solutions and high-precision monitoring and alerting systems.
- Collaborate effectively with cross-functional teams to gather requirements troubleshoot issues and implement data solutions that align with organizational goals.
- Ensure data privacy security and compliance are integrated into all data engineering practices.
- Maintain documentation provide technical mentorship and continuously seek opportunities to improve data infrastructure reliability and performance.
Required Skills and Qualifications:
- Minimum 5 years of professional experience in data engineering with a focus on SQL and Python pipeline development.
- Proven experience working on complex data warehousing projects and building/leading the development of high-complexity monitoring and alerting systems.
- Strong communication skills with the ability to navigate ambiguity collaborate across teams and clearly articulate technical concepts.
- Demonstrated tenacity curiosity and problem-solving skills especially in fast-paced or evolving environments.
- Knowledge of privacy security and compliance best practices related to data management.
- Based on the West Coast preferred with flexibility for occasional in-office presence in San Francisco.
Benefits:
- 401(k).
- Dental Insurance.
- Health insurance.
- Vision insurance.
- We are an equal-opportunity employer and value diversity equality inclusion and respect for people.
- The salary will be determined based on several factors including but not limited to location relevant education qualifications experience technical skills and business needs.
Additional Responsibilities:
- Participate in OP monthly team meetings and participate in team-building efforts.
- Contribute to OP technical discussions peer reviews etc.
- Contribute content and collaborate via the OP-Wiki/Knowledge Base.
- Provide status reports to OP Account Management as requested.
About us:
OP is a technology consulting and solutions company offering advisory and managed services innovative platforms and staffing solutions across a wide range of fields - including AI cybersecurity enterprise architecture and beyond. Our most valuable asset is our people: dynamic creative thinkers who are passionate about doing quality work. As a member of the OP team you will have access to industry-leading consulting practices strategies & and technologies innovative training & education. An ideal OP team member is a technology leader with a proven track record of technical excellence and a strong focus on process and methodology.
View more
View less