Senior Lead Data Engineer - R
Share
Job Location:
San Ramon, CA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital renowned for its world-class professionals referred to as Brillians distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.
Brillio takes pride in its status as an employer of choice consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary groundbreaking technologies and exclusive digital projects. Brillios relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work certification year after year.
Senior Lead Data Engineer
Primary Skills
- CI/CD Pipeline React (React Context / Redux) Django / Flask / FastAPI Docker CSS/SCSS/LESS PyTest PostgreSQL / MongoDB / Redis Kubernetes REST API / GraphQL
Specialization
- Python Fullstack with Microservices: Software Development Lead
Job requirements
- Location: Santa Ana California
- Onsite: 5 days
- We are seeking a skilled Python Developer to support the migration of existing applications and scripts from an external vendors environment into our internal platform. The ideal candidate will have strong Python development experience a solid understanding of software architecture and the ability to refactor enhance and optimize code for long-term maintainability.
- Analyze existing vendor-provided Python codebases and related assets.
- Migrate refactor and integrate code into the internal platform while ensuring compatibility and performance.
- Enhance and extend existing code functionality based on evolving business user requirements.
- Re-architect components as needed to align with internal coding standards best practices and infrastructure.
- Develop automated tests to validate migrated and enhanced code functionality.
- Collaborate with platform engineers business analysts and stakeholders to capture requirements and deliver solutions.
- Document migration processes enhancements system changes and updated workflows.
- Troubleshoot debug and resolve issues during migration enhancement and post-deployment.
- Identify opportunities for automation performance improvements and process efficiency.
- Strong proficiency in Python (3.x) and related frameworks/libraries.
- Strong proficiency in pandas nympy sqlalchemy tenacity polars dask pyspark etc.
- Strong knowledge of data engineering ETL processes or microservices.
- Strong knowledge of APIs databases (SQL/NoSQL) and data pipelines.
- Experience with code migration integration or re-platforming projects.
- Proven ability to enhance and extend existing code to meet business requirements.
- Familiarity with software design patterns modularization and refactoring best practices.
- Experience with version control (Git) CI/CD pipelines and testing frameworks (pytest/unittest).
- Strong debugging problem-solving and analytical skills.
- Excellent communication and documentation abilities.
- Preferred Skills
- Experience with cloud platforms (AWS Azure or GCP).
- Familiarity with containerization (Docker Kubernetes).
- Prior experience collaborating with external vendors or in a migration/enhancement-focused role.
Overview
Responsibilities
Qualifications
Know what its like to work and grow at Brillio: Click here
Required Experience:
Senior IC
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
About Company
Brillio is a global leader in Enterprise Digital Transformation Solutions, providing strategic consulting services and solutions using emerging technologies.
