Lead Data Engineer - R
Lead Data Engineer - R
Posted on :
20-04-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital renowned for its worldclass professionals referred to as Brillians distinguishes itself through their capacity to seamlessly integrate cuttingedge digital and design thinking skills with an unwavering dedication to client satisfaction.
Brillio takes pride in its status as an employer of choice consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary groundbreaking technologies and exclusive digital projects. Brillios relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work certification year after year.
Lead Data Engineer
Primary Skills
- Athena Step Functions Spark Pyspark ETL Fundamentals SQL (Basic Advanced) Glue Python Lambda Data Warehousing EBS /EFS AWS EC2 Lake Formation Aurora S3 Modern Data Platform Fundamentals PLSQL Data Modelling Fundamentals Cloud front
Job requirements
- Youll work with other Data Engineers for the buildout of the Next Generation Data Platform.
- Youll collaborate with various teams to provide guidance on best practices for utilizing the Cloud Data Platform.
- Youll be working on latest Cloud Data Warehouse Platform (Snowflake) and developing Data Marts using Python and SQL.
- Youll work with the team to design and develop a Data Catalog Service using Snowflake Horizon and Polaris.
- Youll work with the team to design and develop Data Observability using DataDog and Data Recon to detect data anomalies.
- You will design and develop a CI/CD process for continuous delivery in AWS Cloud and Snowflake.
- Youll design develop and test robust scalable data platform components
- The ideal candidate will possess extensive experience in building data platform at enterprise scale. You will possess strong analytical skills attention to detail and the ability to thrive in a fastpaced environment. Excellent communication and collaboration skills are essential to communicate with technical & nontechnical partners. The candidate must demonstrate a proactive and resultsdriven approach to problemsolving with a focus on driving continuous improvement and innovation in data quality and operational processes.
- If you are eager to shape the next generation of data foundations in the real estate industry and make an impact join us in an extraordinary worldclass data and analytics organization and become part of the digital transformation is leading.
- Bachelors in computer science Engineering or related technical discipline or equivalent combination of training and experience
- 5 years programming experience: building application frameworks and backend systems for highvolume pipelines using Python.
- Strong knowledge of SQL for querying data manipulation and data transformation
- Understanding of dimensional modeling star schemas and data partitioning techniques
- 2 years experience with the Cloud Data warehousing services including storage options compute capabilities and data management tools
- 3 years experience using Orchestration tools like Airflow or dbt
- 2 years experience using AWS Data Services: S3 Cloudformation EMR
- 2 years experience building Data Observability tools like DataDog or any other tool .
- 3 year exp. with data architecture ETL and processing of structured and unstructured data
- 3 years experience with DevOps tools (any combination of GitHub TravisCI or Jira) and methodologies (Lean Agile Scrum Test Driven Development)
- Excellent communication ability to communicate on different levels of seniority.
- Team player; enjoying being part of a crossfunctional setup.
- Ability to perform well on timecritical endeavors and on multiple fronts at the time.
- Strong dedication to quality and a client mindset.
- A passion for learning and continuous improvement.
Job Description: Below
About the Role
Were seeking a talented creative and motivated Senior Data Engineer who loves to build data platform tools and is ready to work with a team of individuals who share your passion. With a related degree under your beltand relevant experienceyoure ready to take your programming and data knowledge to the next level. You enjoy building tools such as Data Ingestion Service to ingest data from diverse sources to Data Platform building tools for monitoring & observability. With your unwavering commitment to quality excellent data/cloud skills and collaborative work ethic youll do great things.
What youll do:
About you
Your Experience
Behavioral Competences
Know more about:
Brillio is an equal opportunity employer to all regardless of age ancestry colour disability (mental and physical) exercising the right to family care and medical leave gender gender expression gender identity genetic information marital status medical condition military or veteran status national origin political affiliation race religious creed sex (includes pregnancy childbirth breastfeeding and related medical conditions) and sexual orientation.
#LISR1
$60 $65 an hour
Know what its like to work and grow at Brillio: Click here
Employment Type
Gig
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
