Data Engineer (Scala, Spark) - R
Data Engineer (Scala, Spark) - R
Posted on :
21-05-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital renowned for its worldclass professionals referred to as Brillians distinguishes itself through their capacity to seamlessly integrate cuttingedge digital and design thinking skills with an unwavering dedication to client satisfaction.
Brillio takes pride in its status as an employer of choice consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary groundbreaking technologies and exclusive digital projects. Brillios relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work certification year after year.
Consultant
Primary Skills
- MapReduce HDFS Nifi Spark Pyspark ETL Fundamentals SOLR Model Provisioning: Kubernetes Kibana SQL ELK LogStash SQL (Basic Advanced) Spark Scala Python AWS Elastic Cache Spark Java Data Warehousing Kafka Hive Flume Storm Flink Modern Data Platform Fundamentals Data Modelling Fundamentals Confluent Kafka PLSQL TSQL Stored Procedures Oozie
Specialization
- Big Data Architecture: Senior Lead Data Engineer
Job requirements
- Join us as we build a nextgeneration Enterprise Analytics Platform to reengineer a real estate enterprise. As a Senior Platform Engineer you will be joining our Enterprise Analytics Platform Team to build EAP platform from ground up to serve agents brokers home buyers and sellers.
- Your Experience
- 5 years of experience in large scale realtime stream processing using Apache Spark with messaging infrastructure like Kafka/Pulsar.
- 7 years of experience on Data Pipeline development ETL and processing of structured and unstructured data.
- 5 years of experience using NoSQL systems like MongoDB DynamoDB and SnowFlake /Athena.
- Experience with technologies like EMR S3 Lambda AWS Fargate CloudWatch DataDog.
- Experience owning and implementing technical/data solutions or pipelines.
- Excellent written and verbal communication skills in English.
- Strong work ethic and entrepreneurial spirit.
- Additional Information Main skills set that are a must are:1. Spark with Scala or Python
- 2. Apache Kafka
- and NoSQL DB experience like MongoDB
- 4. Experience in AWS cloud services.
- 5. Solid understanding of Medallion architecture Parquet/ Iceberg
- Behavioral Competences
- Excellent communication ability to communicate on different levels of seniority.
- Team player; enjoying being part of a crossfunctional setup.
- Ability to perform well on timecritical endeavors and on multiple fronts at the time.
- Strong dedication to quality and a client mindset.
- A passion for learning and continuous improvement.
- Know more about:
- DAI: what its like to work and grow at Brillio: Employment Opportunity Declaration
- Brillio is an equal opportunity employer to all regardless of age ancestry colour disability (mental and physical) exercising the right to family care and medical leave gender gender expression gender identity genetic information marital status medical condition military or veteran status national origin political affiliation race religious creed sex (includes pregnancy childbirth breastfeeding and related medical conditions) and sexual orientation.
$65 $70 an hour
Know what its like to work and grow at Brillio: Click here
Employment Type
Gig
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
