Senior Data Engineer (AdTech)
Senior Data Engineer (AdTech)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Build and modify Spark jobs (in Scala) to perform various tasks from reading Kinesis streams using Spark Streaming to joining and aggregating huge data sets to integrating with third party data sources
- Develop and launch new features to adapt to evolving business needs
- Be an active and engaged owner of our data infrastructure
- Be curious and seek to understand all aspects of our business
- Maintain high standards of code quality and encourage the same by providing constructive code reviews to collaborators
- Troubleshoot and resolve issues problems and errors encountered across various
- systems
- Collaborate with Data Science Product Research and Engineering teams to iterate on the roadmap
- Gather requirements when underspecified
Qualifications :
- 5 years of experience in data engineering or related field
- BS in Computer Science or related field required
- Strong knowledge of SQL required
- Strong knowledge with Spark (using Scala)
- Working knowledge of serialization formats and their tradeoffs (columnar vs rowbased)
- Experience debugging and optimizing Spark jobs
- Familiarity with database fundamentals such as ACID snowflake schema normalized/denormalized data
- Must be a strong written and verbal communicator
WOULD BE A PLUS
- Familiarity with columnar database keyvalue stores document stores stream processing time series databases data warehouses and OLAP
- Experience working with HDFS S3 GCP and BigQuery
- Familiarity with Data Science tooling in Spark
- Experience in the advertising industry is a plus
- Experience with realtime analytics
Additional Information :
PERSONAL PROFILE
- Strong written and verbal communication skills
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
