Sr Data Engineer
Sr Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
- Design develop and maintain CI/CD pipelines using GitHub Actions to automate deployment testing and monitoring of applications.
- Implement and manage serverless solutions (e.g. AWS Lambda EMR Serverless Kafka SNS SQS Athena etc. as part of the application architecture.
- Implement infrastructure as code (IaC) practices using tools like Terraform AWS CloudFormation or similar to manage cloud infrastructure.
- Work with development teams to set up automated testing frameworks ensuring high test coverage and code quality.
- Must understand the basics of relational data modeling and be able to clearly articulate the reasons to use nonrelational systems in our architecture. Experience in desired but relevant experience in any of the following is acceptable: Singlestore MySQL Redshift Athena MSSQL Server Oracle.
- Decent understanding for the digital media ad sales business and ad serving technologies with experience working with ad serving transactional data logs or Nielsen demographic data.
- Educate and inform business partners on architecture capabilities best practices and solutions to build out future enhancements
- Assist in analyzing business requirements source systems understand underlying data sources transformation requirements data mapping data model and metadata for reporting solutions
- Writing easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time.
Qualifications :
Basic Requirements:
- 5 Years Experience in Data Modeling Data architecture Data Quality Metadata ETL and Data Warehouse methodologies and technologies.
3 years experience in distributed computing solutions such as Spark MapReduce Snowflake Databricks or Kubernetes
3 years experience with AWS technologies with preference for Managed Airflow EMR Lambda ECS EKS
Experience in designing and managing CI/CD pipelines preferably using GitHub Actions.
Experience in any combination of the following: SQL Linux MicroStrategy Tableau Python APIs Spark Scala Pandas
Strong problemsolving skills.
Strong oral and written communication and influencing skills with the ability to communicate new concepts and drive change in processes and behaviors and to communicate complex technical topics to management and nontechnical audiences.
Strong knowledge of data security practices and privacy regulations (e.g. GDPR CCPA) with a proven ability to implement and maintain robust data protection measures
Bachelors degree in Engineering Computer Science Information Systems or related field with 5 years of relevant experience.
Desired Characteristics:
Proven ability to develop data applications using Spark Scala
Troubleshoot complex data pipelines including addressing scalerelated issues such as partitioning resolving data skews and optimizing performance by reviewing Spark UI.
Additionally the candidate should be able to consider data model design in scale and performance decisions before implementing solutions
Understanding of how to manage code in the Enterprise Git repository with appropriate branching and documentation skills
Ability to read external API documentation and write pipelines to extract data from our partners systems
Strong analytical focus resultsoriented and driven.
Ability and desire to work within a crossfunctional team environment with people from multiple business units vendors countries and cultures.
Flexibility to adjust to changing requirements schedules and priorities.
Ability to work independently under minimum supervision and proactive in solving issues
Energetic committed and solution focused with the ability to perform under pressure and meeting targets
Strong desire to share knowledge teach others and improve the overall skills of the team
Fully Remote: This position has been designated as fully remote meaning that the position is expected to contribute from a nonNBCUniversal worksite most commonly an employees residence.
This position is eligible for company sponsored benefits including medical dental and vision insurance 401(k) paid leave tuition reimbursement and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $115000 $145000
We are accepting applications for this position on an ongoing basis.
Additional Information :
As part of our selection process external candidates may be required to attend an inperson interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversals policy is to provide equal employment opportunities to all applicants and employees without regard to race color religion creed gender gender identity or expression age national origin or ancestry citizenship disability sexual orientation marital status pregnancy veteran status membership in the uniformed services genetic information or any other basis protected by applicable law.
If you are a qualified individual with a disability or a disabled veteran you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access as a result of your disability. You can request reasonable accommodations by emailing
For LA County and City Residents Only: NBCUniversal will consider for employment qualified applicants with criminal histories or arrest or conviction records in a manner consistent with relevant legal requirements including the City of Los Angeles Fair Chance Initiative For Hiring Ordinance the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act where applicable.
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
