Data Engineer II

Not Interested
Bookmark
Report This Job

profile Job Location:

State College, PA - USA

profile Monthly Salary: Not Disclosed
Posted on: 30+ days ago
Vacancies: 1 Vacancy

Job Summary

In this role as a Data Engineer II you will directly impact AccuWeathers continued focus on innovation and generating superior weather products. You will play a critical role in building and maintaining our data infrastructure enabling efficient data processing analysis and reporting. You will work closely with cross-functional teams including data scientists analysts and software engineers to ensure our data pipelines and platforms availability reliability and performance. Your expertise in Databricks will be essential in optimizing data workflows ensuring data quality and contributing to the continuous improvement of our data engineering practices.

We are open to hiring candidates to work from our global headquarters in State College PA USA or remotely.

KEY RESPONSIBILITIES

  1. Develop Data Pipelines: Design develop and maintain scalable and moderately complex data pipelines using Databricks Spark and related technologies.
  2. Data Processing Optimization: Optimize data workflows to build performant reliable and efficient data solutions.
  3. Collaboration Excellence: Contribute positively to a highly collaborative work environment by working closely with cross-functional teams including data scientists analysts and software this role youll be responsible for understanding requirements and implementing robust solutions that meet their needs. Additionally youll collaborate with other data engineers to ensure the smooth deployment and operation of data solutions.
  4. Monitoring and Troubleshooting: Monitor troubleshoot and resolve issues related to data pipelines and platform performance.
  5. Implement Best Practices: Implement best practices for data modeling ETL processes and data ingestion and enhance data engineering practices. Stay current with industry trends and advancements in data engineering Databricks and related technologies.
  6. Documentation: Create and maintain detailed documentation of data solutions for knowledge sharing and future reference.

QUALIFICATIONS

  • Bachelors degree in Computer Science Engineering or a related field.
  • 2-4 years of experience as a Data Engineer with a strong focus on Databricks Spark and cloud-based data platforms (e.g. AWS Azure Google Cloud).
  • Expertise in designing developing and optimizing complex ETL processes and data pipelines.
  • Proficiency in programming languages like Python Scala or Java.
  • Solid understanding of data modeling data warehousing and data integration concepts.
  • Familiarity with DevOps practices and tools for CI/CD and infrastructure automation.
  • Strong problem-solving skills and ability to troubleshoot and resolve complex technical issues.
  • Excellent communication and teamwork skills with the ability to collaborate effectively with cross-functional teams.
  • Experience with big data technologies real-time data processing and machine learning pipelines is a plus.
  • Familiarity with weather data is a plus
  • Relevant certifications in Databricks Spark or cloud platforms are a strong advantage.

ABOUT ACCUWEATHER

AccuWeather recognized and documented as the most accurate and most used source of weather forecasts and warnings in the worldhas saved over 12000 lives prevented injury to over 100000 people and saved companies tens of billions of dollars through better planning and decision-making.

Billions of people around the world rely on AccuWeathers proven Superior Accuracy across our consumer digital platforms. is the #1 weather destination and one of the top 100 most-visited websites in the world and our award-winning AccuWeather app delivers detailed real-time forecasts to millions of smartphones.

AccuWeather forecasts also appear on digital signage in 700 newspapers are heard on over 400 radio stations and viewed on 100 television stations. The AccuWeather Network and AccuWeather NOW reach an audience of over 125 million on cable and streaming platforms including DirecTV Charter Communications - Spectrum Verizon Philo Frndly TV Comcasts Xfinity X1 and Xfinity Stream Roku Xumo Rockbot LG and Amazon Freevee.

AccuWeather For Business serves more than half of the Fortune 500 companies and thousands of other businesses and government agencies globally.

Dr. Joel Myers Founder and Executive Chairman established AccuWeather in 1962 and is considered the father of modern commercial meteorology. Myers a leading creative thinker and visionary has been called the most accurate man in weather by The New York Times and has been recognized as one of the top entrepreneurs in American history by Entrepreneurs Encyclopedia of Entrepreneurs.

COMMITMENT TO DIVERSITY & INCLUSION

AccuWeather is proud to be an Equal Opportunity/Affirmative Action Employer. We are committed to equal employment opportunity to all applicants and existing employees and we evaluate qualified applicants without regard to race creed color national origin sex (including pregnancy and gender identity/expression) sexual orientation age ancestry physical or mental disability marital status political affiliation religion citizenship status genetic information veteran status or any other basis protected under applicable federal state or local law.

AccuWeather is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process please send an e-mail toand let us know the nature of your request and your contact information.

In this role as a Data Engineer II you will directly impact AccuWeathers continued focus on innovation and generating superior weather products. You will play a critical role in building and maintaining our data infrastructure enabling efficient data processing analysis and reporting. You will work ...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Company Logo

AccuWeather has local and international weather forecasts from the most accurate weather forecasting technology featuring up to the minute weather reports

View Profile View Profile