Data Operations Engineer II

Want to be part of a team that builds monitors and maintains the data ingestion systems behind the worlds most accurate weather source running reliably around the clock We are looking for a Data Operations Engineer II who displays a deep interest in and passion for scripting automation and operational reliability; an experienced and detail-oriented individual who likes to diagnose systems and help identify areas of improvement. Reporting directly to the Manager Data Operations this position will be responsible for building monitoring and independently maintaining the data ingestion processes and systems that move store and transform data across platforms including administering Databricks our Data Marketplace and Ad Platform and the core weather locations and provider data that power AccuWeathers products. You will develop maintain and optimize complex scripts to automate data collection and monitoring build end-to-end monitoring systems and automated alert mechanisms to ensure pipeline health and troubleshoot issues to ensure continuous operation and data integrity.

You will demonstrate skill across multiple platforms solve technical problems independently and collaborate with peers and stakeholders in an Agile-based environment to deliver reliable data operations that cater to a global audience.

We are open to hiring candidates to work from our global headquarters in State College PA USA or remotely.

KEY RESPONSIBILITIES

Build monitor and maintain data ingestion processes and systems that move store and transform data across platforms administering Databricks and our Data Marketplace and Ad Platform.

Develop maintain and optimize complex scripts using Python PowerShell or similar languages to automate data collection and monitoring.

Own the operational state of a defined set of data pipelines monitoring incident response maintenance procedures and escalation for systems in your scope.

Own SQL database maintenance (Forecast current historical locations) for data loading and deployment.

Develop and maintain unit test coverage for Data Ops code bases ensuring scripts and pipelines behave as expected before deployment.

Administer GoAnywhere and other managed file transfer platforms.

Build and manage end-to-end monitoring systems and automated alert mechanisms to optimize the health and performance of data pipelines ensuring alerts are appropriately calibrated to trigger the right notifications.

Own incident diagnosis and resolution within established parameters investigating alerts identifying root causes implementing fixes validating recovery and documenting resolutions.

Build and maintain CI/CD pipelines (GitHub Actions Azure DevOps) to support reliable repeatable deployments

Own proactive operational maintenance executing scheduled maintenance applying patches and updates and performing checks that prevent incidents before they occur.

Create and maintain comprehensive documentation of scripts automation and monitoring workflows data pipelines and deployment procedures.

Contribute to and improve runbooks based on incidents youve worked through that werent adequately covered before.

Collaborate closely with cross-functional teams providing support for scripting needs and contributing to automation strategy.

Independently plan and prioritize work to meet deadlines.

Begin sharing knowledge with peers; engage in informal coaching moments.

Performs other duties as assigned.

QUALIFICATIONS

Required Qualifications:

o BA/BS in Computer Science Information Technology or a related field with 3 years of experience in data operations scripting and automation.

o Intermediate proficiency in scripting languages such as Python PowerShell Bash or similar.

o Fully competent in Azure Databricks Snowflake and SQL Server.

o Experience managing relational databases such as SQL.

Preferred Qualifications:

o Proficiency in Object-Oriented Programming (OOP) languages such as C Java or similar.

o Experience with DataDog or similar tools for monitoring and performance tracking.

o Experience with deployment automation (CI/CD) tools and processes.

o Administration experience with managed file transfer tools (e.g. GoAnywhere)

o Experience working with cloud platforms (e.g. AWS Azure GCP).

o Familiarity with version control systems (e.g. Git).

Skills & Competencies:

o Exceptional analytical and problem-solving skills with meticulous attention to detail.

o Demonstrated ability to debug systems tracing issues back to their source.

o Excellent communication skills with the ability to collaborate effectively within a team environment.

o Ability to adapt to changing priorities and manage multiple tasks simultaneously.

o Provides clear incident updates on a defined cadence during active incidents.

ABOUT ACCUWEATHER

AccuWeather recognized and documented as the most accurate and most used source of weather forecasts and warnings in the world has saved over 12000 lives prevented injury to over 100000 people and saved companies tens of billions of dollars through better planning and decision-making.

Billions of people around the world rely on AccuWeathers proven Superior Accuracy across our consumer digital platforms. is the #1 weather destination and one of the top 100 most-visited websites in the world and our award-winning AccuWeather app delivers detailed real-time forecasts to millions of smartphones.

AccuWeather forecasts also appear on digital signage in 700 newspapers are heard on over 400 radio stations and viewed on 100 television stations. The AccuWeather Network and AccuWeather NOW reach an audience of over 125 million on cable and streaming platforms including DirecTV Charter Communications - Spectrum Verizon Philo Frndly TV Comcasts Xfinity X1 and Xfinity Stream Roku Xumo Rockbot LG and Amazon Freevee.

AccuWeather For Business serves more than half of the Fortune 500 companies and thousands of other businesses and government agencies globally.

Dr. Joel Myers Founder and Executive Chairman established AccuWeather in 1962 and is considered the father of modern commercial meteorology. Myers a leading creative thinker and visionary has been called the most accurate man in weather by The New York Times and has been recognized as one of the top entrepreneurs in American history by Entrepreneurs Encyclopedia of Entrepreneurs.

COMMITMENT TO DIVERSITY & INCLUSION

AccuWeather is proud to be an Equal Opportunity/Affirmative Action Employer. We are committed to equal employment opportunity to all applicants and existing employees and we evaluate qualified applicants without regard to race creed color national origin sex (including pregnancy and gender identity/expression) sexual orientation age ancestry physical or mental disability marital status political affiliation religion citizenship status genetic information veteran status or any other basis protected under applicable federal state or local law. AccuWeather is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process please send an e-mail to and let us know the nature of your request and your contact information.