Principal Data Engineer (Cortex)
Job Summary
Our Mission
At Palo Alto Networks were united by a shared missionto protect our digital way of life. We thrive at the intersection of innovation and impact solving real-world problems with cutting-edge technology and bold thinking. Here everyone has a voice and every idea counts. If youre ready to do the most meaningful work of your career alongside people who are just as passionate as you are youre in the right place.
Who We Are
In order to be the cybersecurity partner of choice we must trailblaze the path and shape the future of our industry. This is something our employees work at each day and is defined by our values: Disruption Collaboration Execution Integrity and Inclusion. We weave AI into the fabric of everything we do and use it to augment the impact every individual can have. If you are passionate about solving real-world problems and ideating beside the best and the brightest we invite you to join us!
We believe collaboration thrives in person. Thats why most of our teams work from the office full time with flexibility when its needed. This model supports real-time problem-solving stronger relationships and the kind of precision that drives great outcomes.Job Summary
As a Principal Data Engineer you will be integral to the security research group designing building and maintaining the data pipelines and data frameworks that are the backbone of our cyber attack detection capabilities. You will work closely with top security and AI researchers enabling their work and seeing the direct impact of your contributions on our services and the day-to-day effectiveness of the research team.
Key Responsibilities
Lead the design and implementation of end-to-end complex data pipelines and data platforms in cloud environment.
Collect analyze and translate complex data requirements from various stakeholders including data analysts developers and Cyber security researchers.
Develop robust scalable Cloud based data solutions using Python and distributed processing frameworks such as Apache Beam (Dataflow) GKE Spark etc.
Utilize AI as part of the development cycle including generating reviewing and testing code via prompts.
Model and manage data within cloud MPP databases and data lakes such as BigQuery Redshift or Snowflake.
Qualifications
Required Qualifications
4 years experience as a Senior Data Engineer / Data engineer lead (Hands-On) / Data architect - working with Cloud environments
Experience in leading and implementing end to end complex Data pipelines and data platforms
Experience with collecting analyzing and syncing complex data requirements from various data users such as: Data Analysts Developers Researchers and Managers
4 years Experience with Data Modeling using various Data platforms and databases
4 years Python experience - focused on Data related areas and distributed processing (Experience with at least one of the following:
Spark GCP DataFlow (Apache Beam) GKE etc)Experience with Docker & Kubernetes / GKE
4 Years experience with Cloud MPP Databases / Data Lakes such as: BigQuery Redshift Snowflake Azure SQL DWH Azure Kusto
Fluent with SQL
AI:
Using AI as part of the development cycle is second nature for you.
Experience generating code via Prompts and closing the loop by reviewing and testing
Experience writing MCPs Skills and mds
Soft skills:
Collaborative Mindset: A team-first leader who believes that the best data products are built through collective genius and open communication.
Bridge Builder: Naturally connects the dots between diverse teamsfrom DevOps to Data Scienceto break down silos and streamline data delivery.
Growth-Minded: Approaches feedback as a tool for evolution; possesses the grit to pivot and find the silver lining in complex technical setbacks.
Execution Passionate: Genuinely loves the how as much as the what finding joy in the pursuit of clean code and the deployment of mission-critical pipelines.
Preferred Qualifications
GCP experience
Data science background
Cyber security knowledge
Our Commitment
Were trailblazers that dream big take risks and challenge cybersecuritys status quo. Its simple: we cant accomplish our mission without diverse teams innovating together.
We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need please contact us at .
Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace and all qualified applicants will receive consideration for employment without regard to age ancestry color family or medical care leave gender identity or expression genetic information marital status medical condition national origin physical or mental disability political affiliation protected veteran status race religion sex (including pregnancy) sexual orientation or other legally protected characteristics.
All your information will be kept confidential according to EEO guidelines.
Is role eligible for Immigration Sponsorship No. Please note that we will not sponsor applicants for work visas for this position.Required Experience:
Staff IC
About Company
Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information ... View more