Principal/Lead Data Engineer - Azure Databricks

Peraton is seeking an experienced Principal/Lead Data Engineer Azure Databricksto become part of Peratons Department of State (DoS) Diplomatic Security Cyber Mission (DSCM) program providing leading cyber and technology security experience to enable innovative effective and secure business processes.

Location: Rosslyn VA or Beltsville MD

As a Principal/Lead Data Engineer Azure Databrickson the DSCM team you will play a pivotal role in consolidating and integrating existing data warehouses data marts and applications into an Integrated Enterprise Data Warehouse.

In this role you will:

• Perform detailed analyses of data and data source characteristics relationships and logic necessary for the effective implementation of information systems.
• Identify and document problems traced to both original data quality issues and system outputs and recommend solutions.
• Combine domain knowledge and knowledge of system performance requirements in supporting system development and performance testing processes.
• Provide recommendations for normalization to enable data visualizations and advanced analyticsAI
• Manage complex projects and schedules with multiple objectives and priorities
• Work collaboratively with a broad range of stakeholders across organizational boundaries to accomplish mission goals
• Work under tight deadlines within a fastpaced environment
• Demonstrated expertise in integrating new technologies and data analytics techniques to enhance cybersecurity infrastructure.
• Strong leadership and mentoring skills with a track record of guiding data engineering teams to successful project outcomes and professional growth.

#DSCM

MinimumRequirements:

• Bachelors degree and a minimum of 9 years of relevant experience a minimum of 7 years with Masters; minimum of 4 years with PhD.
  • An additional 4 years of experience may be substituted in lieu of the degree requirement.
• Possess at least ONE of the following certifications:
  • CCNASecurity CND CySA GICSP GSEC Security CE or SSCP
• Demonstrated hands on experience with Azure Databricks both batch and streaming experience
• Strong experience with building Data pipeline (ETL) and medallion architecture and developing pipelines for Petabytes of security logs.
• Ability to create and maintain rich interactive visualizations through data interpretation and analysis with reporting components from multiple data sources.
• Understanding of data models & Common Information Model (CIM) and manage structured and unstructured datasets and managing insights through Data Cataloging tool set such as MSPurview/Alation.
• Engineering & Programming experience with building data lakes frameworks including Sirens/CSMA (Cyber Security Mesh Architecture).
• Programming experience with frameworks including Python C# SQL Scala.

Azure Cloud Management:

• Manage optimize and scale Azure cloud environments ensuring efficient deployment management and high availability of cloud resources.

Engineering & Advanced Analytics Management:

• Apply data engineering principles to manage Big data security analytics environment.
• Developing pipelines in Data transformation/ orchestration.
• Extending high data quality to advanced analytics pipelines.

• U.S. citizenship required.
• An active Secret Security security clearance.
  • The ability to obtain a final Top Secret security clearance.

Desired:

• Azure Fundamentals (AZ900).
• Security certification.
• Project Management certification/Safe Agile trained.
• Team Leadership experience managing team of engineers.
• Microsoft Azure AI Fundamentals (AI900).

Peraton is a nextgeneration national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the worlds leading mission capability integrator and transformative enterprise IT provider we deliver trusted highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land sea space air and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day our employees do the cant be done by solving the most daunting challenges facing our customers. Visit to learn how were keeping people around the world safe and secure.