Principal, Data Engineering
Atlanta, GA - USA
Job Summary
Cargill is committed to providing food and agricultural solutions to nourish the world in a safe responsible and sustainable way. Sitting at the heart of the supply chain we partner with farmers and customers to source make and deliver products that are vital for living.
Our 155000 team members innovate with purpose providing customers with lifes essentials so businesses can grow communities prosper and consumers live well. With over 160 years of experience as a family company we look ahead while remaining true to our values. We put people first. We reach higher. We do the right thingtoday and for generations to come.
Job Summary
The Principal Data Engineering job provides thought leadership in the execution of strategic plans related to design development and maintenance of robust data systems. As a recognized subject matter expert in the field this jobleadsthe development of efficient processing and availability of data for analysis and reporting.
Essential Functions
- DATA PIPELINES: Provides thought leadership on the design and development of data pipelines thatfacilitatethe movement of data from various sources to internal databases.
- DATA INFRASTRUCTURE: Influences the construction and optimization of data infrastructure providingappropriate dataformats to ensure data readiness for analysis.
- DATA FORMATS: Examines and sees improvement opportunities forappropriate dataformats tooptimizedata usability and accessibility across the organization.
- STAKEHOLDER MANAGEMENT: Cultivates positive relationships and partners to understand data needs and encourage alignment with organizationalobjectives.
- DATA SYSTEMS: Develops and guides the implementation of data products and solutions using advanced engineering and cloud-based technologies ensuring they are designed and built to be scalable sustainable and robust.
- SOLUTIONS DEVELOPMENT: Leads efforts to improve the development of technical products and solutions driving big data and cloud-based technologies ensuring they are designed and built to be scalable sustainable and robust.
- DATA FRAMEWORKS: Drives development standards and brings forward prototypes to test new data framework concepts and architecture patterns supporting efficient data processing and analysis and promoting standard methodologies in data management.
- AUTOMATED REPORTING SYSTEMS: Builds automated reporting systems thatprovidetimelyinsights andfacilitatedata driven decision making.
- DATA MODELING: Provides thought leadership on data modeling and preparation of data in databases for use in various analytics tools and to develop data pipelines to move and improve data assets.
Qualifications
- Minimumrequirementof6 years of relevant work experience. Typically reflects 10 years ormore ofrelevant experience.
Preferred Qualifications:
- ARCHITECTURAL LEADERSHIP: Defines long-term technical directionestablishesbest practices and ensures solutions are scalable maintainable and aligned with enterprise strategy.
- OPERATIONAL EXCELLENCE MINDSET:Championsreliability observability and performance ensuring data systems meethigh standardsfor availability and quality.
- STRATEGIC DECISION MAKING:Evaluates competing priorities such as speed cost risk and flexibility to make sound technical and architectural decisions.
- CLOUD DATA PLATFORMS:deepexpertiseimplementing cloud-based data warehouses data lakes and open table formats in large-scale production environments. Has hands-on experiencewith technologies such as Snowflake AWS and openlake houseecosystems.
- DATA INGESTION:Demonstratedproficiencyin data collection ingestion tools (Kafka AWS Glue) and storage formats (Iceberg Parquet)
- DATA STREAMING: Experience developing data pipelines with streaming architectures and tools (Kafka Flink).
- DATA TRANSFORMATION: Strongbackground withusing Spark for data transformation including streaming performance tuning and debugging with Spark UI.
- DEVOPS: Extensive experience in DevOps practices including code management CI/CD and deployment strategies.
This role is located in our Atlanta GA office. The business will not sponsor applicants for work visas for this position.
#LINS7
Equal Opportunity Employer including Disability/Vet.
Required Experience:
IC
About Company
Cargill, Incorporated is an American privately held global corporation based in Minnetonka, Minnesota, and incorporated in Wilmington, Delaware. Founded in 1865, it is the largest privately held corporation in the United States in terms of revenue.