Data Engineer

Schwarz Partnershas an exciting opportunity available for aData Engineerin Carmel IN! Data Engineers build data pipelines that transform raw unstructured data into formats that can be used for analysis. They are responsible for creating and maintaining the analytics infrastructure that enables almost every other data function. This includes architectures such as databases servers and large-scale processing systems. A Data Engineer uses different technologies to collect and map an organizations data landscape to help decision-makers find cost savings and optimization addition data Engineers use this data to display trends in collected analytics information encouraging transparency with Partnersis one of the largest independent manufacturers of corrugated sheets and packaging materials in the U.S. Through our family of companies we continuously build and strengthen our capabilities. Youll find our products wherever goods are packaged shipped and soldfrom innovative retail packaging to colorful in-store displays at pharmacies and grocers. You also may have spotted our trucks on the highway. Schwarz Partners is built around the idea that independence and innovation go hand in hand. Our structure allows us to adapt to change quickly get new ideas off the ground and thrive in the marketplace. Our people are empowered to tap into their talents build their skills and grow with JOB FUNCTIONS FOR THIS POSITION:Build and maintain the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using SQL and cloud large complex sets of data that meet non-functional and functional business design and implement internal data-related process with stakeholders including data design product and executive teams and assisting them with data-related technical configuration & design of application to better leverage the data for prescriptive and predictive effective communication to work with application in the creation and quality assurance review of design documents and test results to ensure all project requirements are satisfied. Ability to advise and implement on improvements to data warehousing and data workflow outside the box and come up with improvement and efficiency opportunities to streamline business and operational high-level business workflows and transform into low-level technical to analyze complex information sets and communicate that information in a clear well thought out and well laid out manner. Ability to communicate at varying levels of detail (30000 ft. view 10000 ft. view granular level) and to produce corresponding documentation at varying levels of abstraction. Be an advocate for best practices and continued to communicate with business stakeholders on status of projects/ to prioritize and multi-task between duties at any given communication and interpersonal with company policies and procedures and all applicable laws and regulations. General DBA work as and troubleshoot existing ETL and maintain BI duties as EDUCATION / EXPERIENCE:Bachelors degree in Computer Science or 4 years experience in related EDUCATION / EXPERIENCE:Experience developing data to perform prescriptive and predictive SKILLS:Demonstrated experience with SQL in a large database experience utilizing SQL to develop queries or profile in quantitative and qualitative analysis of level skills in Systems level skills in Systems to function as a MICROSOFT FABRIC SKILLS: Strong grasp of OneLake concepts: lakehouses vs. warehouses shortcuts mirroring item/workspace -on with Delta Lake (Parquet Delta tables partitioning V-ordering Z-ordering Vacuum retention).Understanding of Direct Lake Import and DirectQuery trade-offs and when to use designing star schemas and modern medallion architectures (bronze/silver/gold).Spark/PySpark notebooks (jobs clusters caching optimization broadcast joins).Data Factory in Fabric (Pipelines): activities triggers parameterization error handling/ Gen2 (Power Query/M) for ELT incremental refresh and reusable semantic models; DAX (measures calculation groups aggregations).Ability to multi-task think on his/her feet and react apply attention to detail and follow-up and work effectively and collegially with management staff and end users.