Lead Data Engineer with AI

Job description :

• Data Lead with 10 13 years of experience required to work at the client location in Chicago.
• Strong expertise in AWS Databricks PySpark ETL/ELT and Delta Live Tables (DLT).
• Ability to understand business requirements and translate them into scalable technical solutions.
• Experience interacting directly with clients and leading solution discussions.
• Capability to propose scalable data architectures and build client confidence.
• Lead the design and development of Generative AI and Agentic AI solutions aligned with business objectives.
• Drive architecture discussions solution design and technical strategy with stakeholders and clients.
• Collaborate with cross-functional teams to deliver AI-driven products and platforms.
• Provide technical leadership mentoring and guidance to development teams.
• Ensure best practices in AI/ML architecture integration security and scalability.
• Design and implement scalable data engineering solutions on AWS and Databricks.
• Develop and optimize ETL/ELT pipelines using PySpark and Delta Live Tables (DLT).
• Lead architecture discussions and recommend best-fit data solutions.
• Collaborate with business stakeholders and clients to understand requirements and translate them into technical solutions.
• Drive technical conversations solution presentations and client communications.
• Mentor engineering teams and promote best practices in data engineering and cloud architecture.
• Ensure the performance scalability security and reliability of data platforms.
• Possess a strong understanding of modern data lakehouse architecture.
• Have experience in data modeling orchestration and pipeline optimization.
• Demonstrate strong communication and stakeholder management skills.
• Ability to lead client discussions and provide solution-oriented approaches.
• Experience working in Agile environments and leading teams.
• Strong experience with Generative AI Large Language Models (LLMs) AI Agents Agentic AI and orchestration frameworks.
• Understand client environments and identify business and technical pain points.
• Articulate client concerns and participate in solution discussions.
• Develop Proofs of Concept (POCs) to validate proposed solutions.
• Build client confidence through effective solution design and delivery.
• Experience with AWS-based Generative AI and Agentic AI technologies.