Lead Data Engineer

About us:

As a Fortune 50 company with more than 400000 team members worldwide Target is an iconic brand and one of Americas leading retailers.

Joining Target means promoting a culture of mutual care and respect and striving to make the most meaningful and positive impact. Becoming a Target team member means joining a community that values different voices and lifts each other up. Here we believe your unique perspective is important and youll build relationships by being authentic and respectful.

Overview about TII:

At Target we have a timeless purpose and a proven strategy. And that hasnt happened by accident. Some of the best minds from different backgrounds come together at Target to redefine retail in an inclusive learning environment that values people and delivers world-class outcomes. That winning formula is especially apparent in Bengaluru where Target in India operates as a fully integrated part of Targets global team and has more than 4000 team members supporting the companys global strategy and operations.

Team Overview:

Every time a guest enters a Target store or browses nor the app they experience the impact of Targets investments in technology and innovation. Were the technologists behind one of the most loved retail brands delivering joy to millions of our guests team members and communities.

Join our global in-house technology team of more than 5000 of engineers data scientists architects and product managers striving to make Target the most convenient safe and joyful place to shop. We use agile practices and leverage open-source software to adapt and build best-in-class technology for our team members and guestsand we do so with a focus on diversity and inclusion experimentation and continuous learning.

Position Overview:

As aLead Data Engineer you will serve as thetechnical anchorfor the engineering team responsible for designing and developingscalable high-performance data solutions. You willown and drive data architecturethat supports both functional and non-functional business needs ensuringreliability efficiency and scalability.
Your expertise inbig data technologies distributed systems and cloud platformswill help shape the engineering roadmap and best practices fordata processing analytics and real-time data serving. You will play a key role inarchitecting and optimizing data pipelinesusingHadoop Spark Scala/Java and cloud technologiesto support enterprise-wide data initiatives.
Additionallyexperience with API development for serving low-latency dataandCustomer Data Platforms (CDP)will be a strong plus.

Key Responsibilities:

• Architect and buildscalable high-performance data pipelinesanddistributed data processing solutionsusingHadoop Spark Scala/Java and cloud platforms (AWS/GCP/Azure).

• Design and implementreal-time and batch data processing solutions ensuring data is efficiently processed and made available for analytical and operational use.

• Develop APIs and data servicesto exposelow-latency high-throughputdata for downstream applications enabling real-time decision-making.

• Optimize and enhancedata models workflows and processing frameworksto improve performance scalability and cost-efficiency.

• Drivedata governance security and compliancebest practices.

• Collaborate withdata scientists product teams and business stakeholdersto understand requirements and deliverdata-driven solutions.

• Lead thedesign implementation and lifecycle managementof data services and solutions.

• Stay up to date withemerging technologiesand drive adoption of best practices inbig data engineering cloud computing and API development.

• Providetechnical leadership and mentorshipto engineering teams promoting best practices indata engineering and API design.

About You:

• 7 years of experience in data engineering software development or distributed systems.

• Expertise in big data technologiessuch asHadoop Spark and distributed processing frameworks.

• Strong programming skills in Scala and/or Java(Python is a plus).

• Experience with cloud platforms (AWS GCP or Azure)and theirdata ecosystem(e.g. S3 BigQuery Databricks EMR Snowflake etc.).

• Proficiency in API developmentusingREST GraphQL or gRPCto serve real-time and batch data.

• Experience with real-time and streaming data architectures(Kafka Flink Kinesis etc.).

• Strong knowledge ofdata modeling ETL pipeline design and performance optimization.

• Understanding ofdata governance security and compliancein large-scale data environments.

• Experience with Customer Data Platforms (CDP) or customer-centric data processingis a strong plus.

• Strong problem-solving skills and ability to work incomplex unstructured environments.

• Excellent communication and collaboration skills with experience working incross-functional teams.

Why Join Us

• Work with cutting-edgebig data API and cloud technologiesin a fast-paced collaborative environment.

• Influence and shape thefuture of data architecture and real-time data servicesat Target.

• Solvehigh-impact business problemsusingscalable low-latency data solutions.

• Be part of a culture that valuesinnovation learning and growth.

Life at Target-