Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
About us:
Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture.Learn more about Target here.
About the Role:
As aLead Data Engineer you will serve as thetechnical anchorfor the engineering team responsible for designing and developingscalable highperformance data solutions. You willown and drive data architecturethat supports both functional and nonfunctional business needs ensuringreliability efficiency and scalability.
Your expertise inbig data technologies distributed systems and cloud platformswill help shape the engineering roadmap and best practices fordata processing analytics and realtime data serving. You will play a key role inarchitecting and optimizing data pipelinesusingHadoop Spark Scala/Java and cloud technologiesto support enterprisewide data initiatives.
Additionallyexperience with API development for serving lowlatency dataandCustomer Data Platforms (CDP)will be a strong plus.
Key Responsibilities:
Architect and buildscalable highperformance data pipelinesanddistributed data processing solutionsusingHadoop Spark Scala/Java and cloud platforms (AWS/GCP/Azure).
Design and implementrealtime and batch data processing solutions ensuring data is efficiently processed and made available for analytical and operational use.
Develop APIs and data servicesto exposelowlatency highthroughputdata for downstream applications enabling realtime decisionmaking.
Optimize and enhancedata models workflows and processing frameworksto improve performance scalability and costefficiency.
Drivedata governance security and compliancebest practices.
Collaborate withdata scientists product teams and business stakeholdersto understand requirements and deliverdatadriven solutions.
Lead thedesign implementation and lifecycle managementof data services and solutions.
Stay up to date withemerging technologiesand drive adoption of best practices inbig data engineering cloud computing and API development.
Providetechnical leadership and mentorshipto engineering teams promoting best practices indata engineering and API design.
About You:
7 years of experience in data engineering software development or distributed systems.
Expertise in big data technologiessuch asHadoop Spark and distributed processing frameworks.
Strong programming skills in Scala and/or Java(Python is a plus).
Experience with cloud platforms (AWS GCP or Azure)and theirdata ecosystem(e.g. S3 BigQuery Databricks EMR Snowflake etc..
Proficiency in API developmentusingREST GraphQL or gRPCto serve realtime and batch data.
Experience with realtime and streaming data architectures(Kafka Flink Kinesis etc..
Strong knowledge ofdata modeling ETL pipeline design and performance optimization.
Understanding ofdata governance security and compliancein largescale data environments.
Experience with Customer Data Platforms (CDP) or customercentric data processingis a strong plus.
Strong problemsolving skills and ability to work incomplex unstructured environments.
Excellent communication and collaboration skills with experience working incrossfunctional teams.
Why Join Us
Work with cuttingedgebig data API and cloud technologiesin a fastpaced collaborative environment.
Influence and shape thefuture of data architecture and realtime data servicesat Target.
Solvehighimpact business problemsusingscalable lowlatency data solutions.
Be part of a culture that valuesinnovation learning and growth.
Employment Type
Full-Time
