Datastage Lead with Azure Data Factory exp
Mandatory skills-
Primary Skill- DataStage
Secondary- ADF
Experience in DataStage and migrating of ETL from DataStage to ADF
Need lead experience The person will lead the team of 5-6 yrs people.
Exp with PythonPyspark & Scala
Client location preference in Memphis TN.
Location- Hybrid - Memphis TN (Look for someone local to this Location or ready to relocate) .
Job Description Data Engineer (DataStage & ADF)
We are seeking a seasoned Data Engineer with strong expertise in both IBM DataStage and Azure Data Factory (ADF). This role requires hands-on technical capabilities along with experience in leading offshore teams to deliver enterprise-grade data solutions across hybrid environments.
Key Responsibilities:
- 8 years of experience in data engineering with a balanced focus on traditional ETL and modern cloud-based integration.
- 4 years of hands-on experience with IBM DataStage including development optimization and support of complex ETL workflows.
- 4 years of experience with Azure Data Factory Azure SQL Database and other Azure-native services for data ingestion and transformation.
- Experience in ETL migration projects particularly transitioning DataStage workloads to ADF or equivalent cloud pipelines.
- Ability to design develop and maintain ETL pipelines in both on-premise (DataStage) and cloud (ADF) ecosystems.
- Proven ability to lead and coordinate offshore development teams ensuring alignment with timelines quality standards and delivery goals.
- Expertise in building and managing data pipelines using Databricks implementing data quality lineage and governance practices.
- Proficient in SQL and Python including writing scripts for data manipulation and orchestration logic.
- Experience in Azure-based data warehouse platforms like Azure Synapse Analytics Azure Data Lake and associated data services.
- Familiar with CI/CD practices using Azure DevOps including automation of pipeline deployment and version control.
- Knowledge of data governance security and compliance best practices in the Azure cloud environment.