Sr. Data Engineer
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Sr. Data Engineer (6-9 yrs)
Responsibilities:
- Builds automated pipelines for provisioning and refreshing non-production environments
- Applies data masking tokenization and privacy-aware transformation techniques to sensitive data
- Ensures generated data maintains production-like relationships distributions and usage behavior
- Implements scalable synthetic data generation and environment refresh solutions
- Integrates synthetic data workflows into CI/CD and platform engineering pipelines
- Works closely with Data Architects platform teams QA and engineering teams
- Supports modern synthetic data generation and AI-assisted engineering approaches for creating intelligent privacy-aware production-representative datasets
- Contributes to automation-driven and GenAI-enabled approaches for data generation validation and environment provisioning
Technical skills:
- SQL Server bulk inserts referential integrity index-aware loading performance-aware data ingestion
- Python data generation libraries such as Faker factory-boy or similar frameworks
- Azure DevOps pipelines and CI/CD automation
- Data masking and privacy techniques tokenization hashing format-preserving substitution
- Data validation approaches validating generated data quality relationships and consistency before use
- Experience working with large-scale enterprise data environments
- Experience with at least 2 enterprise Test Data Management (TDM) tools
Required Experience:
Senior IC