AVP, Data Engineer, CDO
AVP, Data Engineer, CDO
Posted on :
01-10-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Location:
CN-Shenzhen-HyQShift:
Scheduled Weekly Hours:
40Worker Type:
PermanentJob Summary:
Job Duties:
Key Responsibilities:
- Lead a high-performing data transformation POD of 810 engineers driving delivery and technical excellence.
- Collaborate closely with data analysts and business stakeholders to gather requirements and deliver scalable reliable data solutions.
- Design build and maintain robust data pipelines using SparkSQL and Python to process large-scale datasets efficiently.
- Manage and optimize data storage and retrieval within the Hadoop Distributed File System (HDFS).
- Utilize Trino to query and analyze data supporting business intelligence and reporting needs.
- Ensure data quality integrity and security across all systems and processes.
- Monitor and fine-tune pipeline performance and query execution to ensure scalability and operational efficiency.
- Troubleshoot and resolve data-related issues promptly to minimize business impact.
- Manage production incidents and coordinate with the Site Reliability Engineering (SRE) Lead to oversee incident investigation and postmortem analysis.
Mandatory Skills and Qualifications:
- Minimum 8 years of experience in data engineering with minimum 3 years of data engineering management role.
- Strong expertise in SparkSQL for large-scale data processing and querying.
- Proven hands-on experience with HDFS for distributed data storage and management.
- Deep understanding of Trino for distributed SQL query execution.
- Proficiency in Python for scripting automation and data manipulation.
- Solid grasp of ETL architecture data modeling and pipeline design.
- Familiarity with distributed computing principles and big data ecosystems
- Basic proficiency in English and Mandarin including both written and verbal communication skills.
Preferred Skills:
- Experience with Tableau for data visualization and dashboard development.
- Exposure to cloud platforms such as AWS or Huawei HCS.
- Knowledge of SQL performance tuning and query optimization techniques.
Company Introduction:
ITD SZ
港交所科技深圳有限公司是2016年12月28日于深圳市前海自贸区成立的外商独资企业
作为港交所的技术子公司港交所科技深圳有限公司主要是为集团及其附属公司提供计算机软件计算机硬件信息系统云存储云计算物联网和计算机网络的开发技术服务技术咨询技术转让经济信息咨询企业管理咨询商务信息咨询商业信息咨询信息系统设计集成运行维护数据库管理大数据分析以承接服务外包方式提供系统应用管理和维护信息技术支持管理数据处理等信息技术和业务流程外包服务
Employment Type
Full-Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
