Apache Doris

Job Description:

工作职责

1. Doris 集群全生命周期管理

- 负责 Apache Doris 集群的部署架构设计高可用配置3FE/3BE日常运维与监控体系建设

- 主导大版本升级如 2.13.0 存算分离灰度发布回滚预案设计与演练

- 724 小时稳定性保障快速响应并解决 FE/BE 故障Tablet 异常Compaction 积压OOM 等问题 - 建立完善的巡检告警Prometheus/Grafana故障复盘与 SOP 沉淀机制

2. 性能调优与治理

- 基于业务场景进行 Doris 表模型选型Duplicate/Unique Key/Aggregate分区策略分桶设计与 Sort Key 优化

- 深入 CBO 优化器执行计划分析主导慢查询治理与物化视图建设

- 针对导入Stream Load/Routine Load/Broker Load和查询两个方向进行参数调优解决导入延迟查询毛刺大查询 OOM 等问题 - 通过资源组Resource Group实现 ETL 与 Ad-hoc 查询的资源隔离

3. 实时&离线数据链路集成

- 基于 Flink CDC 实现 MySQL/PostgreSQL/Oracle 等数据源的全量增量实时入仓解决乱序回撤Exactly-Once 语义保障

- 搭建 Kafka Doris Routine Load 实时摄入管道支撑日志事件流等场景

- 对接离线数仓Hive/HDFS/OSS通过 Airflow/DolphinScheduler 编排离线回流任务

- 完成 BI 工具Superset/FineBI/PowerBI/Tableau的 Doris 数据源对接与查询性能优化

- AI 应用平台集成支撑 Dify / ChatBI 等 LLM 应用的数据层设计统一的指标语义层处理自然语言转 SQL 的权限控制与行级过滤

任职要求

必备条件

- 本科及以上学历计算机相关专业5 年以上大数据平台/OLAP 领域工作经验

- 有 Apache Doris 生产集群运维经验1.2/2.1/3.0 任一版本均可熟悉 FE/BE 架构高可用机制常用运维命令

- 深入理解 Doris 表模型Duplicate/Unique Key/Aggregate分区/分桶原理Rollup/物化视图索引机制Prefix/Bloom Filter/倒排

- 熟练使用 FlinkDataStream/SQLKafkaCDCDebezium/Canal有实时入仓落地经验

- 掌握 SQL 性能分析与调优方法能读懂 Doris EXPLAIN VERBOSE 执行计划并进行针对性优化

- 熟悉 Linux 操作系统Shell/Python 脚本编写有自动化运维工具Ansible/Helm使用经验

- 具备良好的问题拆解能力与跨团队沟通能力能独立承担生产故障排查与应急响应

加分项

- 有 Doris 跨大版本升级存算分离Compute Node 对象存储落地经验 - 熟悉 Flink-Doris-Connector 源码或做过二次开发

- 有 Dify / ChatBI / 大模型应用数据层对接经验理解 RAGText-to-SQL 的技术链路

- 了解 StarRocks / ClickHouse / Trino / Impala 等其他 OLAP 引擎能根据场景做技术选型

- 持有云厂商大数据相关认证阿里云 ACP/ACEAWS 大数据专项等

At DXC Technology we believe strong connections and community are key to our success. Our work model prioritizes in-person collaboration while offering flexibility to support wellbeing productivity individual work styles and life circumstances. Were committed to fostering an inclusive environment where everyone can thrive.

Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services such as false websites or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process nor ask a job seeker to purchase IT or other equipment on our information on employment scams is availablehere.