1、任务日志:
WARN IndexerSQLMetadataStorageCoordinator:97 - Cannot allocate new segment for dataSource[useractive], interval[2018-02-19T00:00:00.000Z/2018-02-26T00:00:00.000Z], maxVersion[2018-02-24T08:59:16.832Z]: conflicting segment[useractive_2018-02-19T00:00:00.000Z_2018-02-20T00:00:00.000Z_2018-02-24T06:30:53.746Z_11].
2、任务日志:
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] ERROR ThreadPoolTaskRunner:121 - Exception while running task[KafkaIndexTask{id=index_kafka_useractive_480e1352143ca85_fajmniii, type=index_kafka, dataSource=useractive}]
io.druid.java.util.common.ISE: Transaction failure publishing segments, abortingat io.druid.indexing.kafka.KafkaIndexTask.run(KafkaIndexTask.java:589) ~[?:?]at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:436) [druid-indexing-service-0.11.0.jar:0.11.0]at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:408) [druid-indexing-service-0.11.0.jar:0.11.0]at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_71]at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_71]at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_71]at java.lang.Thread.run(Thread.java:745) [?:1.8.0_71]
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] INFO TaskRunnerUtils:69 - Task [index_kafka_useractive_480e1352143ca85_fajmniii] status changed to [FAILED].
2018-02-26 17:17:17 3474 [task-runner-0-priority-0] INFO ExecutorLifecycle:69 - Task completed with status: {"id" : "index_kafka_useractive_480e1352143ca85_fajmniii","status" : "FAILED","duration" : 597848
解析
- 1、druid_pendingSegments 中对应的时间段存在冲突
- 2、查看overlord日志,标识 中存在 Not updating metadata, existing state is not the expected start state ,这是由于修改topic 导致校验异常,删除druid_dataSource 对应的 数据即可
异常会导致,segment hand off 失败,无法保留数据 原因:druid_pendingSegments 中对应的时间段存在冲突 解决方案:清理 druid_pendingSegments 对应的时间段