1、Druid版本是imply-2.2.3
2、问题:开启3个kafka任务时,只有2个任务正常运行
3、通过http://192.168.2.41:8090/console.html 查看任务情况。
Remote Workers
Show 102550100 entries
Search all columns:
worker host | worker ip | worker capacity | worker version | currCapacityUsed | availabilityGroups | runningTasks | lastCompletedTaskTime |
---|---|---|---|---|---|---|---|
antrol41:8091 | antrol41 | 2 | 0 | 2 | ["index_kafka_wikiticker_test_e00ff216527816d","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc"] | ["index_kafka_hyper_unique_order_3225f7c0fd887ac_geemblei","index_kafka_wikiticker_test_e00ff216527816d_eboaaloo","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc_eeeidnge"] | 2017-07-17T05:27:17.199Z |
Showing 1 to 1 of 1 entries
发现worker capacity 只有2个,标识只能同时运行2个任务。故此3个kafka任务,只能有2个运行。
4、调整worker capacity. 任务管理是通过 MiddleManager 节点进行管理,需调整,MiddleManager中得参数。(需注意启动时使用的配置文件)本人环境启动使用的配置文件路径:
./conf-quickstart/druid/middleManager/runtime.properties
调整参数:druid.worker.capacity=3 druid.processing.numTheads=3
5、重启MiddleManager 节点。(kill -9 pid) 环境自动重启启动,大家有更好的启动方式可以告知下。
6、效果。
Running Tasks
Show 102550100 entries
Search all columns:
id | createdTime | queueInsertionTime | location host | location port | more |
---|---|---|---|---|---|
index_kafka_hyper_unique_order_3225f7c0fd887ac_geemblei | 2017-07-17T05:27:17.236Z | 2017-07-17T05:27:17.236Z | antrol41 | 8100 | kill |
index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc_eeeidnge | 2017-07-17T05:27:17.233Z | 2017-07-17T05:27:17.234Z | antrol41 | 8101 | kill |
index_kafka_wikiticker_test_e00ff216527816d_eboaaloo | 2017-07-17T05:27:22.323Z | 2017-07-17T05:27:22.473Z | antrol41 | 8102 | kill |
Remote Workers
Show 102550100 entries
Search all columns:
worker host | worker ip | worker capacity | worker version | currCapacityUsed | availabilityGroups | runningTasks | lastCompletedTaskTime |
---|---|---|---|---|---|---|---|
antrol41:8091 | antrol41 | 3 | 0 | 3 | ["index_kafka_hyper_unique_order_3225f7c0fd887ac","index_kafka_wikiticker_test_e00ff216527816d","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc"] | ["index_kafka_hyper_unique_order_3225f7c0fd887ac_geemblei","index_kafka_wikiticker_test_e00ff216527816d_eboaaloo","index_kafka_visitor_statistics_kafka_f0cf7b984a0bcfc_eeeidnge"] | 2017-07-17T05:27:17.199Z |
Showing 1 to 1 of 1 entries