1. 程式人生 > >kafka connect 一言不合就死程序

kafka connect 一言不合就死程序

錯誤棧是這樣的,打底的意思呢,是我的connector有個配置錯了
我知道錯了,可尼瑪connect程序喂貓掛了啊
知道從這個狀態恢復有多難麼,不刪除connectors,起來就掛啊,
connect掛了,我得刪topic才能刪掉配置啊。
kafka connect各種掛,各種難恢復,各種自我感覺良好。
如果能夠重選,還選kafka connect,勞資特麼改姓卡啊。

[2016-06-29 07:02:26,280] ERROR Uncaught exception in herder work thread, exiting:  (org.apache.kafka.connect.runtime.distributed.DistributedHerder:166)
org.apache.kafka.connect.errors.ConnectException: Connector threw an exception while starting
        at org.apache.kafka.connect.runtime.Worker.addConnector(Worker.java:188)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:668)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startWork(DistributedHerder.java:640)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.handleRebalanceCompleted(DistributedHerder.java:598)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:184)
        at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:159)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kafka.connect.errors.ConnectException: Couldn't start
HdfsSinkConnector due to configuration error at io.confluent.connect.hdfs.HdfsSinkConnector.start(HdfsSinkConnector.java:48) at org.apache.kafka.connect.runtime.Worker.addConnector(Worker.java:186) ... 6 more Caused by: io.confluent.common.config.ConfigException: Invalid value
9999999999 for configuration flush.size: Not a number of type INT at io.confluent.common.config.ConfigDef.parseType(ConfigDef.java:342) at io.confluent.common.config.ConfigDef.parse(ConfigDef.java:239) at io.confluent.common.config.AbstractConfig.<init>(AbstractConfig.java:75
) at io.confluent.connect.hdfs.HdfsSinkConnectorConfig.<init>(HdfsSinkConnectorConfig.java:245) at io.confluent.connect.hdfs.HdfsSinkConnector.start(HdfsSinkConnector.java:46) ... 7 more [2016-06-29 07:02:26,282] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:68)