kafka connect 一言不合就死程序
阿新 • • 發佈:2019-02-12
錯誤棧是這樣的,打底的意思呢,是我的connector有個配置錯了
我知道錯了,可尼瑪connect程序喂貓掛了啊
知道從這個狀態恢復有多難麼,不刪除connectors,起來就掛啊,
connect掛了,我得刪topic才能刪掉配置啊。
kafka connect各種掛,各種難恢復,各種自我感覺良好。
如果能夠重選,還選kafka connect,勞資特麼改姓卡啊。
[2016-06-29 07:02:26,280] ERROR Uncaught exception in herder work thread, exiting: (org.apache.kafka.connect.runtime.distributed.DistributedHerder:166)
org.apache.kafka.connect.errors.ConnectException: Connector threw an exception while starting
at org.apache.kafka.connect.runtime.Worker.addConnector(Worker.java:188)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startConnector(DistributedHerder.java:668)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.startWork(DistributedHerder.java:640)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.handleRebalanceCompleted(DistributedHerder.java:598)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:184)
at org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:159)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kafka.connect.errors.ConnectException: Couldn't start HdfsSinkConnector due to configuration error
at io.confluent.connect.hdfs.HdfsSinkConnector.start(HdfsSinkConnector.java:48)
at org.apache.kafka.connect.runtime.Worker.addConnector(Worker.java:186)
... 6 more
Caused by: io.confluent.common.config.ConfigException: Invalid value 9999999999 for configuration flush.size: Not a number of type INT
at io.confluent.common.config.ConfigDef.parseType(ConfigDef.java:342)
at io.confluent.common.config.ConfigDef.parse(ConfigDef.java:239)
at io.confluent.common.config.AbstractConfig.<init>(AbstractConfig.java:75 )
at io.confluent.connect.hdfs.HdfsSinkConnectorConfig.<init>(HdfsSinkConnectorConfig.java:245)
at io.confluent.connect.hdfs.HdfsSinkConnector.start(HdfsSinkConnector.java:46)
... 7 more
[2016-06-29 07:02:26,282] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:68)