学习hadoop遇到的问题(flume-kafka报错)

版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/madongyu1259892936/article/details/89333919
org.apache.kafka.common.errors.InterruptException: Flush interrupted.
	at org.apache.kafka.clients.producer.KafkaProducer.flush(KafkaProducer.java:546)
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:236)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
	at org.apache.kafka.clients.producer.internals.ProduceRequestResult.await(ProduceRequestResult.java:57)
	at org.apache.kafka.clients.producer.internals.RecordAccumulator.awaitFlushCompletion(RecordAccumulator.java:425)
	at org.apache.kafka.clients.producer.KafkaProducer.flush(KafkaProducer.java:544)
	... 4 more
2019-04-16 15:09:31,285 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] flume.SinkRunner: Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to publish events
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:264)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kafka.common.errors.InterruptException: Flush interrupted.
	at org.apache.kafka.clients.producer.KafkaProducer.flush(KafkaProducer.java:546)
	at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:236)
	... 3 more
Caused by: java.lang.InterruptedException
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:231)
	at org.apache.kafka.clients.producer.internals.ProduceRequestResult.await(ProduceRequestResult.java:57)
	at org.apache.kafka.clients.producer.internals.RecordAccumulator.awaitFlushCompletion(RecordAccumulator.java:425)
	at org.apache.kafka.clients.producer.KafkaProducer.flush(KafkaProducer.java:544)
	... 4 more

原因是在flume上的的hosts文件里没有配置kafka服务集群服务的地址映射

猜你喜欢

转载自blog.csdn.net/madongyu1259892936/article/details/89333919