Flume 使用avroSource和AvroSink实现跃点agent处理

1.创建配置文件
        [avro_hop.conf]

#a1
		a1.sources = r1
		a1.sinks= k1
		a1.channels = c1

		a1.sources.r1.type=netcat
		a1.sources.r1.bind=localhost
		a1.sources.r1.port=8888

		a1.sinks.k1.type = avro
		a1.sinks.k1.hostname=localhost
		a1.sinks.k1.port=9999

		a1.channels.c1.type=memory

		a1.sources.r1.channels = c1
		a1.sinks.k1.channel = c1

#a2
		a2.sources = r2
		a2.sinks= k2
		a2.channels = c2

		a2.sources.r2.type=avro
		a2.sources.r2.bind=localhost
		a2.sources.r2.port=9999

		a2.sinks.k2.type = logger

		a2.channels.c2.type=memory

		a2.sources.r2.channels = c2
		a2.sinks.k2.channel = c2

2.启动a2

flume-ng agent -f /soft/flume/conf/avro_hop.conf -n a2 -Dflume.root.logger=INFO,console

3.验证a2

netstat -anop | grep 9999

4.启动a1

flume-ng agent -f /soft/flume/conf/avro_hop.conf -n a1

5.验证a1

netstat -anop | grep 8888

猜你喜欢

转载自blog.csdn.net/mao502010435/article/details/89472976