Flume1.11.0默认Java8,如果系统环境为Java17,则额外需要配置Java8前置条件系统已经部署Java8和Java17,位置如下/usr/local/soft/jdk-17.0.1//usr/local/soft/jdk1.8.0_381/一、上传解压将apache-flume-1.11.0-bin.tar.gz软件包上传至/usr/local/soft文件夹下cd /usr/local/soft tar -zxvf apache-flume-1.11.0-bin.tar.gz二、添加系统环境变量编辑环境变量vi /etc/profile添加如下内容export FLUME_HOME/usr/local/soft/apache-flume-1.11.0-bin export PATH$PATH:$FLUME_HOME/bin使环境变量生效source /etc/profile三、修改Flume环境变量拷贝环境变量文件cd /usr/local/soft/apache-flume-1.11.0-bin/conf/ cp flume-env.sh.template flume-env.sh添加内容export JAVA_HOME/usr/local/soft/jdk1.8.0_381编辑 flume-ng文件vi /usr/local/soft/apache-flume-1.11.0-bin/bin/flume-ng前面添加一下内容JAVA_HOME/usr/local/soft/jdk1.8.0_381 FLUME_JAVA_OPTS-Xms512m -Xmx2048m四、配置文件客户端(Source)收集信息拷贝配置文件cp flume-conf.properties.template flume-client.properties配置文件内容#分别指定agent的sourcessinks, channels的名称 名称可以自定义#分别指定agent的sourcessinks, channels的名称 名称可以自定义 a1.sources s1 a1.sinks k1 a1.channels c1 #配置目录scource a1.sources.s1.type spooldir a1.sources.s1.spoolDir /usr/local/data/logs/ a1.sources.s1.fileHeader true a1.sources.s1.channels c1 #配置sink a1.sinks.k1.type logger a1.sinks.k1.channel c1 #配置channel(内存做缓存) a1.channels.c1.type memory五、启动cd /usr/local/soft/apache-flume-1.11.0-bin/conf/ flume-ng agent -n a1 -c conf -f flume-client.properties -Dflume.root.loggerDEBUG,console其中-n:agent名称-c:配置文件路径conf-f:配置文件名称如果还是有错则直接指定JAVA_HOMEcd /usr/local/soft/apache-flume-1.11.0-bin/conf/ JAVA_HOME/usr/local/soft/jdk1.8.0_381 FLUME_JAVA_OPTS-Xms512m -Xmx2048m /usr/local/soft/apache-flume-1.11.0-bin/bin/flume-ng agent -n a1 -c conf -f flume-client.properties -Dflume.root.loggerINFO,console五、执行验证将一个文本文件放入到/usr/local/data/logs/文件夹下查看shell页面变化附集群拷贝scp -r /usr/local/soft/apache-flume-1.11.0-bin roothadoop101:/usr/local/soft scp -r /usr/local/soft/apache-flume-1.11.0-bin roothadoop102:/usr/local/soft scp /etc/profile roothadoop101:/etc/profile scp /etc/profile roothadoop102:/etc/profile
