hive lzo的安装

第一步

1、在hadoop集群每个节点上安装lzo和lzop及其依赖(主要为解决安装lzop)：
yum -y install *lzo*
2. 安装准备：
[root@hadoop01 home]# yum -y install gcc-c++ lzo-devel zlib-devel autoconf automake libtool
3.下载
[root@hadoop01 home]# wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.10.tar.gz
4.解压编译
[root@hadoop01 home]# tar -zxvf /home/lzo-2.10.tar.gz
[root@hadoop01 home]# cd /home/lzo-2.10/
[root@hadoop01 lzo-2.10]# ./configure -prefix=/usr/local/lzo/ 
[root@hadoop01 lzo-2.10]# make 
[root@hadoop01 lzo-2.10]# make install

第二步:

[root@hadoop01 home]# wget https://github.com/twitter/hadoop-lzo/archive/master.zip
[root@hadoop01 home]# unzip /home/hadoop-lzo-master.zip
[root@hadoop01 home]# cd /home/hadoop-lzo-master
搜索内容hadoop.current并修改版本号：
<hadoop.current.version>2.7.7(你自己的hadoop版本号)</hadoop.current.version>

第三步

使用maven编译(需要maven已经安装) 
[root@hadoop01 hadoop-lzo-master]# export C_INCLUDE_PATH=/usr/local/lzo/include 
[root@hadoop01 hadoop-lzo-master]# export LIBRARY_PATH=/usr/local/lzo/lib
编译 
[root@hadoop01 hadoop-lzo-master]# mvn package -Dmaven.test.skip=true
我这一步进行了半个小时
进入target，将hadoop-lzo-0.4.21-SNAPSHOT.jar放到hadoop的classpath下。如 ${HADOOP_HOME}/share/hadoop/common
[root@hadoop01 hadoop-lzo-master]# cp ./target/hadoop-lzo-0.4.21-SNAPSHOT.jar  ${HADOOP_HOME}/share/hadoop/common/
分发到其它服务器： 
[root@hadoop01 hadoop-lzo-master]# scp ./target/hadoop-lzo-0.4.21-SNAPSHOT.jar hadoop02: ${HADOOP_HOME}/share/hadoop/common/
[root@hadoop01 hadoop-lzo-master]# scp ./target/hadoop-lzo-0.4.21-SNAPSHOT.jar hadoop03: ${HADOOP_HOME}/share/hadoop/common/

第四步
把以下内容添加到core-stie.xml

<property> 
<name>io.compression.codecs</name>
<value>org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.BZip2Codec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec</value>
 </property>
  <property>
   <name>io.compression.codec.lzo.class</name> 
   <value>com.hadoop.compression.lzo.LzoCodec</value> 
</property>

把core-stie.xml分发到每台服务器

重启集群和hive