在hive中建立HBase外部表
阿新 • • 發佈：2018-12-23
2012-07-19
http://abloz.com
author:周海漢
date:2012.7.19
HBase查詢award表
hbase(main):003:0> scan 'award' ,LIMIT=>2 ROW COLUMN+CELL 2012-04-27 06:55:00:102713629 column=info:MPID, timestamp=1341890254281, value=2947 2012-04-27 06:55:00:102713629 column=info:MatchID, timestamp=1341890254281, value=433203828 2012-04-27 06:55:00:102713629 column=info:MatchName, timestamp=1341890254281, value=xxx 2012-04-27 06:55:00:102713629 column=info:Rank, timestamp=1341890254281, value=2 2012-04-27 06:55:00:102713629 column=info:TourneyID, timestamp=1341890254281, value=1027102 2012-04-27 06:55:00:102713629 column=info:UserId, timestamp=1341890254281, value=102713629 2012-04-27 06:55:00:102713629 column=info:gameID, timestamp=1341890254281, value=1001 2012-04-27 06:55:00:102713629 column=info:loginId, timestamp=1341890254281, value=715878221 2012-04-27 06:55:00:102713629 column=info:nickName, timestamp=1341890254281, value=xxx 2012-04-27 06:55:00:102713629 column=info:platform, timestamp=1341890254281, value=ios 2012-04-27 06:55:00:102713629 column=info:ware, timestamp=1341890254281, value=1984:1 2082:1 2012-04-27 06:55:00:106788559 column=info:MPID, timestamp=1341890254281, value=478 2012-04-27 06:55:00:106788559 column=info:MatchID, timestamp=1341890254281, value=433203930 2012-04-27 06:55:00:106788559 column=info:MatchName, timestamp=1341890254281, value=xxx 2012-04-27 06:55:00:106788559 column=info:Rank, timestamp=1341890254281, value=19 2012-04-27 06:55:00:106788559 column=info:TourneyID, timestamp=1341890254281, value=1014780 2012-04-27 06:55:00:106788559 column=info:UserId, timestamp=1341890254281, value=106788559 2012-04-27 06:55:00:106788559 column=info:gameID, timestamp=1341890254281, value=1001 2012-04-27 06:55:00:106788559 column=info:gold, timestamp=1341890254281, value=1 2012-04-27 06:55:00:106788559 column=info:loginId, timestamp=1341890254281, value=13835155880 2012-04-27 06:55:00:106788559 column=info:nickName, timestamp=1341890254281, value=xxx 2012-04-27 06:55:00:106788559 column=info:platform, timestamp=1341890254281, value=android 2 row(s) in 0.0420 seconds
hive中建立外部表
hive> CREATE EXTERNAL TABLE hive_award(key string, productid int,matchid string, rank string, tourneyid string, userid bigint,gameid int,gold int,loginid string,nick string,plat string) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,info:MPID,info:MatchID,info:Rank,info:TourneyID,info:UserId,info:gameID,info:gold,info:loginId,info:nickName,info:platform") TBLPROPERTIES("hbase.table.name" = "award");
此命令可以看到HBase的列族如何和hive的列對應，表名如何對應。SERDEPROPERTIES表示serializer properties, 序列化屬性。deserializer 表示反序列化。TBLPROPERTIES表示table 表屬性。
hive> desc hive_award; key string from deserializer productid int from deserializer matchid string from deserializer rank string from deserializer tourneyid string from deserializer userid bigint from deserializer gameid int from deserializer gold int from deserializer loginid string from deserializer nick string from deserializer plat string from deserializer
hive查詢
hive> select * from hive_award limit 3;
OK
2012-04-27 06:55:00:102713629 2947 433203828 2 1027102 102713629 1001 NULL 715878221 xxx ios
2012-04-27 06:55:00:106788559 478 433203930 19 1014780 106788559 1001 1 13835155880 xxx android
2012-04-27 06:55:00:114298440 478 433203930 20 1014780 114298440 1001 1 1131024406 xxx android
Time taken: 0.104 seconds
如非註明轉載, 均為原創. 本站遵循知識共享CC協議,轉載請註明來源