hbase中表关联到hive然后使用sql查询

最新推荐文章于 2024-08-09 15:41:02 发布

原创最新推荐文章于 2024-08-09 15:41:02 发布 · 3.1k 阅读

0 ·

本内容遵循CC 4.0 BY-SA版权协议

收录于

知识随笔

本文介绍了如何将HBase中的'user_position_table'表实时关联到Hive，并在Hive中通过SQL查询数据。首先创建了一个外部表'hive_user_position_table'，然后展示了如何使用HBaseStorageHandler进行存储配置，最后演示了查询特定msisdn的数据操作。

hbase中的'user_position_table'表实时关联到hive

hive

创建表

create external table hive_user_position_table
(
id string,
lacCell string,
lacCoordinate string,
msisdn string,
timestamp string
)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key,position:lacCell,position:lacCoordinate,position:msisdn,position:timestamp")
TBLPROPERTIES("hbase.table.name" = "user_position_table");

在hive中查看数据

select * from user_position_table_tmp where msisdn=13641999428;

hive> create external table hive_user_position_table
> (
> id string,
> lacCell string,
> lacCoordinate string,
> msisdn string,
> timestamp string
> )
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> WITH SERDEPROPERTIES("hbase.columns.mapping" = ":key,position:lacCell,position:lacCoordinate,position:msisdn,position:timestamp")
> TBLPROPERTIES("hbase.table.name" = "user_position_table");
OK
Time taken: 3.344 seconds
hive> select * from user_position_table_tmp where msisdn=13641999428;
WARNING: Comparing a bigint and a string may result in a loss of precision.
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_1466479961681_0610, Tracking URL = http://vhost79.test.quality:8088/proxy/application_1466479961681_0610/