centos7安装geowave0.9.7_hbase_geoserver2.13.2的方法
centos7安装geowave0.9.7_hbase_geoserver2.13.2的方法
参考web页面地址url:
https://www.linkedin.com/pulse/testing-big-spatial-data-software-hadoop-hbase-geowave-alvaro-huarte/
https://blog.csdn.net/sinat_35582093/article/details/80182019
安装geoserver2.13.2参考：https://blog.csdn.net/hsg77/article/details/81910007
安装hbase参考：https://blog.csdn.net/hsg77/article/details/81037726
安装的环境：
master 192.168.10.180 namenode,datanode,hmaster,hregionserver
slave1 192.168.10.181 namenode,datanode,hmaster,hregionserver
slave2 192.168.10.182 datanode,hregionserver
geoserver 192.168.10.190 tomcat geoserver geowave
geoserver服务器hosts具体内容：
127.0.0.1 core localhost.localdomain localhost
192.168.10.190 geoserver
192.168.10.180 master
192.168.10.181 slave1
192.168.10.182 slave2
hdfs webpageurl:
http://192.168.10.180:50070
http://192.168.10.181:50070
hbase webpageurl:
http://192.168.10.180:16010/master-status
http://192.168.10.181:16010/master-status
tomcat webpageurl:
http://192.168.10.190:8080/
geoserver webpageurl:
http://192.168.10.190:8080/geoserver
#安装geowave0.9.7
下载离线包：geowave-geoserver-0.9.7-apache.jar
下载地址：
http://s3.amazonaws.com/geowave-rpms/release-jars/JAR/geowave-geoserver-0.9.7-apache.jar
更多版本地址：
http://locationtech.github.io/geowave/packages.html
选择Release JARS有一个列表下载
将它拷到 /usr/tomcat/webapps/geoserver/WEB-INF/lib下
此时启动geoserver, 打开浏览器进入 192.168.10.190:8080/geoserver/web 登录geoserver。默认帐号admin，密码geoserver。
在左侧data栏目下store, 点击add new store可以看到geowave插件已经加载了
s矢量数据源
Directory of spatial files (shapefiles) - Takes a directory of shapefiles and exposes it as a data store
GeoPackage - GeoPackage
GeoWave Datastore - ACCUMULO - A datastore that uses the GeoWave API for spatial data persistence in accumulo. A GeoWave store backed by tables in Apache Accumulo
GeoWave Datastore - BIGTABLE - A datastore that uses the GeoWave API for spatial data persistence in bigtable. A GeoWave store backed by tables in Google's Cloud BigTable
GeoWave Datastore - HBASE - A datastore that uses the GeoWave API for spatial data persistence in hbase. A GeoWave store backed by tables in Apache HBase
PostGIS - PostGIS Database
PostGIS (JNDI) - PostGIS Database (JNDI)
使用hbase，需要把geowave-hbase-0.9.7-apache.jar拷到hbase的lib里面
具体位置为：/home/hadoop3/app/hbase/lib
三台服务器都要拷贝(与hbase有关) master,slave1,slave2
#数据准备情况：
在geoserver192.168.10.190服务器上执行下面的代码：
[root@geoserver geoserver]# pwd
/usr/geoserver
#拷贝文件到这个目录下
geowave-tools-0.9.7-apache.jar
ne_50m_admin_0_countries.shp
[root@geoserver geoserver]# ls -ls
总用量 395328
90944 -rw-r--r--. 1 root root 93122657 7月 23 21:53 geoserver.war
302124 -rw-r--r--. 1 root root 309371727 8月 23 16:23 geowave-tools-0.9.7-apache.jar
20 -rw-r--r--. 1 root root 18008 6月 19 2017 GPL.txt
80 -rw-r--r--. 1 root root 81585 2月 20 2018 LICENSE.txt
4 -rw-r--r--. 1 root root 5 8月 23 16:22 ne_50m_admin_0_countries.cpg
536 -rw-r--r--. 1 root root 546979 8月 23 16:22 ne_50m_admin_0_countries.dbf
4 -rw-r--r--. 1 root root 143 8月 23 16:22 ne_50m_admin_0_countries.prj
24 -rw-r--r--. 1 root root 23632 8月 23 16:22 ne_50m_admin_0_countries.README.html
4 -rw-r--r--. 1 root root 2396 8月 23 16:22 ne_50m_admin_0_countries.sbn
4 -rw-r--r--. 1 root root 268 8月 23 16:22 ne_50m_admin_0_countries.sbx
1576 -rw-r--r--. 1 root root 1612740 8月 23 16:22 ne_50m_admin_0_countries.shp
4 -rw-r--r--. 1 root root 2028 8月 23 16:22 ne_50m_admin_0_countries.shx
4 -rw-r--r--. 1 root root 7 8月 23 16:22 ne_50m_admin_0_countries.VERSION.txt
0 drwxr-xr-x. 2 root root 25 7月 23 22:00 target
[root@geoserver geoserver]#
#利用geowave将shp导入hbase并将该store添加到geoserver中
#查看geowave版本
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain --version
#修改zookeeper默认地址
查看已有数据源列表
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config list
找到其中的zookeeper的key设置值
default.opts.zookeeper为config list中看到具体key为准
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config set default.opts.zookeeper master:2181
#建立空间索引
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addindex -t spatial eea-spindex --partitionStrategy ROUND_ROBIN
#在hbase里面建立geowave的eea-store
注意最后的端口，如果你修改过hbase的zookeeper记得修改
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addstore eea-store --gwNamespace geowave.eea -t hbase --zookeeper 192.168.10.180:2181
#将本地shp导入刚刚建立的eea-store中
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain ingest localtogw -f geotools-vector ./ne_50m_admin_0_countries.shp eea-store eea-spindex
#配置geoserver连接
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config geoserver -ws geowave -u admin -p geoserver http://192.168.10.190:8080/geoserver
#利用geowave给geoserver添加layer
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain gs addlayer eea-store
#查看web页面情况
http://192.168.10.190:8080/geoserver
数据存储：
geowave eea-store-vector GeoWave Datastore – HBASE
需要手动添加图层：
ne_50m_admin_0_countries geowave:ne_50m_admin_0_countries eea-store-vector
#具体过程如下所示：
导入./ne_50m_admin_0_countries.shp到hbase中并发布到geoserver中
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain --version
{build.os=Linux
build.jvm.vendor=Oracle Corporation
build.jvm.version=1.8.0_131-b11
build.maven.version=3.2.2
build.os.arch=amd64
build.os.version=4.9.27-14.31.amzn1.x86_64
build.timestamp=2018-03-28T16:45:31+0000
build.user=root
project.branch=UNKNOWN
project.build.args=-Dvendor.version=apache
project.scm.revision=dbac917aff060ee206bd7b7f5dec3fa3db6ef422
project.version=0.9.7}
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addindex -t spatial eea-spindex --partitionStrategy ROUND_ROBIN
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addstore eea-store --gwNamespace geowave.eea -t hbase --zookeeper 192.168.10.180:2181
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain ingest localtogw -f geotools-vector ./ne_50m_admin_0_countries.shp eea-store eea-spindex
23 八月 16:38:32 WARN [util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23 八月 16:38:32 INFO [zookeeper.RecoverableZooKeeper] - Process identifier=hconnection-0xa2431d0 connecting to ZooKeeper ensemble=192.168.10.180:2181
八月 23, 2018 4:38:34 下午 org.geotools.image.ImageWorker <clinit>
信息: Warp/affine reduction enabled: true
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 4:38:34 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config geoserver -ws geowave -u admin -p geoserver http://192.168.10.190:8080/geoserver
geoserver.url=http://192.168.10.190:8080/geoserver
geoserver.pass=ENC{68336f69636339454a43743136667a34644b456b4b673d3d}
geoserver.user=admin
geoserver.workspace=geowave
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain gs addlayer eea-store
23 八月 16:40:54 WARN [util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23 八月 16:40:54 INFO [zookeeper.RecoverableZooKeeper] - Process identifier=hconnection-0x738dc9b connecting to ZooKeeper ensemble=192.168.10.180:2181
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 4:40:55 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
Add GeoServer layer for 'eea-store: OK : {
"description": "Successfully added:",
"layers": [ {
"id": "ne_50m_admin_0_countries",
"type": "vector"
}]
}
[root@geoserver geoserver]#
#导入另一个shp文件到hbase并发布到geoserver中
./guizhou_xzq.shp
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addindex -t spatial gzxzq-spindex --partitionStrategy ROUND_ROBIN
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addstore gzxzq-store --gwNamespace geowave.gzxzq -t hbase --zookeeper 192.168.10.180:2181
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain ingest localtogw -f geotools-vector ./guizhou_xzq.shp gzxzq-store gzxzq-spindex
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config geoserver -ws geowave -u admin -p geoserver http://192.168.10.190:8080/geoserver
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain gs addlayer gzxzq-store
具体过程如下：
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addindex -t spatial gzxzq-spindex --partitionStrategy ROUND_ROBIN
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addstore gzxzq-store --gwNamespace geowave.gzxzq -t hbase --zookeeper 192.168.10.180:2181
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain ingest localtogw -f geotools-vector ./guizhou_xzq.shp gzxzq-store gzxzq-spindex
23 八月 18:04:52 WARN [util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23 八月 18:04:53 INFO [zookeeper.RecoverableZooKeeper] - Process identifier=hconnection-0xa2431d0 connecting to ZooKeeper ensemble=192.168.10.180:2181
八月 23, 2018 6:04:55 下午 org.geotools.image.ImageWorker <clinit>
信息: Warp/affine reduction enabled: true
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 6:04:56 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
23 八月 18:05:00 INFO [client.HBaseAdmin] - Created geowave.gzxzq_GEOWAVE_METADATA
23 八月 18:05:05 INFO [client.HBaseAdmin] - Created geowave.gzxzq_SPATIAL_IDX
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config geoserver -ws geowave -u admin -p geoserver http://192.168.10.190:8080/geoserver
geoserver.pass=ENC{68336f69636339454a43743136667a34644b456b4b673d3d}
geoserver.workspace=geowave
geoserver.url=http://192.168.10.190:8080/geoserver
geoserver.user=admin
[root@geoserver geoserver]# java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain gs addlayer gzxzq-store
23 八月 18:07:22 WARN [util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
23 八月 18:07:22 INFO [zookeeper.RecoverableZooKeeper] - Process identifier=hconnection-0x738dc9b connecting to ZooKeeper ensemble=192.168.10.180:2181
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
八月 23, 2018 6:07:24 下午 org.geoserver.platform.GeoServerExtensions checkContext
警告: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
Add GeoServer layer for 'gzxzq-store: OK : {
"description": "Successfully added:",
"layers": [ {
"id": "guizhou_xzq",
"type": "vector"
}]
}
[root@geoserver geoserver]#
添加2000坐标系35度带的shp文件方法
xzq35.shp
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addindex -t spatial xzq35-spindex --partitionStrategy ROUND_ROBIN --crs EPSG:4523
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config addstore xzq35-store --gwNamespace geowave.xzq35 -t hbase --zookeeper master:2181,slave1:2181,slave2:2181
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain ingest localtogw -f geotools-vector ./xzq35.shp xzq35-store xzq35-spindex
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain config geoserver -ws geowave -u admin -p geoserver http://192.168.145.190:8080/geoserver
java -cp ./geowave-tools-0.9.7-apache.jar mil.nga.giat.geowave.core.cli.GeoWaveMain gs addlayer xzq35-store
25 九月 17:27:43 INFO [client.HBaseAdmin] - Created geowave.xzq35_GEOWAVE_METADATA
25 九月 17:27:48 INFO [client.HBaseAdmin] - Created geowave.xzq35_SPATIAL_IDX_4523
—the–end—-
转载自：https://blog.csdn.net/hsg77/article/details/81985249
