GeoAnalyticsServer cluster deployment manual in Linux,

GeoAnalyticsServer cluster deployment manual in Linux,

1 geoanalyticsserver distributed deployment architecture

This deployment uses three machines for the distributed deployment of vector big data servers. Unlike the single-host deployment, this deployment removes the big data computing nodes and storage nodes that consume hardware resources, these two points can be horizontally expanded in the future.

2 Preparation 2.1 VM distribution instructions

The three machines for Distributed installation and deployment have been copied to the \ 192.168.0.111 \ nas3 \ ant \ Archive directory. The three machines have installed the operating system in advance, copied the software installation package and license file. The file is stored in/home/esrixa/arcgis1051.

In the architecture diagram, machines correspond to virtual machines as follows:

1. The virtual machine name of esrixa.portal.com is ArcGIS Enterprise.

2. The virtual machine ga1 corresponding to ga1.portal.com

3. The virtual machine corresponding to es1.portal.com is es1.

2.2 software preparation

I. Linux operating system

CentOS-7, installation package CentOS-7-x86_64-DVD-1511.iso

Ii. JDK

Jdk8 installation package jdk-8u151-linux-x64.tar.gz

Iii. Web Container

Tomcat 8.5.23 installation package apache-tomcat-8.5.23.zip

Iv. ArcGIS software

A) Portal for ArcGIS 10.5.1 (Linux), installation package:

Portal_for_ArcGIS_Linux_1051_156440.tar.gz

B) ArcGIS Server 10.5.1 (Linux), installation package:

ArcGIS_Server_Linux_1051_156429.tar.gz

C) WebAdaptor 10.5.1 (Linux), installation package:

Web_Adaptor_Java_Linux_1051_156442.tar.gz

D) ArcGIS DataStore 10.5.1 (Linux), installation package:

ArcGIS_DataStore_Linux_1051_156441.tar.gz

3 deployment steps 3.1 install the Operating System

Install CentOS7 on the three machines.

3.2 Create a user group

[Root @ esrixa home] # groupadd arcgis

[Root @ esrixa home] # useradd-g arcgis-m arcgis

[Root @ esrixa home] # passwd arcgis

3.3 copy the software installation package

Move the installation packages to/home/arcgis/arcgis1051.

[Root @ esrixa home] # mv/home/esrixa/arcgis1051/home/arcgis/

3.4 decompress the software installation package

Uncompress the installation packages ending with .tar.gz.

[Root @ esrixa home] # tar-zxvf package name

The installation package ending with uncompress. Zip is waiting for use.

[Root @ esrixa home] # unzip

3.5 machine name Configuration

The installation of ArcGISEnterprise requires that the computer name be in the form of a fully qualified domain name. This modification can be implemented by editing the/etc/hostname and/etc/hosts files.

3.5.1 edit/etc/hostname

[Root @ esrixa home] # vim/etc/hostname

Write the file to the machine name. Here we use esrixa as an example to write the file to esrixa.portal.com.

3.5.2 edit/etc/hosts

[Root @ esrixa home] # vim/etc/hosts

The file content is as follows:

127.0.0.1 localhost

192.168.0.128esrixa.portal.com

192.168.0.129ga1.portal.com

192.168.0.130es1.portal.com

3.6 network configuration 3.6.1 IP address Modification

[Root @ esrixa home] # vim/etc/sysconfig/network-scripts/ifcfg-eno16777736

Modify the following content

Change BOOTPROTO = dhcp to BOOTPROTO = static

Add the following content:

IPADDR=192.168.0.128

GATEWAY=192.168.0.2

DNS1=192.168.0.2

Restart NETWORK SERVICE

[Root @ esrixa home] # servicenetwork restart

Restart the network service (new command)

[Root @ esrixa home] # systemctlrestart network. service

3.6.2 Testing Network

[Root @ esrixa home] # ping www.baidu.com

If a packet is returned, the network configuration is successful.

3.6.3 attachment: vmvm Network Configuration

Click "Virtual Network Editor"

Click "change settings"

Set VMnet8 to NAT mode, enter 192.168.0.0 as the IP segment, and 255.255.255.0 as the subnet mask.

3.7 modify File Permissions

Chmod-R 777/home/arcgis/arcgis1051

3.8 disable Firewall

Disable the three machine firewalls.

[root@esrixa home]# systemctl stop firewalld.service

3.8.1 disable firewall startup

[root@esrixa home]# systemctl disable firewalld.service

3.9 install and configure ArcGIS for Server3.9.1 edit/etc/security/limits. conf

[Root @ esrixa home] # vim/etc/security/limits. conf

Add the following content:

arcgis soft nofile 65535

arcgis hard nofile 65535

arcgis soft nproc 25059

arcgis hard nproc 25059

Install ArcGIS for Server

Switch to arcgis account

[Root @ esrixa home] # suarcgis

3.9.2 Installation

[Arcgis @ esrixa home] $./Setup-m console

Press enter to display the following information, indicating that the installation is successful.

Congratulations. ArcGISServer10.5 has beensuccessfully installed to:/home/arcgis/server You will be able toaccess ArcGIS Server Manager by navigating tohttps: // agsenterprise. esrichina... ager. PRESS Toexit theinstaller:

3.9.3 Configuration

The procedure for creating a site is omitted.

3.10 install and configure the Portal for ArcGIS3.10.1

[Arcgis @ esrixa home] $ cdPortalForArcGIS/

[Arcgis @ esrixa home] $./Setup-m console

If the following information is displayed, the installation is successful.

Congratulations. Portalfor ArcGIS 10.5 has beensuccessfully installed to:/home/arcgis/portal You will be able toaccess Portalfor ArcGIS 10.5 bynavigating tohttps: // localhost: 7443/arcgis/home.

3.10.2 Configuration

Create a new Portal.

Creating an initial account is omitted.

3.11 install and configure ArcGIS DataStore3.11.1 installation environment Configuration

Set vm. swappiness and vm. max_map_count to meet the big data analysis needs of time and space.

[Root @ esrixa arcgis] # echo 'vm. max_map_count = 262144 '>/etc/sysctl. conf

[Root @ esrixa arcgis] # echo 'vm. swappiness = 1'>/etc/sysctl. conf

Run the command to make the above change take effect

[Root @ esrixa arcgis] #/sbin/sysctl-p

3.11.2 Installation

Switch to arcgis account

[Root @ esrixa arcgis] # su-arcgis

Install

[Arcgis @ esrixa ~] $ CdArcGISDataStore_Linux/

[Arcgis @ esrixaArcGISDataStore_Linux] $./Setup-m silent-l Yes

3.11.3 Configuration

Two machines need to install DataStore, one is esrixa.portal.com, and the other is es1.portal.com. Esrixa.portal.com is used to configure relational databases and es1.portal.com is used to configure space-time big data storage.

3.11.3.1 DataStore configuration under esrixa.portal.com

3.11.3.2 DataStore configuration under es1.portal.com

3.12 Install Web Adaptor

WebAdaptor requires a Web container for configuration. in Linux, you can select Tomcat for deployment. To install Tomcat, you must first install JDK, while the CentOS7 operating system comes with OpenJDK. We need to uninstall OpenJDK first, install Sun's JDK and configure Tomcat and WebAdptor.

3.12.1 uninstall OpenJDK and install SunJDK3.12.1.1 view the built-in OpenJDK

[Root @ esrixa arcgis] # java-version

Show JDK as openjdk and version as "1.8.0 _ 65"

 

3.12.1.2 query installed JDK packages

[Root @ esrixa arcgis] # rpm-qa | grep java

3.12.1.3 Delete OpenJDK

Note that there are two "-" before nodeps.

[Root @ esrixa arcgis] # rpm-e-nodeps java-1.7.0-openjdk-headless

[Root @ esrixa arcgis] # rpm-e-nodeps java-1.7.0-openjdk

[Root @ esrixa arcgis] # rpm-e-nodeps java-1.8.0-openjdk-headless

[Root @ esrixa arcgis] # rpm-e-nodeps java-1.8.0-openjdk

3.12.1.4 check whether deletion is successful

[Root @ esrixa arcgis] # java-version

If it is displayed, it is successfully deleted.

3.12.2 install SunJDK3.12.2.1 copy JDK

Copy the JDK installation package content to the/usr/local directory.

[Root @ esrixa arcgis] # mv/jdk1.8.0 _ 151/usr/local

3.12.2.2 configure JDK Environment Variables

[Root @ esrixa arcgis] # vim/etc/profile

Add the following lines

JAVA_HOME =/usr/local/jdk1.8.0 _ 151

JRE_HOME =/usr/local/jdk1.8.0 _ 151/jre

CLASSPATH =.: $ JAVA_HOME/lib/tools. jar: $ JAVA_HOME/lib/dt. jarPATH = $ JAVA_HOME/bin: $ PATH

Export JAVA_HOMECLASSPATH PATH

Make JDK environment variable configuration take effect

[Root @ esrixa arcgis] # source/etc/profile

3.12.2.3 verify JDK

[Root @ esrixa arcgis] # java-version

If the following information is displayed, the configuration is successful.

3.12.3 configure Tomcat3.12.3.1 copy the installation package

Create the tomcat8 folder under/usr/local/

[Root @ esrixa home] # mkdir/usr/local/tomcat8

Copy the tomcat installation package to/usr/local/tomcat8

[Root @ esrixa home] # mvapache-tomcat-8.5.23/*/usr/local/tomcat8

3.12.3.2 create a private key and certificate request

[Root @ esrixa home] # openssl req-newkey rsa: 2048-nodes-keyout/usr/local/tomcat8/esrixa. key-x509-days 365-out/usr/local/tomcat8/esrixa. crt

Enter the content. Note that the CommonName must be a domain name.

Country Name (2 lettercode) [XX]: cn

State or Province Name (full name): sx

Locality Name (eg, city) [Default City]: xa

Organization Name (eg, company) [Default Company Ltd]: arcgis

Organizational Unit Name (eg, section): arcgis

Common Name (eg, yourname or your server's hostname): esrixa.portal.com

Email Address: esrixa@esrichina.com.cn

3.12.3.3 create a self-signed certificate

[Root @ esrixa home] # openssl pkcs12-inkey/usr/local/tomcat8/esrixa. key-in/usr/local/tomcat8/esrixa. crt-export-out/usr/local/tomcat8/esrixa. pfx

Enter the password arcgis

3.12.3.4 configure Tomcat

Enable https

[Root @ esrixa home] # vim/usr/local/tomcat8/conf/server. xml

Modify to the following content:

3.12.3.5 start and verify Tomcat

Modify the permissions of the root user to start tomcat.

[Root @ esrixa home] # chmod-R 777/usr/local/tomcat8

Start tomcat

[Root @ esrixa home] # cd/usr/local/tomcat8/bin

[Root @ esrixa home] #./startup. sh

Verify tomcat

Enter https://esrixa.portal.com in the browser

The following interface is displayed successfully:

3.12.4 install WebAdaptor

[Arcgis @ esrixa home] # cd/usr/local/arcgis1051/WebAdaptor

[Arcgis @ esrixa home] #./Setup-m silent-l yes

The installation is complete.

3.12.5Web Adaptor Configuration

Copy the arcgis. war package to Tomcat.

[Root @ esrixa home] # cp/home/arcgis/webadaptor10.5.1/java/arcgis. war

/Usr/local/tomcat8/webapps/

[Root @ esrixa home] # cp/home/arcgis/webadaptor10.5.1/java/arcgis. war

/Usr/local/tomcat8/webapps/server. war

Arcgis. war is used as the Web Adaptor of Portal for ArcGIS, and server. war is used as the Web Adaptor of ArcGIS Server.

3.12.6 verify Web Adaptor

Browser Input

Https://esrixa.portal.com/arcgis

Https://esrixa.portal.com/server

If the page is opened normally, the installation is correct. You can configure Web adaptors for the server and portal.

3.13 ArcGIS Enterprise configuration 3.14 register a federated Server

Register the ArcGIS Server under esrixa.portal.com and the ArcGIS Server under ga1.portal.com as the combined Server of the Portal.

Note: If the Server is configured with webadaptor, enter the address of webadaptor. If the ArcGIS Server does not have webadaptor, enter the following.

3.15 configure managed servers

Configure ArcGIS Server under esrixa.portal.com as a hosting Server.

3.16 configure the Big Data Analysis Server

Select ArcGIS Server in ga1.portal.com as the Big Data Analysis Server.

After the configuration is complete, click "save ".

3.17 Configure NFS

In an environment without shared storage, you can configure NFS servers in the LAN for shared storage. However, we recommend that you only use them in the test environment. Professional storage is recommended in the production environment.

CentOS 7 has nfs software installed and only needs to be started. In this distributed deployment, the NFS server is configured on es1.portal.com.

Use the/usr/local/nfstest folder as the shared content. Other machines mount the folder to/data.

3.17.1NFS server configuration 3.17.1.1 configure shared folders and share Permissions

Edit/etc/exports

[Root @ es1 home] # vim/etc/exports

Add the following content:

/Usr/local/nfstest * (insecure, rw, sync, no_root_squash)

3.17.1.2 start the service

Restart the rpc service

[Root @ es1 home] # systemctlrestartrpcbind. service

Restart the nfs service

[Root @ es1 home] # systemctlrestart nfs. service

3.17.2NFS client Configuration

Queries the content that can be attached.

[Root @ ga1 home] # showmount-e 192.168.0.130

Run the following commands on the two ECs instances, esrixa.portal.com and ga1.portal.com. The/data folder needs to be created by yourself. /Data is in the root directory

[Root @ ga1 home] # mkdir/data

[Root @ ga1 home] # mount-tnfs 192.168.0.130:/usr/local/nfstest/data

3.18 configure NAS disks for shared storage

Omitted

4. Test the vector Big Data Analysis Function Step 4.1 copy the analysis data to the shared storage

Copy the analysis data to the shared directory, in this case copy the analysis data to es1.portal.com's "/usr/local/nfstest", the test data can be sent to the lizf@esrichina.com.cn to ask for it.

4.2 register Big Data File Sharing

Go to the ArcGISServer manager page and click "Site ".

Click "DataStore"-"register"-"Big Data File Sharing"

4.2.1 registration file sharing

Enter the following content:

Note: Here/nas is the shared directory. The "name" cannot start at will. The "taxi" entered here corresponds to the/data/taxi folder.

After entering the information, click "CREATE ".

4.2.2 register HDFS data

For the format, see the default format.

4.2.3 register Hive data

For the format, see the default format.

4.3 edit big data sharing

Click "edit ".

Select the dataset you just registered.

Click "select field ". Select "pickup_longpolling ".

Configure it as a space field, X coordinate. Similarly, set "pickup_long1_" to Y coordinate.

After the configuration is complete, click "save ".

4.4 use of aggregate point analysis tools

Log on to ArcGIS Enterprise, select "map"-"analysis"-"GeoAnalytics Tools", and select the "aggregation point" tool.

Click "Browse layer"

Click "My content" and select a big data file.

Enter parameters and click "Run analysis"