Spark Learning (1)--ubuntu14.04 cluster setup, configuration (JDK)

Environment: ubuntu14.04

1, Text mode desktop mode switch

CTRL+ALT+F6 Switching to text mode

CTRL + ALT +F7/input command startx switch to desktop mode

2. Change the IP address, host name

• /etc/hostname-Change host name
• /etc/hosts-host file
• /etc/network/interfaces-Change IP address

• We need to add our own network settings and add them to the file (it needs to be modified according to the respective network conditions):

  Auto Eth0
  Iface eth0 inet Static
  Address 192.168.7.124
  Netmask 255.255.255.0
  Gateway 192.168.7.1
  Broadcast 192.168.7.255

• Restart Network sudo/etc/init.d/networking restart

3, configure Xshell connection ubuntu14.0. (SSH)

sudo apt-get update is complete after updating: sudo apt-get install Openssh-server

Problem:

sudo apt-get update encounters many cannot download

Solve:

Change the software source (graphical interface) graphical interface: Open Ubuntu Software Center, click "Edit" in the top panel and then you can see the "Software Source" option after clicking on the Software Source Edit window, button, select "Other sites" can choose the best server, you can also directly on the left to choose a source you think fast, I prefer 163.com.

Problem:

Parsing host mirrors.163.com ... Failed: unknown name or service. Wget: Unable to resolve host address "mirrors.163.com"

Workaround:

1. Log in Root

2. Enter/etc/resolv.conf

   Vim/etc/resolv.conf

3. Modify content below (change DNS address to Google Domain name server)
   NameServer 8.8.8.8
   NameServer 8.8.4.4

Problem:

Workaround:

/etc/ssh//etc/ssh/permitrootlogin prohibit -  Permitrootlogin yesstrictmodes Yes and enter the command

In general, you can use XSHLL to connect ubuntu14.04 remotely.

Here's what to expand:

Confirm that the Sshserver is started:
Ps-e |grep SSH

This indicates that the Ssh-server service has been successfully installed and has been successfully started.

If only ssh-agent that Ssh-server has not started, need to/etc/init.d/ssh start, if you see sshd, that means that Ssh-server has been started.

4. JDK

(1) Installing the JDK

Create a soft folder under the root directory
sudo mkdir/soft

Change the soft folder to Ailab user
sudo chown ailab/soft

Move the Tar-open folder to/soft
MV ~/downloads/jdk1.7.0_45/soft/

(2) Configuring environment variables

Java_home=/soft/jdk1.7.0_45
Path= "/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/soft/jdk1.7.0_ 45/bin

#> Source Environment

5, clone the virtual machine, modify the IP address, host name

Spark Learning (1)--ubuntu14.04 cluster setup, configuration (JDK)