Spark Web Interface

1.7 Spark Web Interface

Each Sparkcontext publishes a Web interface, the default port is 4040, which displays useful information about the application. This includes:

? A series of scheduling stages and tasks

? Summary of RDD size and memory usage

? Environmental information

? Information on the running Actuator (executor)

You can access http://<driver-node>:4040 through the browser, of course, you will have to start Sparkcontext first. For example, command:./bin/spark-shell, the following Web interface information appears:

If more than one sparkcontext is running on a machine, its web port will automatically add one, such as 4041,4042,4043. To browse the persistent event log, set the park.eventLog.enabled .