2 spark environment setup local

1 The basic principle

2 build

3 test - be based on bin/pyspark

4 be based on bin/spark-shell test - understand ( This item requires Scala Language operation )

5 summary

1 Local How patterns work ?
Local Mode is to provide completion with an independent process and its internal thread Spark Runtime environment . Local
The mode can be through spark-shell/pyspark/spark-submit Wait to open
2 bin/pyspark What is the program ?
Is an interactive interpreter execution environment , After the environment starts, you get a Local Spark Environmental Science , It can carry
That's ok Python Code to Spark Calculation , similar Python Built in interpreter
3 Spark Of 4040 What is the port ?
Spark After running the task , Will be in Driver The machine is bound to 4040 port , Provide the monitoring page of the current task
For viewing