StarMirror/data-science-ipython-notebooks
1
0
Fork 0
mirror of https://github.com/donnemartin/data-science-ipython-notebooks.git synced 2024-03-22 13:30:56 +08:00
Code Issues Projects Releases Wiki Activity

Added Spark IPython Notebook, currently contains snippets for starting the pyspark shell and viewing the spark context.

Browse Source
This commit is contained in:
Donne Martin 2015-03-03 10:32:59 -05:00
parent a0ac867b7b
commit 6c7e7b5239
2 changed files with 66 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@ -37,6 +37,7 @@ IPython Notebooks demonstrating Amazon Web Services functionality.
IPython Notebooks demonstrating spark and HDFS functionality. IPython Notebooks demonstrating spark and HDFS functionality.
* [hdfs](http://nbviewer.ipython.org/github/donnemartin/ipython-data-notebooks/blob/master/spark/hdfs.ipynb) * [hdfs](http://nbviewer.ipython.org/github/donnemartin/ipython-data-notebooks/blob/master/spark/hdfs.ipynb)
* [spark](http://nbviewer.ipython.org/github/donnemartin/ipython-data-notebooks/blob/master/spark/spark.ipynb)
## commands ## commands

65
spark/spark.ipynb Normal file
View File

@ -0,0 +1,65 @@
{
"metadata": {
"name": "",
"signature": "sha256:91816797cb89d9542e7443d05f797ce60e70a74be3a870823401ce7b3e7c3313"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Spark\n",
"\n",
"* Python Shell"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Python Shell"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Start the pyspark shell:"
]
},
{
"cell_type": "code",
"collapsed": false,
"input": [
"pyspark"
],
"language": "python",
"metadata": {},
"outputs": []
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"View the spark context:"
]
},
{
"cell_type": "code",
"collapsed": false,
"input": [
"sc"
],
"language": "python",
"metadata": {},
"outputs": []
}
],
"metadata": {}
}
]
}