Monday, August 15, 2016

Install iPython (Jupyter) Notebook on Amazon EMR


  1. Use the bootstrap script on this link to install iPython Notebook: https://github.com/awslabs/emr-bootstrap-actions/tree/master/ipython-notebook
  2. Although the iPython server is running, it's not integrated with Spark. Follow the instructions according to this blog post: https://districtdatalabs.silvrback.com/getting-started-with-spark-in-python
  3. Create the initial SparkContext and SQL context as follows:

from pyspark import  SparkContext
sc = SparkContext( 'local', 'pyspark')
from pyspark.sql import SQLContext
sqlContext = SQLContext(sc)

10 comments:

  1. Much thanks for sharing such an advisable post. It was an interesting read. The best way to get rid of the writing blues is to hire expert and knowledgeable writing professionals from the MyAssignmentHelpAU platform. The Ph.D. or Master’s qualified Thesis Writing Help expert associated with the platform leaves no stone unturned to share accurately referenced, perfectly polished, and precisely written scholarly assignments with students at highly economical prices.

    ReplyDelete
  2. It as really a great and helpful piece of info. I am glad that you shared this helpful info with us. Please keep us up to date like this. Thank you for sharing. 경마사이트

    ReplyDelete
  3. Good article. I absolutely love this site.
    Thanks! 토 토

    ReplyDelete
  4. This article was written by a real thinking writer without a doubt. I agree many of the with the solid points made by the writer. I’ll be back day in and day for further new updates. 토토사이트

    ReplyDelete
  5. Many thanks for the article, I have a lot of spray lining knowledge but always learn something new. Keep up the good work and thank you again. 경마

    ReplyDelete
  6. I’m writing on this topic these days, , but I have stopped writing because there is no reference material. Then I accidentally found your article. I can refer to a variety of materials, so I think the work I was preparing will work! Thank you for your efforts. 바카라사이트

    ReplyDelete
  7. You completely match our expectation and the variety of our information 토토사이트

    ReplyDelete