Thursday, July 7, 2016

Unstuck Spark/Zeppelin Jobs on Amazon EMR

Apache Zeppelin + Apache Spark is a perfect match. Basically, you can do the following in one console:

  • Data Ingestion
  • Data Discovery
  • Data Analytics
  • Data Visualization & Collaboration
As it's still under incubation, the error handling is still not as rock solid. Often, I have experienced Spark jobs being stuck for long time. Usually, restarting the Spark interpreter should do the trick. However, there are times that this simple trick won't work and the only way is to restart the Zeppelin daemon. On Amazon EMR console, do the following:
  1. /usr/lib/zeppelin/bin/zeppelin-daemon.sh stop
  2. /usr/lib/zeppelin/bin/zeppelin-daemon.sh start
If you wish to execute the scripts in zepplin account, which has a nologin shell. Execute following instead:
  1. sudo -s /bin/bash -c '/usr/lib/zeppelin/bin/zeppelin-daemon.sh stop' zeppelin
  2. sudo -s /bin/bash -c '/usr/lib/zeppelin/bin/zeppelin-daemon.sh start' zeppelin
If you encounter this Java connection error: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method), it's probably because Zeppelin starts the spark interpreter in a different process.

  1. Edit /etc/spark/conf/spark-defaults.conf
  2. Comment off the following line and restart Zeppelin

#spark.driver.memory              5g
Reference: http://stackoverflow.com/questions/32735645/hello-world-in-zeppelin-failed

    11 comments:

    1. the blog is very interesting and will be much useful for us. thank you for sharing the blog with us. please keep on updating.
      Informatica Training in Chennai ECR

      ReplyDelete
    2. All the points you described so beautiful. Every time i read your i blog and i am so surprised that how you can write so well.
      python training in rajajinagar
      Python training in bangalore
      Python training in usa

      ReplyDelete
    3. A universal message I suppose, not giving up is the formula for success I think. Some things take longer than others to accomplish, so people must understand that they should have their eyes on the goal, and that should keep them motivated to see it out til the end.

      Data Science course in rajaji nagar
      Data Science with Python course in chenni
      Data Science course in electronic city
      Data Science course in USA
      Data science course in pune | Data Science Training institute in Pune

      ReplyDelete
    4. Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us and I never get bored while reading your article because, they are becomes a more and more interesting from the starting lines until the end.
      Best Devops training in sholinganallur
      Devops training in velachery
      Devops training in annanagar
      Devops training in tambaram

      ReplyDelete
    5. Whoa! I’m enjoying the template/theme of this website. It’s simple, yet effective. A lot of times it’s very hard to get that “perfect balance” between superb usability and visual appeal. I must say you’ve done a very good job with this.
      AWS Training in Bangalore |Best AWS Training Institute in Bangalore BTM, Marathahalli
      AWS Training in Chennai | AWS Training Institute in Chennai Velachery, Tambaram, OMR

      ReplyDelete
    6. Nice information, valuable and excellent design, as share good stuff with good ideas and concepts, lots of great information and inspiration, both of which I need, thanks to offer such a helpful information here.
      angularjs Training in chennai

      angularjs Training in chennai

      angularjs-Training in tambaram

      angularjs-Training in sholinganallur

      angularjs-Training in velachery

      angularjs-Training in pune

      ReplyDelete
    7. Very nice post here and thanks for it .I always like and such a super contents of these post.
      Excellent and very cool idea and great content of different kinds of the valuable information's.
      Java training in Bangalore|best Java training in Bangalore
      Java training in Chennai
      Java training in Bangalore
      Java online training
      Java training in Pune

      ReplyDelete

    8. Inspiring writings and I greatly admired what you have to say , I hope you continue to provide new ideas for us all and greetings success always for you.
      Keep update more information..


      Selenium training in bangalore
      Selenium training in Chennai
      Selenium training in Bangalore
      Selenium training in Pune
      Selenium Online training
      Selenium interview questions and answers

      ReplyDelete