hadoop - Spark Standalone Mode: Worker not starting properly in cloudera -


i new spark, after installing spark using parcels available in cloudera manager.

i have configured files shown in below link cloudera enterprise:

http://www.cloudera.com/content/cloudera-content/cloudera-docs/cm4ent/4.8.1/cloudera-manager-installation-guide/cmig_spark_installation_standalone.html

after setup, have started nodes in spark running /opt/cloudera/parcels/spark/lib/spark/sbin/start-all.sh. couldn't run worker nodes got specified error below.

[root@localhost sbin]# sh start-all.sh org.apache.spark.deploy.master.master running process 32405. stop first. root@localhost.localdomain's password:  localhost.localdomain: starting org.apache.spark.deploy.worker.worker, logging /var/log/spark/spark-root-org.apache.spark.deploy.worker.worker-1-localhost.localdomain.out localhost.localdomain: failed launch org.apache.spark.deploy.worker.worker: localhost.localdomain:      @ java.lang.classloader.loadclass(libgcj.so.10) localhost.localdomain:      @ gnu.java.lang.mainthread.run(libgcj.so.10) localhost.localdomain: full log in /var/log/spark/spark-root-org.apache.spark.deploy.worker.worker-1-localhost.localdomain.out localhost.localdomain:starting org.apac

when run jps command, got:

23367 jps 28053 quorumpeermain 28218 secondarynamenode 32405 master 28148 datanode 7852 main 28159 namenode

i couldn't run worker node properly. thought install standalone spark master , worker work on single machine. in slaves file of spark directory, given address "localhost.localdomin" host name. not aware of settings file. please 1 cloud me out installation process. couldn't run worker nodes. can start master node.

thanks & regards, bips

please notice error info below:

localhost.localdomain:      @ java.lang.classloader.loadclass(libgcj.so.10)

i met same error when installed , started spark master/workers on centos 6.2 x86_64 after making sure libgcj.x86_64 , libgcj.i686 had been installed on server, solved it. below solution, wish can you.

seem if java_home environment parameter didn't set correctly.
maybe, java_home links system embedded java, e.g. java version "1.5.0".
spark needs java version >= 1.6.0. if using java 1.5.0 start spark, see error info.
try export java_home="your java home path", start spark again.


Comments

Post a Comment

Popular posts from this blog

get url and add instance to a model with prefilled foreign key :django admin -

Image
i have page in each contest shown in row. each row contains contest id , link other model names have foreign key contest. news model: class news(models.model): title = models.charfield(max_length=50, null=true) description = models.textfield() time = models.timefield( default= datetime.datetime.now().time()) contest = models.foreignkey(contest) i want use admin adding , changing these models. want when user clicks on 'news' has foreign key contest id=1, shows list of news value foreign key. use {% instance in instances %} <tr class="{% cycle 'row1' 'row2' %}"> <td>{{ instance.title }}</td> <td>{{ instance.starttime }}</td> <td>{{ instance.timespan }}</td> <td>{{ instance.date }}</td> <td><a href="/adm...
Read more

android - Keyboard hides my half of edit-text and button below it even in scroll view -

i having trouble keyboard covers edit-text , half of button in scroll view. here's layout , please tell me how should resolve problem. many questions on topic none of them s working me. <?xml version="1.0" encoding="utf-8"?> <linearlayout xmlns:android="http://schemas.android.com/apk/res/android" android:layout_width="match_parent" android:background="@drawable/bg" android:layout_height="match_parent"> <scrollview android:layout_width="match_parent" android:fillviewport="true" android:layout_height="match_parent"> <relativelayout android:layout_width="match_parent" android:layout_height="wrap_content" android:orientation="vertical"> <linearlayout android:layout_width="match_parent" android:layout_height="w...
Read more

css - Make div keyboard-scrollable in jQuery Mobile? -

from can tell, although jquery-mobile-powered pages can contain divs overflow set scroll or auto, , these divs can scrolled one-screen bar or mouse wheel, cannot scrolled using arrow keys, page-up/page-down, or home/end. instead, official "page" div (with data-role="page") absorbs input. perhaps other divs can't acquire focus, i'm not sure. is there way around this? edit: jsfiddle of simple example: https://jsfiddle.net/qogz0shx/ <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.1.4/jquery.min.js"></script> <script src="https://ajax.googleapis.com/ajax/libs/jquerymobile/1.4.5/jquery.mobile.min.js"> </script> <link rel="stylesheet" href="https://code.jquery.com/mobile/1.4.5/jquery.mobile-1.4.5.css"/> <style> #outer { overflow:scroll; height: 50vh; width: 50vw; } #inner { height: 500vh; width: 500vw; } ...
Read more