Depth First Search in GraphX

[abagavat]

Has anyone come across involving Depth First Search in Spark GraphX?

Just wondering if that could be possible with Spark GraphX. I searched a
lot. But found just results of BFS. If someone have an idea about it, please
share with me. I would love to learn about it's possibility in Spark GraphX.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Data from HDFS

[Zois Theodoros]

Hello,

I am reading data from HDFS in a Spark application and as far as I read 
each HDFS block is 1 partition for Spark by default. Is there any way to 
select only 1 block from HDFS to read in my Spark application?


Thank you,
Thodoris


-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Problem running Kubernetes example v2.2.0-kubernetes-0.5.0

[Felix Cheung]

You might want to check with the spark-on-k8s
Or try using kubernetes from the official spark 2.3.0 release. (Yes we don't 
have an official docker image though but you can build with the script)


From: Rico Bergmann 
Sent: Wednesday, April 11, 2018 11:02:38 PM
To: user@spark.apache.org
Subject: Problem running Kubernetes example v2.2.0-kubernetes-0.5.0

Hi!

I was trying to get the SparkPi example running using the spark-on-k8s
distro from kubespark. But I get the following error:
+ /sbin/tini -s -- driver
[FATAL tini (11)] exec driver failed: No such file or directory

Did anyone get the example running on a Kubernetes cluster?

Best,
Rico.

invoked cmd:
bin/spark-submit \
  --deploy-mode cluster \
  --class org.apache.spark.examples.SparkPi \
  --master k8s://https://cluster:port \
  --conf spark.executor.instances=2 \
  --conf spark.app.name=spark-pi \
  --conf
spark.kubernetes.container.docker.image=kubespark/spark-driver:v2.2.0-kubernetes-0.5.0
\
  --conf
spark.kubernetes.driver.docker.image=kubespark/spark-driver:v2.2.0-kubernetes-0.5.0
\
  --conf
spark.kubernetes.executor.docker.image=kubespark/spark-executor:v2.2.0-kubernetes-0.5.0
\

local:///opt/spark/examples/jars/spark-examples_2.11-v2.2.0-kubernetes-0.5.0.jar

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org