stopping a process usgin an RDD

[domibd]

Hello,

Is there a way to stop under a condition a process (like map-reduce) using 
an RDD ?

(this could be use if the process does not always need to
 explore all the RDD)

thanks

Dominique





--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/stopping-a-process-usgin-an-RDD-tp25870.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: efficient checking the existence of an item in a rdd

[domibd]

thanks a lot.

It is very interesting.

Unfortunatly it does not solve my very simple problem :
efficiently find whether a value is in a huge rdd.

thanks again

Dominique

Le 31/12/2015 01:26, madaan.amanmadaan [via Apache Spark User List] a 
écrit :
> Hi,
>
> Check out https://github.com/amplab/spark-indexedrdd, might be helpful.
>
> Aman
>
> On Wed, Dec 30, 2015 at 12:13 PM, domibd [via Apache Spark User List]
> <[hidden email] > wrote:
>
> hello,
>
> how can i check the existence of an item in a very large rdd
> in a prallelised way such that the process stop as soon as
> the item is found (if it is found)?
>
> thanks a lot
>
> Dominique
>
> 
> If you reply to this email, your message will be added to the
> discussion below:
> 
> http://apache-spark-user-list.1001560.n3.nabble.com/efficient-checking-the-existence-of-an-item-in-a-rdd-tp25839.html
>
> To start a new topic under Apache Spark User List, email [hidden
> email] 
> To unsubscribe from Apache Spark User List, click here.
> NAML
> 
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
>
>
>
>
> --
> -Aman
>
>
> 
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-spark-user-list.1001560.n3.nabble.com/efficient-checking-the-existence-of-an-item-in-a-rdd-tp25839p25840.html
>
> To unsubscribe from efficient checking the existence of an item in a
> rdd, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code=25839=ZGJAbGlwbi51bml2LXBhcmlzMTMuZnJ8MjU4Mzl8LTg5MTQ4NTg5NQ==>.
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer=instant_html%21nabble%3Aemail.naml=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> !DSPAM:152,56847c15223168992667645!




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/efficient-checking-the-existence-of-an-item-in-a-rdd-tp25839p25845.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.