*To:* Pagliari, Roberto
*Cc:* user@spark.apache.org
*Subject:* Re: indexing an RDD [Python]
The solution depends largely on your use case. I assume the index is in
the key. In that case, you can make a second RDD out of the list of indices
and then use cogroup() on both.
If the list of indices is small
the values and preserve the original ones.
Thank you,
From: Sven Krasser [mailto:kras...@gmail.com]
Sent: Friday, April 24, 2015 5:56 PM
To: Pagliari, Roberto
Cc: user@spark.apache.org
Subject: Re: indexing an RDD [Python]
The solution depends largely on your use case. I assume the index is in the
key
I have an RDD of LabledPoints.
Is it possible to select a subset of it based on a list of indeces?
For example with idx=[0,4,5,6,8], I'd like to be able to create a new RDD with
elements 0,4,5,6 and 8.
-
To unsubscribe,
The solution depends largely on your use case. I assume the index is in the
key. In that case, you can make a second RDD out of the list of indices and
then use cogroup() on both.
If the list of indices is small, just using filter() will work well.
If you need to read back a few select values to
