Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21121
Sure, closing ...
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21121
@mn-mikke I think we can close this since we've added `transform` which can
take the index argument as suggested.
---
-
To
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21121
@rxin Oh, I see. In that case, I'm happy to close the PR. @hvanhovell Can
you confirm that the `transform` function will pass the index into lambda
functions?
---
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21121
@lokm01 wouldn't @ueshin's suggestion on adding a second parameter to
transform work for you? You can just do something similar to `transform(x,
(entry, index) -> struct(entry, index))`. Perhaps
Github user Tagar commented on the issue:
https://github.com/apache/spark/pull/21121
Would this cover https://issues.apache.org/jira/browse/SPARK-23074 as well?
Thanks.
---
-
To unsubscribe, e-mail:
Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21121
@ueshin What about combining `zip_with_index` with
[`map_from_entries`](https://issues.apache.org/jira/browse/SPARK-23934)?
---
Github user lokm01 commented on the issue:
https://github.com/apache/spark/pull/21121
@ueshin Currently we use our own implementation of zipWithIndex when we do
explode and need to preserve the ordering of the array elements (especially if
there is a shuffle involved in the
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21121
I'm not sure we really need this function.
If the purpose is only for `transform` function you mentionsed at
https://github.com/apache/spark/pull/21121#issuecomment-383319312, how about
adding a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89888/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89888 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89888/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89887/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89887 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89887/testReport)**
for PR 21121 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89888 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89888/testReport)**
for PR 21121 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89887 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89887/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89857/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89857 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89857/testReport)**
for PR 21121 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89857 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89857/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89838/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89838 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89838/testReport)**
for PR 21121 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89838 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89838/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89804/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89804 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89804/testReport)**
for PR 21121 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89804 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89804/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89803 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89803/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89803/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89803 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89803/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89802/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89802 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89802/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89686/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89686 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89686/testReport)**
for PR 21121 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89686 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89686/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89683 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89683/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89683/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89683 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89683/testReport)**
for PR 21121 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/89679/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89679 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89679/testReport)**
for PR 21121 at commit
Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21121
@gatorsmile I'm not aware of any. From user experience, I strongly feel
that such a function is missing. Escpecially, when
[transform](https://issues.apache.org/jira/browse/SPARK-23908) function
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21121
Which database has this function?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21121
**[Test build #89679 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/89679/testReport)**
for PR 21121 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21121
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mn-mikke commented on the issue:
https://github.com/apache/spark/pull/21121
cc @gatorsmile @ueshin @kiszk
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21121
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
54 matches
Mail list logo
