Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16030
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69611/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16120
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69610/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16120
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16098
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69614/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16030
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16098
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16120
retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, o
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16120
**[Test build #69615 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69615/consoleFull)**
for PR 16120 at commit
[`a5594f7`](https://github.com/apache/spark/commit/a
Github user eyalfa commented on a diff in the pull request:
https://github.com/apache/spark/pull/16043#discussion_r90752975
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ComplexTypes.scala
---
@@ -0,0 +1,78 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13909
**[Test build #69616 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69616/consoleFull)**
for PR 13909 at commit
[`b29d7cf`](https://github.com/apache/spark/commit/b
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16030
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16030
**[Test build #69617 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69617/consoleFull)**
for PR 16030 at commit
[`1ab3363`](https://github.com/apache/spark/commit/1
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/16129
[SPARK-18678][ML] Skewed feature subsampling in Random forest
## What changes were proposed in this pull request?
Fix reservoir sampling bias for small k. An off-by-one error meant that the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #69618 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69618/consoleFull)**
for PR 16129 at commit
[`8ac5dee`](https://github.com/apache/spark/commit/8
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16102
Merged to master, though as I say I don't think the CVE actually impacted
Spark to begin with.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16102
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16116
Merged to master/2.1/2.0
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16116
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16098
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes s
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16116
Thank you !!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16037
Yes I'm pretty OK with merging this. If you can dig up any results, that's
all the better. Will check in with you next week.
---
If your project is set up for it, you can reply to this email and hav
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16098
**[Test build #69619 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69619/consoleFull)**
for PR 16098 at commit
[`4804862`](https://github.com/apache/spark/commit/4
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16120
**[Test build #69615 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69615/consoleFull)**
for PR 16120 at commit
[`a5594f7`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16120
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69615/
Test PASSed.
---
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r90754731
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -56,6 +56,31 @@ private[kinesis] class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16120
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16103#discussion_r90754782
--- Diff:
mllib/src/main/resources/org/apache/spark/ml/feature/stopwords/english.txt ---
@@ -149,5 +149,58 @@ shan
shouldn
wasn
weren
-won
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16031#discussion_r90754812
--- Diff: core/src/main/resources/org/apache/spark/ui/static/historypage.js
---
@@ -78,6 +78,12 @@ jQuery.extend( jQuery.fn.dataTableExt.oSort, {
}
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16069
Merged to master. It's a build change and probably fine for 2.1 but it's
non-trivial.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16069
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r90754922
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -56,6 +56,31 @@ private[kinesis] class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13909
**[Test build #69616 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69616/consoleFull)**
for PR 13909 at commit
[`b29d7cf`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13909
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13909
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69616/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16030
**[Test build #69617 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69617/consoleFull)**
for PR 16030 at commit
[`1ab3363`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16030
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69617/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16030
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16114
@srowen Do u know qualified maintainers on this component?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not hav
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69620 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69620/consoleFull)**
for PR 16114 at commit
[`f381ac2`](https://github.com/apache/spark/commit/f
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16030
The failure seems to be not related to this pr?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16030
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16030
**[Test build #69621 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69621/consoleFull)**
for PR 16030 at commit
[`1ab3363`](https://github.com/apache/spark/commit/1
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/12004
Test failure due to new artifacts
```
+++ b/dev/pr-deps/spark-deps-hadoop-2.7
@@ -16,8 +16,6 @@ arpack_combined_all-0.1.jar
avro-1.7.7.jar
avro-ipc-1.7.7.jar
avro-mapr
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69620 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69620/consoleFull)**
for PR 16114 at commit
[`f381ac2`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69620/
Test PASSed.
---
Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/11105#discussion_r90755993
--- Diff:
core/src/test/scala/org/apache/spark/DataPropertyAccumulatorSuite.scala ---
@@ -0,0 +1,395 @@
+/*
+ * Licensed to the Apache Software Found
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/11105
I'm down the idea of having add and merge not be final with huge warning
signs and we could switch it up in 3.X to be final.
---
If your project is set up for it, you can reply to this email and ha
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #69618 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69618/consoleFull)**
for PR 16129 at commit
[`8ac5dee`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16129
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69618/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16129
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15995
**[Test build #69623 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69623/consoleFull)**
for PR 15995 at commit
[`b5f4394`](https://github.com/apache/spark/commit/b
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16122
**[Test build #69622 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69622/consoleFull)**
for PR 16122 at commit
[`f8955df`](https://github.com/apache/spark/commit/f
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16068#discussion_r90756326
--- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala
---
@@ -144,7 +144,7 @@ private[hive] case class HiveGenericUDF(
@transie
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/15998#discussion_r90756432
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
---
@@ -519,6 +519,26 @@ private[hive] class HiveClientImpl(
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r90756693
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -56,6 +56,27 @@ private[kinesis] class
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r90756702
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -56,6 +56,27 @@ private[kinesis] class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #3466 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3466/consoleFull)**
for PR 16129 at commit
[`8ac5dee`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16098
**[Test build #69619 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69619/consoleFull)**
for PR 16098 at commit
[`4804862`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16098
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69619/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16098
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16122
**[Test build #69622 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69622/consoleFull)**
for PR 16122 at commit
[`f8955df`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16122
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16122
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69622/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16030
**[Test build #69621 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69621/consoleFull)**
for PR 16030 at commit
[`1ab3363`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16030
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16030
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69621/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16043#discussion_r90757729
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ComplexTypes.scala
---
@@ -0,0 +1,78 @@
+/*
+ * Licensed to the Ap
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/16122
This patch fails because hive-0.12 and hive-0.13 doesn't has `getMetaConf`
method.
see [HIVE-7532](https://issues.apache.org/jira/browse/HIVE-7532),
---
If your project is set up for it, you ca
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69624 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69624/consoleFull)**
for PR 16114 at commit
[`b625b8f`](https://github.com/apache/spark/commit/b
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69624 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69624/consoleFull)**
for PR 16114 at commit
[`b625b8f`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69624/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16122
**[Test build #69625 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69625/consoleFull)**
for PR 16122 at commit
[`19c7611`](https://github.com/apache/spark/commit/1
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r90758182
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -56,6 +56,27 @@ private[kinesis] class
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16114
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15995
**[Test build #69623 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69623/consoleFull)**
for PR 15995 at commit
[`b5f4394`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69626 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69626/consoleFull)**
for PR 16114 at commit
[`b625b8f`](https://github.com/apache/spark/commit/b
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69623/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69626/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69626 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69626/consoleFull)**
for PR 16114 at commit
[`b625b8f`](https://github.com/apache/spark/commit/
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r90758322
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -56,6 +56,27 @@ private[kinesis] class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69627 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69627/consoleFull)**
for PR 16114 at commit
[`8cc24ec`](https://github.com/apache/spark/commit/8
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/16090
If we are going to hack it, how about this?
```
val dataSource = DataSource(...)
if (classOf[FileFormat].isAssignableFrom(dataSource.providingClass)) {
dataSource.getOrInferFileFor
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #3466 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3466/consoleFull)**
for PR 16129 at commit
[`8ac5dee`](https://github.com/apache/spark/commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69627 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69627/consoleFull)**
for PR 16114 at commit
[`8cc24ec`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16122
**[Test build #69625 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69625/consoleFull)**
for PR 16122 at commit
[`19c7611`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69627/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16122
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69625/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16122
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #3467 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3467/consoleFull)**
for PR 16129 at commit
[`8ac5dee`](https://github.com/apache/spark/commit/
Github user zhzhan commented on the issue:
https://github.com/apache/spark/pull/16068
My understanding is that the non-deterministic udf does not need to be
stageful, but a stateful udf has to be non-deterministic.
Here is the comments in hive regarding this property
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16068
Could we directly use `@UDFType(deterministic = true/false)`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16068
Found the link: [HIVE-1994: Support new annotation @UDFType(stateful =
true)](https://issues.apache.org/jira/browse/HIVE-1994 )
---
If your project is set up for it, you can reply to this email
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16068
https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java#L1373-L1378
Copied the code from Hive `FunctionRegistry.java`:
```JAVA
Github user zhzhan commented on the issue:
https://github.com/apache/spark/pull/16068
@gatorsmile we cannot use deterministic = true/false, as there are
existing udf with deterministic as true, but stateful as true as well.
---
If your project is set up for it, you can reply to this
Github user zhzhan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16068#discussion_r90763121
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala
---
@@ -487,6 +488,29 @@ class HiveUDFSuite extends QueryTest with
1 - 100 of 160 matches
Mail list logo