Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/22912
Thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user KyleLi1985 commented on the issue:
https://github.com/apache/spark/pull/22893
> So the pull request right now doesn't reflect what you tested, but you
tested the version pasted above. You're saying that the optimization just never
helps the dense-dense case, and sqdist is
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22932#discussion_r230547020
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcSourceSuite.scala
---
@@ -314,6 +316,21 @@ abstract class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22932
**[Test build #98420 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98420/testReport)**
for PR 22932 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22932
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22932
**[Test build #98421 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98421/testReport)**
for PR 22932 at commit
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/22932
[SPARK-25102][SQL] Write Spark version to ORC/Parquet file metadata
## What changes were proposed in this pull request?
Currently, Spark writes Spark version number into Hive Table
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22920#discussion_r230546330
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonBenchmark.scala
---
@@ -158,26 +166,78 @@ object JSONBenchmark
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22912
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22930
**[Test build #98422 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98422/testReport)**
for PR 22930 at commit
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22930
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22930
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22930
**[Test build #98423 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98423/testReport)**
for PR 22930 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22932
**[Test build #98420 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98420/testReport)**
for PR 22932 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22930
**[Test build #98419 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98419/testReport)**
for PR 22930 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98419/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22913
**[Test build #98418 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98418/testReport)**
for PR 22913 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22923
**[Test build #98416 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98416/testReport)**
for PR 22923 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22913
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22913
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98418/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22914
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98417/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22914
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98420/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22914
**[Test build #98417 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98417/testReport)**
for PR 22914 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22923
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98416/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22923
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22255
Just to confirm it. `created_by` is set to `parquet-mr version 1.10.0
(build 031a6654009e3b82020012a18434c582bd74c73a)`?
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22255
It seems to cause some inconsistency if we choose one of
`org.apache.spark.sql.create.version` or `spark.sql.create.version` as a key?
1) If we choose `spark.sql.create.version` as a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22255
Hi, All.
New PR is made. Please move to https://github.com/apache/spark/pull/22932
for further discussion.
---
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98422/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22930
**[Test build #98422 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98422/testReport)**
for PR 22930 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22932
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22255
That is the value used by Parquet-MR library. We had better not to touch
it. Parquet MR reader can work differently based on that versions to handle
some older Parquet writer bugs.
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22920
@MaxGekk .
1. Could you review https://github.com/MaxGekk/spark-1/pull/14 and merge
that?
I recovered the iteration number and update the result on EC2.
2. Also, please
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22930
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98423/
Test PASSed.
---
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22683
cc @ajbozarth
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22855
Oops, something to do with the benchmark class:
```
[error]
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22892
@cloud-fan @ueshin I'm not sure, but I'm seeing this failure regularly in
master builds and I wonder if this could be the cause? in two builds it started
failing with this (and another) change:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22933
**[Test build #4411 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4411/testReport)**
for PR 22933 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22930
**[Test build #98423 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98423/testReport)**
for PR 22930 at commit
GitHub user HyukjinKwon reopened a pull request:
https://github.com/apache/spark/pull/22919
[SPARK-25906][SHELL] Documents '-I' option (from Scala REPL) in spark-shell
## What changes were proposed in this pull request?
Looks we mistakenly changed `-i` option behaviour at
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/22693#discussion_r230554142
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala ---
@@ -115,26 +116,45 @@ class ResolveHiveSerdeTable(session:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22855
**[Test build #4410 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4410/testReport)**
for PR 22855 at commit
GitHub user litao1223 opened a pull request:
https://github.com/apache/spark/pull/22935
Branch 2.2
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this
Github user KyleLi1985 commented on the issue:
https://github.com/apache/spark/pull/22893
> OK, the Spark part doesn't seem relevant. The input might be more
realistic here, yes. I was commenting that your test code doesn't show what
you're testing, though I understand you manually
GitHub user gbloisi opened a pull request:
https://github.com/apache/spark/pull/22936
Support WITH clause (CTE) in subqueries
Because of SPARK-17590 support of WITH clause (CTE) in subqueries requires
only grammar support.
Test for augmented syntax is provided.
You can
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22936
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22936
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22914
**[Test build #98426 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98426/testReport)**
for PR 22914 at commit
Github user HyukjinKwon closed the pull request at:
https://github.com/apache/spark/pull/22919
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user arman1371 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22889#discussion_r230554936
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -883,6 +883,31 @@ class Dataset[T] private[sql](
join(right,
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/22889#discussion_r230557937
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -883,6 +883,31 @@ class Dataset[T] private[sql](
join(right,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22936
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22920
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22920
**[Test build #98424 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98424/testReport)**
for PR 22920 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22920
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22920
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98424/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22933
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user AlexHagerman opened a pull request:
https://github.com/apache/spark/pull/22933
[SPARK-25933][DOCUMENTATION] Fix pstats.Stats() reference in
configuration.md
## What changes were proposed in this pull request?
Change ptats.Stats() to pstats.Stats() for
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22933
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/22889#discussion_r230554727
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -883,6 +883,31 @@ class Dataset[T] private[sql](
join(right,
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22893
OK, the Spark part doesn't seem relevant. The input might be more realistic
here, yes. I was commenting that your test code doesn't show what you're
testing, though I understand you manually
Github user litao1223 closed the pull request at:
https://github.com/apache/spark/pull/22935
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22930
cc @gatorsmile @gengliangwang @maropu
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22934
Thank you for taking care of this, @wangyum .
nit. We are using `[BUILD]` or `[INFRA]` tag for this kind of work. Maybe,
can we use `[INFRA]` consistently?
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22920
Thank you, @MaxGekk and @HyukjinKwon !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22919
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22919
**[Test build #98425 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98425/testReport)**
for PR 22919 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22919#discussion_r230554256
--- Diff: bin/spark-shell2.cmd ---
@@ -20,7 +20,13 @@ rem
rem Figure out where the Spark framework is installed
call
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22919
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22919#discussion_r230554455
--- Diff: bin/spark-shell2.cmd ---
@@ -20,7 +20,13 @@ rem
rem Figure out where the Spark framework is installed
call
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/19796#discussion_r230554452
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/internal/CatalogSuite.scala ---
@@ -519,6 +518,28 @@ class CatalogSuite
}
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22914
**[Test build #98426 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98426/testReport)**
for PR 22914 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22855
**[Test build #4410 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4410/testReport)**
for PR 22855 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22934
Maybe add https://github.com/apache/spark/pull/22849
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22088
cc @jiangxb1987
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22935
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22935
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22932
**[Test build #98429 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98429/testReport)**
for PR 22932 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22932
**[Test build #98430 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98430/testReport)**
for PR 22932 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22920
**[Test build #98424 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98424/testReport)**
for PR 22920 at commit
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/22889#discussion_r230555316
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -883,6 +883,31 @@ class Dataset[T] private[sql](
join(right,
GitHub user wangyum opened a pull request:
https://github.com/apache/spark/pull/22934
[BUILD] Close stale PRs
Closes https://github.com/apache/spark/pull/22859
Closes https://github.com/apache/spark/pull/22591
Closes https://github.com/apache/spark/pull/22322
Closes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22934
**[Test build #98427 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98427/testReport)**
for PR 22934 at commit
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22626#discussion_r230559020
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/UnivocityGenerator.scala
---
@@ -15,18 +15,17 @@
* limitations under the
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/22626#discussion_r230559006
--- Diff: sql/core/src/test/resources/sql-tests/inputs/csv-functions.sql ---
@@ -15,3 +15,10 @@ CREATE TEMPORARY VIEW csvTable(csvField, a) AS SELECT *
Github user arman1371 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22889#discussion_r230559472
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -883,6 +883,31 @@ class Dataset[T] private[sql](
join(right,
1 - 100 of 186 matches
Mail list logo
