Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14182
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63452/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14182
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user yhuai commented on the issue:
https://github.com/apache/spark/pull/14500
@liancheng Can you do a post-hoc review?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enab
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14500
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the fe
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14182
**[Test build #63453 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63453/consoleFull)**
for PR 14182 at commit
[`14feaa0`](https://github.com/apache/spark/commit/1
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14500#discussion_r74123952
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala ---
@@ -425,6 +430,111 @@ case class AlterTableDropPartitionCommand(
Github user junyangq commented on a diff in the pull request:
https://github.com/apache/spark/pull/14258#discussion_r74125149
--- Diff: R/pkg/R/sparkR.R ---
@@ -365,6 +365,23 @@ sparkR.session <- function(
}
overrideEnvs(sparkConfigMap, paramMap)
}
+ #
Github user junyangq commented on a diff in the pull request:
https://github.com/apache/spark/pull/14258#discussion_r74125426
--- Diff: R/pkg/R/install.R ---
@@ -0,0 +1,230 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14531
**[Test build #63454 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63454/consoleFull)**
for PR 14531 at commit
[`45b51d1`](https://github.com/apache/spark/commit/4
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14531
**[Test build #63454 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63454/consoleFull)**
for PR 14531 at commit
[`45b51d1`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14531
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63454/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14531
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74127228
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala ---
@@ -229,10 +230,8 @@ case class AlterTableSetPropertiesCommand(
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14384
**[Test build #63451 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63451/consoleFull)**
for PR 14384 at commit
[`5535736`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14384
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63451/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14384
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74128927
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala
---
@@ -93,7 +92,7 @@ class DDLSuite extends QueryTest with SharedSQLC
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74129515
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala
---
@@ -689,4 +689,38 @@ class HiveDDLSuite
))
}
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74129714
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala ---
@@ -81,6 +86,19 @@ private[spark] class HiveExternalCatalog(client:
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74130034
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala ---
@@ -81,6 +86,19 @@ private[spark] class HiveExternalCatalog(client:
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74130452
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala ---
@@ -144,16 +162,101 @@ private[spark] class HiveExternalCatalog(clien
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14258
**[Test build #63455 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63455/consoleFull)**
for PR 14258 at commit
[`d84ba06`](https://github.com/apache/spark/commit/d
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14258
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74130831
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala ---
@@ -363,3 +503,82 @@ private[spark] class HiveExternalCatalog(client:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14258
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63455/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14258
**[Test build #63455 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63455/consoleFull)**
for PR 14258 at commit
[`d84ba06`](https://github.com/apache/spark/commit/
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74131072
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala ---
@@ -70,64 +69,16 @@ private[hive] class HiveMetastoreCatalog(sparkSe
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/14155#discussion_r74131369
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCommandSuite.scala
---
@@ -18,21 +18,32 @@
package org.apache.spark.sql.hive.ex
Github user yhuai commented on the issue:
https://github.com/apache/spark/pull/14155
Thank you for working on this! It's great to see we are moving those hacks
into `HiveExternalCatalog`. It will be very helpful if we can have two diagrams
to show how we use CatalogTable before and af
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14182
**[Test build #63453 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63453/consoleFull)**
for PR 14182 at commit
[`14feaa0`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14182
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14258
**[Test build #63456 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63456/consoleFull)**
for PR 14258 at commit
[`3aeb4eb`](https://github.com/apache/spark/commit/3
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14182
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63453/
Test PASSed.
---
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/14500#discussion_r74132132
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala ---
@@ -425,6 +430,111 @@ case class AlterTableDropPartitionCommand(
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/14500#discussion_r74132414
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala ---
@@ -425,6 +430,111 @@ case class AlterTableDropPartitionCommand(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11157
**[Test build #63449 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63449/consoleFull)**
for PR 11157 at commit
[`af9b19b`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63449/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11157
**[Test build #63445 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63445/consoleFull)**
for PR 11157 at commit
[`4ff5de4`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63445/
Test FAILed.
---
Github user HyukjinKwon closed the pull request at:
https://github.com/apache/spark/pull/14560
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14531
**[Test build #63457 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63457/consoleFull)**
for PR 14531 at commit
[`6180e80`](https://github.com/apache/spark/commit/6
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14560
Thanks for your feedback!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and w
Github user wangmiao1981 commented on the issue:
https://github.com/apache/spark/pull/14182
@felixcheung I addressed your comments. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have thi
GitHub user tedyu opened a pull request:
https://github.com/apache/spark/pull/14568
SPARK-10868 monotonicallyIncreasingId() supports offset for indexing
## What changes were proposed in this pull request?
This PR adds offset to monotonicallyIncreasingId()
## How was
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11157
**[Test build #63448 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63448/consoleFull)**
for PR 11157 at commit
[`2b192a1`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63448/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14531#discussion_r74135550
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -80,13 +83,49 @@ case class CreateTableLikeCommand(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14568
**[Test build #63458 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63458/consoleFull)**
for PR 14568 at commit
[`4a4e247`](https://github.com/apache/spark/commit/4
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14568
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63458/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14568
**[Test build #63458 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63458/consoleFull)**
for PR 14568 at commit
[`4a4e247`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14568
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14258
**[Test build #63456 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63456/consoleFull)**
for PR 14258 at commit
[`3aeb4eb`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14258
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14258
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63456/
Test PASSed.
---
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14568
Add a test?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14550
After an investigation, Hive does not have such a field. Thus, they also
put it in the table properties/parameters.
For example, this is the output of one table with table comment `d`
GitHub user jupblb opened a pull request:
https://github.com/apache/spark/pull/14569
Fixed typo
## What changes were proposed in this pull request?
Fixed small typo - "value ... ~~in~~ is null"
## How was this patch tested?
Still compiles!
You can merge th
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14550#discussion_r74137525
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala
---
@@ -135,7 +135,9 @@ class HiveDDLSuite
sql(s"CR
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14568
**[Test build #63459 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63459/consoleFull)**
for PR 14568 at commit
[`46ea8a4`](https://github.com/apache/spark/commit/4
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14568#discussion_r74137649
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/MonotonicallyIncreasingID.scala
---
@@ -40,13 +40,14 @@ import org.apache
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14569
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user tedyu commented on a diff in the pull request:
https://github.com/apache/spark/pull/14568#discussion_r74138850
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/MonotonicallyIncreasingID.scala
---
@@ -40,13 +40,14 @@ import org.apache.spar
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14544
**[Test build #63446 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63446/consoleFull)**
for PR 14544 at commit
[`ef3297d`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14544
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14544
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63446/
Test PASSed.
---
Github user ajbozarth commented on the issue:
https://github.com/apache/spark/pull/12990
@tgravescs I will look into a different solution for this issue (seems
@tankkyo has vanished) If I'm understanding you correctly you're suggesting
modifying the way the History Server caches appli
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14552
**[Test build #63460 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63460/consoleFull)**
for PR 14552 at commit
[`880a1f4`](https://github.com/apache/spark/commit/8
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14569
OK. Feel free to look for other typos to include in a PR like this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project doe
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14569
Jenkins test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14569
**[Test build #63461 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63461/consoleFull)**
for PR 14569 at commit
[`1b17aff`](https://github.com/apache/spark/commit/1
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/11157
**[Test build #63450 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63450/consoleFull)**
for PR 11157 at commit
[`50a34b8`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user tejasapatil closed the pull request at:
https://github.com/apache/spark/pull/14475
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14568#discussion_r74140971
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/MonotonicallyIncreasingID.scala
---
@@ -40,13 +40,14 @@ import org.apache
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/11157
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63450/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14568
**[Test build #63462 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63462/consoleFull)**
for PR 14568 at commit
[`ea77d78`](https://github.com/apache/spark/commit/e
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/14570
[SPARK-10601][SQL] Support `MINUS` set operator
## What changes were proposed in this pull request?
This PR adds `MINUS` set operator which is equivalent `EXCEPT DISTINCT`.
This will
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14568
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63462/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14568
**[Test build #63462 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63462/consoleFull)**
for PR 14568 at commit
[`ea77d78`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14568
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/12990
Yeah. That might be a much larger change though too. Ideally the history
server is smart and can load just meta data quickly to list application, then
if application actually clicked it would loa
GitHub user tejasapatil reopened a pull request:
https://github.com/apache/spark/pull/14475
[SPARK-16862] Configurable buffer size in `UnsafeSorterSpillReader`
## What changes were proposed in this pull request?
Jira: https://issues.apache.org/jira/browse/SPARK-16862
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14570
**[Test build #63463 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63463/consoleFull)**
for PR 14570 at commit
[`0cf8f43`](https://github.com/apache/spark/commit/0
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14511
**[Test build #63464 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63464/consoleFull)**
for PR 14511 at commit
[`81f2b1c`](https://github.com/apache/spark/commit/8
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14475
**[Test build #63465 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63465/consoleFull)**
for PR 14475 at commit
[`6ce70a9`](https://github.com/apache/spark/commit/6
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14570
Could you review this PR when you have some time, @hvanhovell ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14568
**[Test build #63466 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63466/consoleFull)**
for PR 14568 at commit
[`81e342d`](https://github.com/apache/spark/commit/8
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13680
**[Test build #63467 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63467/consoleFull)**
for PR 13680 at commit
[`d9a269d`](https://github.com/apache/spark/commit/d
Github user shivaram commented on the issue:
https://github.com/apache/spark/pull/14431
Sure - Appending more information to the R object is fine. Also it looks
like we actually have a handle to the RelationalGroupedDataset when we call
groupBy on the scala side
https://github.com/a
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14570
LGTM - I'll merge as soon as test pass.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14570
Thank you so much, @hvanhovell !
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enab
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14568#discussion_r74145557
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -993,12 +993,31 @@ object functions {
* This expression would return
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14568#discussion_r74145985
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/MonotonicallyIncreasingID.scala
---
@@ -40,13 +40,14 @@ import org.apache.spark
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14568
A high-level question: is it a problem when the offset is larger than `1 <<
33`? I can't really think of one.
---
If your project is set up for it, you can reply to this email and have your
repl
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14527
**[Test build #63468 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63468/consoleFull)**
for PR 14527 at commit
[`fdeb02e`](https://github.com/apache/spark/commit/f
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/14558#discussion_r74146966
--- Diff: .gitignore ---
@@ -77,3 +77,8 @@ spark-warehouse/
# For R session data
.RData
.RHistory
+.Rhistory
--- End diff --
Du
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14568
So I'm still confused what offset does, even after reading the code. Can
you please write a more clear documentation? An example would help.
Also let's update the Python API as well, and add an
301 - 400 of 768 matches
Mail list logo
