[spark] branch master updated (0549c20 -> a6d6ea3)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly add a6d6ea3 [SPARK-32802][SQL] Avoid using SpecificInternalRow in RunLengthEncoding#Encoder No new revisions were added by this update. Summary of changes: .../CompressionSchemeBenchmark-jdk11-results.txt | 168 ++--- .../CompressionSchemeBenchmark-results.txt | 168 ++--- .../columnar/compression/compressionSchemes.scala | 27 ++-- 3 files changed, 179 insertions(+), 184 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (0549c20 -> a6d6ea3)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly add a6d6ea3 [SPARK-32802][SQL] Avoid using SpecificInternalRow in RunLengthEncoding#Encoder No new revisions were added by this update. Summary of changes: .../CompressionSchemeBenchmark-jdk11-results.txt | 168 ++--- .../CompressionSchemeBenchmark-results.txt | 168 ++--- .../columnar/compression/compressionSchemes.scala | 27 ++-- 3 files changed, 179 insertions(+), 184 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (0549c20 -> a6d6ea3)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly add a6d6ea3 [SPARK-32802][SQL] Avoid using SpecificInternalRow in RunLengthEncoding#Encoder No new revisions were added by this update. Summary of changes: .../CompressionSchemeBenchmark-jdk11-results.txt | 168 ++--- .../CompressionSchemeBenchmark-results.txt | 168 ++--- .../columnar/compression/compressionSchemes.scala | 27 ++-- 3 files changed, 179 insertions(+), 184 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (0549c20 -> a6d6ea3)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly add a6d6ea3 [SPARK-32802][SQL] Avoid using SpecificInternalRow in RunLengthEncoding#Encoder No new revisions were added by this update. Summary of changes: .../CompressionSchemeBenchmark-jdk11-results.txt | 168 ++--- .../CompressionSchemeBenchmark-results.txt | 168 ++--- .../columnar/compression/compressionSchemes.scala | 27 ++-- 3 files changed, 179 insertions(+), 184 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (0549c20 -> a6d6ea3)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly add a6d6ea3 [SPARK-32802][SQL] Avoid using SpecificInternalRow in RunLengthEncoding#Encoder No new revisions were added by this update. Summary of changes: .../CompressionSchemeBenchmark-jdk11-results.txt | 168 ++--- .../CompressionSchemeBenchmark-results.txt | 168 ++--- .../columnar/compression/compressionSchemes.scala | 27 ++-- 3 files changed, 179 insertions(+), 184 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4072665 [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
4072665 is described below
commit 40726650338f2c4906e5bc6841a77712c4d44285
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index 8bf0d6e..d91695c 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -384,7 +384,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new d4d2f5c [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
d4d2f5c is described below
commit d4d2f5c128cf5de98ca18daf30538ad132d99331
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index e7a16a3..557fc18 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -399,7 +399,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4072665 [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
4072665 is described below
commit 40726650338f2c4906e5bc6841a77712c4d44285
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index 8bf0d6e..d91695c 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -384,7 +384,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new d4d2f5c [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
d4d2f5c is described below
commit d4d2f5c128cf5de98ca18daf30538ad132d99331
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index e7a16a3..557fc18 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -399,7 +399,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3d08084 -> 0549c20)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types add 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly No new revisions were added by this update. Summary of changes: docs/quick-start.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4072665 [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
4072665 is described below
commit 40726650338f2c4906e5bc6841a77712c4d44285
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index 8bf0d6e..d91695c 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -384,7 +384,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new d4d2f5c [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
d4d2f5c is described below
commit d4d2f5c128cf5de98ca18daf30538ad132d99331
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index e7a16a3..557fc18 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -399,7 +399,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3d08084 -> 0549c20)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types add 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly No new revisions were added by this update. Summary of changes: docs/quick-start.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4072665 [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
4072665 is described below
commit 40726650338f2c4906e5bc6841a77712c4d44285
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index 8bf0d6e..d91695c 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -384,7 +384,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new d4d2f5c [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
d4d2f5c is described below
commit d4d2f5c128cf5de98ca18daf30538ad132d99331
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index e7a16a3..557fc18 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -399,7 +399,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3d08084 -> 0549c20)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types add 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly No new revisions were added by this update. Summary of changes: docs/quick-start.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 4072665 [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
4072665 is described below
commit 40726650338f2c4906e5bc6841a77712c4d44285
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index 8bf0d6e..d91695c 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -384,7 +384,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new d4d2f5c [SPARK-32865][DOC] python section in quickstart page doesn't
display SPARK_VERSION correctly
d4d2f5c is described below
commit d4d2f5c128cf5de98ca18daf30538ad132d99331
Author: bowen.li
AuthorDate: Sat Sep 12 21:45:55 2020 -0700
[SPARK-32865][DOC] python section in quickstart page doesn't display
SPARK_VERSION correctly
### What changes were proposed in this pull request?
In https://github.com/apache/spark/blame/master/docs/quick-start.md#L402,it
should be `{{site.SPARK_VERSION}}` rather than `{site.SPARK_VERSION}`
### Why are the changes needed?
SPARK_VERSION isn't displayed correctly, as shown below
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
tested locally, as shown below
Closes #29738 from bowenli86/doc.
Authored-by: bowen.li
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 0549c20c6fccc7ff412818d7352b141590f88b1b)
Signed-off-by: Dongjoon Hyun
---
docs/quick-start.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/quick-start.md b/docs/quick-start.md
index e7a16a3..557fc18 100644
--- a/docs/quick-start.md
+++ b/docs/quick-start.md
@@ -399,7 +399,7 @@ If you are building a packaged PySpark application or
library you can add it to
{% highlight python %}
install_requires=[
-'pyspark=={site.SPARK_VERSION}'
+'pyspark=={{site.SPARK_VERSION}}'
]
{% endhighlight %}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3d08084 -> 0549c20)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types add 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly No new revisions were added by this update. Summary of changes: docs/quick-start.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3d08084 -> 0549c20)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types add 0549c20 [SPARK-32865][DOC] python section in quickstart page doesn't display SPARK_VERSION correctly No new revisions were added by this update. Summary of changes: docs/quick-start.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3be552c -> 3d08084)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13 add 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/optimizer/Optimizer.scala | 1 + .../optimizer/UnwrapCastInBinaryComparison.scala | 236 + .../UnwrapCastInBinaryComparisonSuite.scala| 161 ++ .../spark/sql/FileBasedDataSourceSuite.scala | 90 +++- 4 files changed, 487 insertions(+), 1 deletion(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparisonSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3be552c -> 3d08084)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13 add 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/optimizer/Optimizer.scala | 1 + .../optimizer/UnwrapCastInBinaryComparison.scala | 236 + .../UnwrapCastInBinaryComparisonSuite.scala| 161 ++ .../spark/sql/FileBasedDataSourceSuite.scala | 90 +++- 4 files changed, 487 insertions(+), 1 deletion(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparisonSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3be552c -> 3d08084)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13 add 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/optimizer/Optimizer.scala | 1 + .../optimizer/UnwrapCastInBinaryComparison.scala | 236 + .../UnwrapCastInBinaryComparisonSuite.scala| 161 ++ .../spark/sql/FileBasedDataSourceSuite.scala | 90 +++- 4 files changed, 487 insertions(+), 1 deletion(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparisonSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3be552c -> 3d08084)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13 add 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/optimizer/Optimizer.scala | 1 + .../optimizer/UnwrapCastInBinaryComparison.scala | 236 + .../UnwrapCastInBinaryComparisonSuite.scala| 161 ++ .../spark/sql/FileBasedDataSourceSuite.scala | 90 +++- 4 files changed, 487 insertions(+), 1 deletion(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparisonSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (3be552c -> 3d08084)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13 add 3d08084 [SPARK-24994][SQL] Add UnwrapCastInBinaryComparison optimizer to simplify literal types No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/optimizer/Optimizer.scala | 1 + .../optimizer/UnwrapCastInBinaryComparison.scala | 236 + .../UnwrapCastInBinaryComparisonSuite.scala| 161 ++ .../spark/sql/FileBasedDataSourceSuite.scala | 90 +++- 4 files changed, 487 insertions(+), 1 deletion(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparison.scala create mode 100644 sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/UnwrapCastInBinaryComparisonSuite.scala - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark-website] branch asf-site updated: Fix formatting in release notes.
This is an automated email from the ASF dual-hosted git repository. prashant pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new ae6991e Fix formatting in release notes. ae6991e is described below commit ae6991ef625dbcb5c27f71ad45426cdca13f501f Author: Prashant Sharma AuthorDate: Sun Sep 13 04:25:24 2020 + Fix formatting in release notes. --- releases/_posts/2020-09-12-spark-release-2-4-7.md | 37 +++- site/releases/spark-release-2-4-7.html| 108 ++ 2 files changed, 108 insertions(+), 37 deletions(-) diff --git a/releases/_posts/2020-09-12-spark-release-2-4-7.md b/releases/_posts/2020-09-12-spark-release-2-4-7.md index 6f4234d..e98e0ce 100644 --- a/releases/_posts/2020-09-12-spark-release-2-4-7.md +++ b/releases/_posts/2020-09-12-spark-release-2-4-7.md @@ -15,42 +15,76 @@ Spark 2.4.7 is a maintenance release containing stability, correctness, and secu ### Notable changes [SPARK-28818] - FrequentItems applies an incorrect schema to the resulting dataframe when nulls are present + [SPARK-31511] - Make BytesToBytesMap iterator() thread-safe + [SPARK-31703] - Changes made by SPARK-26985 break reading parquet files correctly in BigEndian architectures (AIX + LinuxPPC64) + [SPARK-31854] - Different results of query execution with wholestage codegen on and off + [SPARK-31903] - toPandas with Arrow enabled doesn't show metrics in Query UI. + [SPARK-31923] - Event log cannot be generated when some internal accumulators use unexpected types + [SPARK-31935] - Hadoop file system config should be effective in data source options + [SPARK-31941] - Handling the exception in SparkUI for getSparkUser method + [SPARK-31967] - Loading jobs UI page takes 40 seconds + [SPARK-31968] - write.partitionBy() creates duplicate subdirectories when user provides duplicate columns + [SPARK-31980] - Spark sequence() fails if start and end of range are identical dates + [SPARK-31997] - Should drop test_udtf table when SingleSessionSuite completed + [SPARK-32000] - Fix the flaky testcase for partially launched task in barrier-mode. + [SPARK-32003] - Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost + [SPARK-32024] - Disk usage tracker went negative in HistoryServerDiskManager + [SPARK-32028] - App id link in history summary page point to wrong application attempt + [SPARK-32034] - Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown + [SPARK-32044] - [SS] 2.4 Kafka continuous processing print mislead initial offsets log + [SPARK-32098] - Use iloc for positional slicing instead of direct slicing in createDataFrame with Arrow + [SPARK-32115] - Incorrect results for SUBSTRING when overflow + [SPARK-32131] - Fix AnalysisException messages at UNION/INTERSECT/EXCEPT/MINUS operations + [SPARK-32167] - nullability of GetArrayStructFields is incorrect + [SPARK-32214] - The type conversion function generated in makeFromJava for "other" type uses a wrong variable. + [SPARK-32238] - Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF + [SPARK-32280] - AnalysisException thrown when query contains several JOINs + [SPARK-32300] - toPandas with no partitions should work + [SPARK-32344] - Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates + [SPARK-32364] - Use CaseInsensitiveMap for DataFrameReader/Writer options + [SPARK-32372] - "Resolved attribute(s) XXX missing" after dudup conflict references + [SPARK-32377] - CaseInsensitiveMap should be deterministic for addition + [SPARK-32609] - Incorrect exchange reuse with DataSourceV2 + [SPARK-32672] - Data corruption in some cached compressed boolean columns + [SPARK-32693] - Compare two dataframes with same schema except nullable property + [SPARK-32771] - The example of expressions.Aggregator in Javadoc / Scaladoc is wrong + [SPARK-32810] - CSV/JSON data sources should avoid globbing paths when inferring schema -[SPARK-32812] - Run tests script for Python fails in certain environments +[SPARK-32812] - Run tests script for Python fails in certain environments ### Dependency Changes @@ -62,3 +96,4 @@ Spark 2.4.7 is a maintenance release containing stability, correctness, and secu You can consult JIRA for the [detailed changes](https://s.apache.org/v2.4.7-release-notes). We would like to acknowledge all community members for contributing patches to this release. + diff --git a/site/releases/spark-release-2-4-7.html b/site/releases/spark-release-2-4-7.html index 5ed2e66..b008f13 100644 --- a/site/releases/spark-release-2-4-7.html +++ b/site/releases/spark-release-2-4-7.html @@ -206,42 +206,77 @@ Spark 2.4.7 is a maintenance release containing stability, correctness, and security fixes. This release is based on the
[spark] branch master updated (bbbd907 -> 3be552c)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug
add 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/repl/Main.scala | 0
.../org/apache/spark/repl/SparkILoop.scala | 0
.../org/apache/spark/repl/Main.scala | 22 ++-
.../org/apache/spark/repl/SparkILoop.scala | 149 ++
.../org/apache/spark/repl/Repl2Suite.scala | 58 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../org/apache/spark/repl/Repl2Suite.scala | 53 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../scala/org/apache/spark/repl/ReplSuite.scala| 27
.../org/apache/spark/repl/SingletonReplSuite.scala | 61
.../sql/catalyst/util/CaseInsensitiveMap.scala | 2 +-
11 files changed, 618 insertions(+), 96 deletions(-)
copy repl/src/main/{scala => scala-2.12}/org/apache/spark/repl/Main.scala
(100%)
rename repl/src/main/{scala =>
scala-2.12}/org/apache/spark/repl/SparkILoop.scala (100%)
rename repl/src/main/{scala => scala-2.13}/org/apache/spark/repl/Main.scala
(89%)
create mode 100644
repl/src/main/scala-2.13/org/apache/spark/repl/SparkILoop.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/SingletonRepl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/SingletonRepl2Suite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (bbbd907 -> 3be552c)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug
add 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/repl/Main.scala | 0
.../org/apache/spark/repl/SparkILoop.scala | 0
.../org/apache/spark/repl/Main.scala | 22 ++-
.../org/apache/spark/repl/SparkILoop.scala | 149 ++
.../org/apache/spark/repl/Repl2Suite.scala | 58 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../org/apache/spark/repl/Repl2Suite.scala | 53 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../scala/org/apache/spark/repl/ReplSuite.scala| 27
.../org/apache/spark/repl/SingletonReplSuite.scala | 61
.../sql/catalyst/util/CaseInsensitiveMap.scala | 2 +-
11 files changed, 618 insertions(+), 96 deletions(-)
copy repl/src/main/{scala => scala-2.12}/org/apache/spark/repl/Main.scala
(100%)
rename repl/src/main/{scala =>
scala-2.12}/org/apache/spark/repl/SparkILoop.scala (100%)
rename repl/src/main/{scala => scala-2.13}/org/apache/spark/repl/Main.scala
(89%)
create mode 100644
repl/src/main/scala-2.13/org/apache/spark/repl/SparkILoop.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/SingletonRepl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/SingletonRepl2Suite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (bbbd907 -> 3be552c)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug
add 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/repl/Main.scala | 0
.../org/apache/spark/repl/SparkILoop.scala | 0
.../org/apache/spark/repl/Main.scala | 22 ++-
.../org/apache/spark/repl/SparkILoop.scala | 149 ++
.../org/apache/spark/repl/Repl2Suite.scala | 58 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../org/apache/spark/repl/Repl2Suite.scala | 53 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../scala/org/apache/spark/repl/ReplSuite.scala| 27
.../org/apache/spark/repl/SingletonReplSuite.scala | 61
.../sql/catalyst/util/CaseInsensitiveMap.scala | 2 +-
11 files changed, 618 insertions(+), 96 deletions(-)
copy repl/src/main/{scala => scala-2.12}/org/apache/spark/repl/Main.scala
(100%)
rename repl/src/main/{scala =>
scala-2.12}/org/apache/spark/repl/SparkILoop.scala (100%)
rename repl/src/main/{scala => scala-2.13}/org/apache/spark/repl/Main.scala
(89%)
create mode 100644
repl/src/main/scala-2.13/org/apache/spark/repl/SparkILoop.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/SingletonRepl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/SingletonRepl2Suite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (bbbd907 -> 3be552c)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug
add 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/repl/Main.scala | 0
.../org/apache/spark/repl/SparkILoop.scala | 0
.../org/apache/spark/repl/Main.scala | 22 ++-
.../org/apache/spark/repl/SparkILoop.scala | 149 ++
.../org/apache/spark/repl/Repl2Suite.scala | 58 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../org/apache/spark/repl/Repl2Suite.scala | 53 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../scala/org/apache/spark/repl/ReplSuite.scala| 27
.../org/apache/spark/repl/SingletonReplSuite.scala | 61
.../sql/catalyst/util/CaseInsensitiveMap.scala | 2 +-
11 files changed, 618 insertions(+), 96 deletions(-)
copy repl/src/main/{scala => scala-2.12}/org/apache/spark/repl/Main.scala
(100%)
rename repl/src/main/{scala =>
scala-2.12}/org/apache/spark/repl/SparkILoop.scala (100%)
rename repl/src/main/{scala => scala-2.13}/org/apache/spark/repl/Main.scala
(89%)
create mode 100644
repl/src/main/scala-2.13/org/apache/spark/repl/SparkILoop.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/SingletonRepl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/SingletonRepl2Suite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (bbbd907 -> 3be552c)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug
add 3be552c [SPARK-30090][SHELL] Adapt Spark REPL to Scala 2.13
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/repl/Main.scala | 0
.../org/apache/spark/repl/SparkILoop.scala | 0
.../org/apache/spark/repl/Main.scala | 22 ++-
.../org/apache/spark/repl/SparkILoop.scala | 149 ++
.../org/apache/spark/repl/Repl2Suite.scala | 58 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../org/apache/spark/repl/Repl2Suite.scala | 53 +++
.../apache/spark/repl/SingletonRepl2Suite.scala| 171 +
.../scala/org/apache/spark/repl/ReplSuite.scala| 27
.../org/apache/spark/repl/SingletonReplSuite.scala | 61
.../sql/catalyst/util/CaseInsensitiveMap.scala | 2 +-
11 files changed, 618 insertions(+), 96 deletions(-)
copy repl/src/main/{scala => scala-2.12}/org/apache/spark/repl/Main.scala
(100%)
rename repl/src/main/{scala =>
scala-2.12}/org/apache/spark/repl/SparkILoop.scala (100%)
rename repl/src/main/{scala => scala-2.13}/org/apache/spark/repl/Main.scala
(89%)
create mode 100644
repl/src/main/scala-2.13/org/apache/spark/repl/SparkILoop.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.12/org/apache/spark/repl/SingletonRepl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/Repl2Suite.scala
create mode 100644
repl/src/test/scala-2.13/org/apache/spark/repl/SingletonRepl2Suite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] zhengruifeng commented on pull request #289: Release 3.0.1
zhengruifeng commented on pull request #289: URL: https://github.com/apache/spark-website/pull/289#issuecomment-690895923 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] shivaram commented on pull request #289: Release 3.0.1
shivaram commented on pull request #289: URL: https://github.com/apache/spark-website/pull/289#issuecomment-691143254 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2009f95 -> bbbd907)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code add bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug No new revisions were added by this update. Summary of changes: .../spark/launcher/SparkSubmitCommandBuilder.java | 15 +-- .../spark/launcher/SparkSubmitCommandBuilderSuite.java | 18 ++ 2 files changed, 31 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #289: Release 3.0.1
dongjoon-hyun commented on pull request #289: URL: https://github.com/apache/spark-website/pull/289#issuecomment-691114428 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2009f95 -> bbbd907)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code add bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug No new revisions were added by this update. Summary of changes: .../spark/launcher/SparkSubmitCommandBuilder.java | 15 +-- .../spark/launcher/SparkSubmitCommandBuilderSuite.java | 18 ++ 2 files changed, 31 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2009f95 -> bbbd907)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code add bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug No new revisions were added by this update. Summary of changes: .../spark/launcher/SparkSubmitCommandBuilder.java | 15 +-- .../spark/launcher/SparkSubmitCommandBuilderSuite.java | 18 ++ 2 files changed, 31 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2009f95 -> bbbd907)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code add bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug No new revisions were added by this update. Summary of changes: .../spark/launcher/SparkSubmitCommandBuilder.java | 15 +-- .../spark/launcher/SparkSubmitCommandBuilderSuite.java | 18 ++ 2 files changed, 31 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2009f95 -> bbbd907)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code add bbbd907 [SPARK-32804][LAUNCHER] Fix run-example command builder bug No new revisions were added by this update. Summary of changes: .../spark/launcher/SparkSubmitCommandBuilder.java | 15 +-- .../spark/launcher/SparkSubmitCommandBuilderSuite.java | 18 ++ 2 files changed, 31 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] zhengruifeng commented on pull request #289: Release 3.0.1
zhengruifeng commented on pull request #289: URL: https://github.com/apache/spark-website/pull/289#issuecomment-690895923 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 2e04689 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
2e04689 is described below
commit 2e04689932b96321012ad9a5acaaf3ac306bba37
Author: sandeep.katta
AuthorDate: Sat Sep 12 13:22:54 2020 -0700
[SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
### What changes were proposed in this pull request?
Follow-up PR as per the review comments in
[29649](https://github.com/apache/spark/pull/29649/files/8d45542e915bea1b321f42988b407091065a2539#r487140171)
### Why are the changes needed?
Delete the un used code
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing UT
Closes #29736 from sandeep-katta/deadlockfollowup.
Authored-by: sandeep.katta
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 2009f953406aa5b4fdcdcd35f4c7c143f34d53e3)
Signed-off-by: Dongjoon Hyun
---
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
index 8d0a0f6..c7cbf32 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
@@ -1327,8 +1327,6 @@ private[client] class Shim_v3_0 extends Shim_v2_3 {
inheritTableSpecs: Boolean,
isSkewedStoreAsSubdir: Boolean,
isSrcLocal: Boolean): Unit = {
-val session = SparkSession.getActiveSession
-assert(session.nonEmpty)
val table = hive.getTable(tableName)
val loadFileType = if (replace) {
clazzLoadFileType.getEnumConstants.find(_.toString.equalsIgnoreCase("REPLACE_ALL"))
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 2e04689 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
2e04689 is described below
commit 2e04689932b96321012ad9a5acaaf3ac306bba37
Author: sandeep.katta
AuthorDate: Sat Sep 12 13:22:54 2020 -0700
[SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
### What changes were proposed in this pull request?
Follow-up PR as per the review comments in
[29649](https://github.com/apache/spark/pull/29649/files/8d45542e915bea1b321f42988b407091065a2539#r487140171)
### Why are the changes needed?
Delete the un used code
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing UT
Closes #29736 from sandeep-katta/deadlockfollowup.
Authored-by: sandeep.katta
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 2009f953406aa5b4fdcdcd35f4c7c143f34d53e3)
Signed-off-by: Dongjoon Hyun
---
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
index 8d0a0f6..c7cbf32 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
@@ -1327,8 +1327,6 @@ private[client] class Shim_v3_0 extends Shim_v2_3 {
inheritTableSpecs: Boolean,
isSkewedStoreAsSubdir: Boolean,
isSrcLocal: Boolean): Unit = {
-val session = SparkSession.getActiveSession
-assert(session.nonEmpty)
val table = hive.getTable(tableName)
val loadFileType = if (replace) {
clazzLoadFileType.getEnumConstants.find(_.toString.equalsIgnoreCase("REPLACE_ALL"))
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ce566be -> 2009f95)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ce566be [SPARK-32180][FOLLOWUP] Fix .rst error in new Pyspark installation guide add 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code No new revisions were added by this update. Summary of changes: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 -- 1 file changed, 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 2e04689 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
2e04689 is described below
commit 2e04689932b96321012ad9a5acaaf3ac306bba37
Author: sandeep.katta
AuthorDate: Sat Sep 12 13:22:54 2020 -0700
[SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
### What changes were proposed in this pull request?
Follow-up PR as per the review comments in
[29649](https://github.com/apache/spark/pull/29649/files/8d45542e915bea1b321f42988b407091065a2539#r487140171)
### Why are the changes needed?
Delete the un used code
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing UT
Closes #29736 from sandeep-katta/deadlockfollowup.
Authored-by: sandeep.katta
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 2009f953406aa5b4fdcdcd35f4c7c143f34d53e3)
Signed-off-by: Dongjoon Hyun
---
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
index 8d0a0f6..c7cbf32 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
@@ -1327,8 +1327,6 @@ private[client] class Shim_v3_0 extends Shim_v2_3 {
inheritTableSpecs: Boolean,
isSkewedStoreAsSubdir: Boolean,
isSrcLocal: Boolean): Unit = {
-val session = SparkSession.getActiveSession
-assert(session.nonEmpty)
val table = hive.getTable(tableName)
val loadFileType = if (replace) {
clazzLoadFileType.getEnumConstants.find(_.toString.equalsIgnoreCase("REPLACE_ALL"))
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ce566be -> 2009f95)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ce566be [SPARK-32180][FOLLOWUP] Fix .rst error in new Pyspark installation guide add 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code No new revisions were added by this update. Summary of changes: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 -- 1 file changed, 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 2e04689 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
2e04689 is described below
commit 2e04689932b96321012ad9a5acaaf3ac306bba37
Author: sandeep.katta
AuthorDate: Sat Sep 12 13:22:54 2020 -0700
[SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
### What changes were proposed in this pull request?
Follow-up PR as per the review comments in
[29649](https://github.com/apache/spark/pull/29649/files/8d45542e915bea1b321f42988b407091065a2539#r487140171)
### Why are the changes needed?
Delete the un used code
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing UT
Closes #29736 from sandeep-katta/deadlockfollowup.
Authored-by: sandeep.katta
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 2009f953406aa5b4fdcdcd35f4c7c143f34d53e3)
Signed-off-by: Dongjoon Hyun
---
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
index 8d0a0f6..c7cbf32 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
@@ -1327,8 +1327,6 @@ private[client] class Shim_v3_0 extends Shim_v2_3 {
inheritTableSpecs: Boolean,
isSkewedStoreAsSubdir: Boolean,
isSrcLocal: Boolean): Unit = {
-val session = SparkSession.getActiveSession
-assert(session.nonEmpty)
val table = hive.getTable(tableName)
val loadFileType = if (replace) {
clazzLoadFileType.getEnumConstants.find(_.toString.equalsIgnoreCase("REPLACE_ALL"))
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ce566be -> 2009f95)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ce566be [SPARK-32180][FOLLOWUP] Fix .rst error in new Pyspark installation guide add 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code No new revisions were added by this update. Summary of changes: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 -- 1 file changed, 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.0 updated: [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new 2e04689 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
2e04689 is described below
commit 2e04689932b96321012ad9a5acaaf3ac306bba37
Author: sandeep.katta
AuthorDate: Sat Sep 12 13:22:54 2020 -0700
[SPARK-32779][SQL][FOLLOW-UP] Delete Unused code
### What changes were proposed in this pull request?
Follow-up PR as per the review comments in
[29649](https://github.com/apache/spark/pull/29649/files/8d45542e915bea1b321f42988b407091065a2539#r487140171)
### Why are the changes needed?
Delete the un used code
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing UT
Closes #29736 from sandeep-katta/deadlockfollowup.
Authored-by: sandeep.katta
Signed-off-by: Dongjoon Hyun
(cherry picked from commit 2009f953406aa5b4fdcdcd35f4c7c143f34d53e3)
Signed-off-by: Dongjoon Hyun
---
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
index 8d0a0f6..c7cbf32 100644
--- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
+++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala
@@ -1327,8 +1327,6 @@ private[client] class Shim_v3_0 extends Shim_v2_3 {
inheritTableSpecs: Boolean,
isSkewedStoreAsSubdir: Boolean,
isSrcLocal: Boolean): Unit = {
-val session = SparkSession.getActiveSession
-assert(session.nonEmpty)
val table = hive.getTable(tableName)
val loadFileType = if (replace) {
clazzLoadFileType.getEnumConstants.find(_.toString.equalsIgnoreCase("REPLACE_ALL"))
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ce566be -> 2009f95)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ce566be [SPARK-32180][FOLLOWUP] Fix .rst error in new Pyspark installation guide add 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code No new revisions were added by this update. Summary of changes: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 -- 1 file changed, 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (ce566be -> 2009f95)
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ce566be [SPARK-32180][FOLLOWUP] Fix .rst error in new Pyspark installation guide add 2009f95 [SPARK-32779][SQL][FOLLOW-UP] Delete Unused code No new revisions were added by this update. Summary of changes: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala | 2 -- 1 file changed, 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] shivaram commented on pull request #289: Release 3.0.1
shivaram commented on pull request #289: URL: https://github.com/apache/spark-website/pull/289#issuecomment-691143254 @zhengruifeng sorry for the delay -- I'll get to this today This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] dongjoon-hyun commented on pull request #289: Release 3.0.1
dongjoon-hyun commented on pull request #289:
URL: https://github.com/apache/spark-website/pull/289#issuecomment-691114428
@zhengruifeng . Sorry, I'm not sure SparkR release process either.
`SparkR` package info has `Maintainer` field like the following.
- https://github.com/apache/spark/blob/master/R/pkg/DESCRIPTION#L6-L11
```
Authors@R: c(person("Shivaram", "Venkataraman", role = c("aut", "cre"),
email = "shiva...@cs.berkeley.edu"),
person("Xiangrui", "Meng", role = "aut",
email = "m...@databricks.com"),
person("Felix", "Cheung", role = "aut",
email = "felixche...@apache.org"),
person(family = "The Apache Software Foundation", role =
c("aut", "cph")))
```
@shivaram , @mengxr , @felixcheung . Could you give us some advice?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[GitHub] [spark-website] zhengruifeng commented on pull request #289: Release 3.0.1
zhengruifeng commented on pull request #289: URL: https://github.com/apache/spark-website/pull/289#issuecomment-690895923 @dongjoon-hyun I had uploaded the `SparkR_3.0.1.tar.gz` two days ago, according **Publish to CRAN** in [release-process](https://spark.apache.org/release-process.html). But I am not sure whether this upload is done. Do you know how to check its status? Thanks This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark-website] branch asf-site updated: updated js/downloads scripts
This is an automated email from the ASF dual-hosted git repository.
prashant pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/spark-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 4237a2b updated js/downloads scripts
4237a2b is described below
commit 4237a2b76b3f2d0f063db44018b7a77431bfcc77
Author: Prashant Sharma
AuthorDate: Sat Sep 12 09:31:29 2020 +
updated js/downloads scripts
---
js/downloads.js | 2 +-
site/js/downloads.js | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/js/downloads.js b/js/downloads.js
index 7a82089..b100f66 100644
--- a/js/downloads.js
+++ b/js/downloads.js
@@ -24,7 +24,7 @@ var packagesV9 = [hadoop2p7, hadoop2p6, hadoopFree,
scala2p12_hadoopFree, source
var packagesV10 = [hadoop2p7, hadoop3p2, hadoopFree, sources];
addRelease("3.0.1", new Date("09/02/2020"), packagesV10, true);
-addRelease("2.4.6", new Date("06/05/2020"), packagesV9, true);
+addRelease("2.4.7", new Date("09/12/2020"), packagesV9, true);
function append(el, contents) {
el.innerHTML += contents;
diff --git a/site/js/downloads.js b/site/js/downloads.js
index 7a82089..b100f66 100644
--- a/site/js/downloads.js
+++ b/site/js/downloads.js
@@ -24,7 +24,7 @@ var packagesV9 = [hadoop2p7, hadoop2p6, hadoopFree,
scala2p12_hadoopFree, source
var packagesV10 = [hadoop2p7, hadoop3p2, hadoopFree, sources];
addRelease("3.0.1", new Date("09/02/2020"), packagesV10, true);
-addRelease("2.4.6", new Date("06/05/2020"), packagesV9, true);
+addRelease("2.4.7", new Date("09/12/2020"), packagesV9, true);
function append(el, contents) {
el.innerHTML += contents;
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark-website] 02/02: added release notes.
This is an automated email from the ASF dual-hosted git repository. prashant pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git commit 7ba86ee7a599d30422f5f6c459d75ad43fca04b0 Author: Prashant Sharma AuthorDate: Sat Sep 12 04:07:57 2020 -0500 added release notes. --- releases/_posts/2020-09-12-spark-release-2-4-7.md | 64 +++ 1 file changed, 64 insertions(+) diff --git a/releases/_posts/2020-09-12-spark-release-2-4-7.md b/releases/_posts/2020-09-12-spark-release-2-4-7.md new file mode 100644 index 000..6f4234d --- /dev/null +++ b/releases/_posts/2020-09-12-spark-release-2-4-7.md @@ -0,0 +1,64 @@ +--- +layout: post +title: Spark Release 2.4.7 +categories: [] +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +Spark 2.4.7 is a maintenance release containing stability, correctness, and security fixes. This release is based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4 users to upgrade to this stable release. + +### Notable changes +[SPARK-28818] - FrequentItems applies an incorrect schema to the resulting dataframe when nulls are present +[SPARK-31511] - Make BytesToBytesMap iterator() thread-safe +[SPARK-31703] - Changes made by SPARK-26985 break reading parquet files correctly in BigEndian architectures (AIX + LinuxPPC64) +[SPARK-31854] - Different results of query execution with wholestage codegen on and off +[SPARK-31903] - toPandas with Arrow enabled doesn't show metrics in Query UI. +[SPARK-31923] - Event log cannot be generated when some internal accumulators use unexpected types +[SPARK-31935] - Hadoop file system config should be effective in data source options +[SPARK-31941] - Handling the exception in SparkUI for getSparkUser method +[SPARK-31967] - Loading jobs UI page takes 40 seconds +[SPARK-31968] - write.partitionBy() creates duplicate subdirectories when user provides duplicate columns +[SPARK-31980] - Spark sequence() fails if start and end of range are identical dates +[SPARK-31997] - Should drop test_udtf table when SingleSessionSuite completed +[SPARK-32000] - Fix the flaky testcase for partially launched task in barrier-mode. +[SPARK-32003] - Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost +[SPARK-32024] - Disk usage tracker went negative in HistoryServerDiskManager +[SPARK-32028] - App id link in history summary page point to wrong application attempt +[SPARK-32034] - Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown +[SPARK-32044] - [SS] 2.4 Kafka continuous processing print mislead initial offsets log +[SPARK-32098] - Use iloc for positional slicing instead of direct slicing in createDataFrame with Arrow +[SPARK-32115] - Incorrect results for SUBSTRING when overflow +[SPARK-32131] - Fix AnalysisException messages at UNION/INTERSECT/EXCEPT/MINUS operations +[SPARK-32167] - nullability of GetArrayStructFields is incorrect +[SPARK-32214] - The type conversion function generated in makeFromJava for "other" type uses a wrong variable. +[SPARK-32238] - Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF +[SPARK-32280] - AnalysisException thrown when query contains several JOINs +[SPARK-32300] - toPandas with no partitions should work +[SPARK-32344] - Unevaluable expr is set to FIRST/LAST ignoreNullsExpr in distinct aggregates +[SPARK-32364] - Use CaseInsensitiveMap for DataFrameReader/Writer options +[SPARK-32372] - "Resolved attribute(s) XXX missing" after dudup conflict references +[SPARK-32377] - CaseInsensitiveMap should be deterministic for addition +[SPARK-32609] - Incorrect exchange reuse with DataSourceV2 +[SPARK-32672] - Data corruption in some cached compressed boolean columns +[SPARK-32693] - Compare two dataframes with same schema except nullable property +[SPARK-32771] - The example of expressions.Aggregator in Javadoc / Scaladoc is wrong +[SPARK-32810] - CSV/JSON data sources should avoid globbing paths when inferring schema +[SPARK-32812] - Run tests script for Python fails in certain environments + + + +### Dependency Changes + + +### Known issues + + +You can consult JIRA for the [detailed changes](https://s.apache.org/v2.4.7-release-notes). + +We would like to acknowledge all community members for contributing patches to this release. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] tag v2.4.7 created (now 14211a1)
This is an automated email from the ASF dual-hosted git repository. prashant pushed a change to tag v2.4.7 in repository https://gitbox.apache.org/repos/asf/spark.git. at 14211a1 (commit) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41426 - /release/spark/spark-2.4.6/
Author: prashant Date: Sat Sep 12 08:11:34 2020 New Revision: 41426 Log: Removing old release Removed: release/spark/spark-2.4.6/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41425 - /dev/spark/v2.4.7-rc1-docs/
Author: prashant Date: Sat Sep 12 08:10:03 2020 New Revision: 41425 Log: removing old artifacts Removed: dev/spark/v2.4.7-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41424 - /dev/spark/v2.4.7-rc2-docs/
Author: prashant Date: Sat Sep 12 08:09:02 2020 New Revision: 41424 Log: removing old artifacts Removed: dev/spark/v2.4.7-rc2-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41423 - /dev/spark/v2.4.7-rc2-bin/
Author: prashant Date: Sat Sep 12 08:08:07 2020 New Revision: 41423 Log: Removing old artifacts Removed: dev/spark/v2.4.7-rc2-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41422 - /dev/spark/v2.4.7-rc1-bin/
Author: prashant Date: Sat Sep 12 08:07:20 2020 New Revision: 41422 Log: removing old artifiacts Removed: dev/spark/v2.4.7-rc1-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41421 - /release/spark/KEYS
Author: prashant Date: Sat Sep 12 07:46:16 2020 New Revision: 41421 Log: public key added. Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Sat Sep 12 07:46:16 2020 @@ -1352,3 +1352,64 @@ stYuYBaWmLpcfVt1JIu+RycFbdt1VcgiYkZtgEWy QIyucVW+lUfx8YAkZLrAXI0frwYqFNZMekAM2MXS9hPARC/Ae6+W2Rhj0tQA =TBGw -END PGP PUBLIC KEY BLOCK- + +pub rsa4096 2020-07-18 [SC] + 234B23A6DCE2B2101781D00E66827234BC7B750E +uid [ultimate] Prashant Sharma (CODE SIGNING KEY) +sig 366827234BC7B750E 2020-07-18 Prashant Sharma (CODE SIGNING KEY) +sub rsa4096 2020-07-18 [E] +sig 66827234BC7B750E 2020-07-18 Prashant Sharma (CODE SIGNING KEY) + +-BEGIN PGP PUBLIC KEY BLOCK- + +mQINBF8S6MMBEACqwNovcbmY9sbKwAgDfBrwE5WjqhqbS9rpzNIqDWo62blpBxO7 +eK0TbHocleWr2HCDzroKuaGmAXvHwCuJqUd4T/Z2f8a/wbaJXlfktlxwFsZ/Comx +3qBZ3AcEpMIHsVhX3n4nwmhsq7B4jiKgENr+P1BJCW6vhw+r4O8fAFUBbZ+HCw+H +9w2GIpYnydCeFS58l8TRgblbSIop5IqgfcC35jwPhotfae46mSc1sM4RUVLOoL/Q +0+1HH9cKDqeMgtxcjGe7BsuiL6DGszzpZC7mJFsUWv7/LCIp8rmXX7/QWTYQnUrY +h0KNtKty6sV9R91W7D6lKhEVQwJGUaaDfliLQXA/tCP51GP16DN57t2ajHtYQynR +ddW3Ag2CnxeWhKZD1bmchvUE8CMPh5kBCVE9jp9C6ZDO8odABa3FvQpkrUM2L+Te +goNMmpKAMG3lw/HoJ+TrWtpBbO7sP7kGxC7gH4SImPRjpcOLjUqgM1T2CVuvO8So +tqhw1W8xfkUnD0EvRvaWj2Fr0yUCRbJD6bEZET47KbACbSmOEfd1CRQgCWv7RGYl +TnRqsPsIUIE66F4LoM7vhUJNUU6znsom8zbE0eWpD/nM47+/TPY7YMee04V7KAcF +sRqM9JBNVyzisG9pwy+6v+XJZaarQvwT1wy8nnsg2rA1psX90cvpQwk+VQARAQAB +tDhQcmFzaGFudCBTaGFybWEgKENPREUgU0lHTklORyBLRVkpIDxwcmFzaGFudEBh +cGFjaGUub3JnPokCTgQTAQIAOBYhBCNLI6bc4rIQF4HQDmaCcjS8e3UOBQJfEujD +AhsDBQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJEGaCcjS8e3UOPwcP/jiSDMBY +Ak/Iq9+P+95tfJZDAldk548+S2snZjI+rPqFVmFqspQhGyF/omR6NCRhvg9B7AcD +UcYLagWVtCXS+tQNPE07BN49YBXsmYcYO3k5ionqw6JCrx0oIfzCxDImK9jy+Lia +uTPr7FsB0mE4n5V6z7LYtBBDzp0TdqtaYPNsy/vXSIhG5Dz1bkDLHFaCwm2Mr19m +X3US8+dT09jLhz2ynq3RAvwV9NR7Ws179gotARGK5j80IYMs47BnucH7LGw34Rg/ +c1qTltLJB6jPW3eHzctRUBASMPt7lFN3XdHfpTkliu3foyX/CO018DMhDH7q+5mM +qcJdATB3ttvrlHn3EZvbrMoBcvO800vqkzojVwzaljLEKJJkuXsmiIMAadv2Y0yf +AHugN+hcfC6Z9cHcTsNNhJkSAPFEuKyLxvo5KEI6jm9qXCHl9BWdeX8WqyuNWJWo +gIlfZc95hZVmBo7QATG5PKLgAwAnbJU5WQ85LjCQ+h9VNzd1yHhRupPvLXfLO0av +1bsJjSjxhpoE8VjuBVsfjzaR7p9q6dvt6chCIKfNwVRpAZMMESg5fTvumrjvSxTF +brfrqgh6EDyadKYYRnwQy6zXhRKazs6njh9CrhGykKVHu6cqmeHSR9txhfRQP5HA +zcQnT7/8cQpsUTB9kg0ZLzyw6+fmUWqI7IQQuQINBF8S6MMBEADP0WoShSkojEuK +nAoWlcPAMRGWWylDSg9QA5ss9ropcxSGUMLPF0oEHbQL6I0+uEwRxVib1G2qY3yI +h+xbC+zoUUeRlZf9AIAqWMkaxlJ+jmLIYQyNbWNARt8608x6mEncQxOR4HYOovuQ +Kwur30cMNVuXAvVOmF687Tj++bfi+FafmxXE0bjY9UrO4K5vrKTqccQonr9e1e0b +D08srfkmjOqj2YNNzu5/tzU7n/U07t4cXzirqTLfS2it/niAzP8yuHUtin5MOnd5 +BI/TECBBqNudvK3V1tj0Q4FKDyCmNi/CHIicSpvHtcKQPuMfjtJhl+Gr/XPondcR +2M4ErhqhRFNrJ6XQh/1erDA+CXCUb9EavIZtOykGz7h3EB4GxqZCb5Jc9DghKwSP +0iSHh6DW6EMO9kHXjBi3t3NB+QSuvqxcXMyrgp++9nDLSDR7PdYKBkCUDp1btcgB +qZA4Z1B1ccuZgYggQFDPc/IMCnAHDvwOFRwxUZcm6bBxxKgJep1KsopP9bXUy0cM +bdJfHRqOVDu5ug3YfIt4PkSCrKLr6ZrJ9KTFgkQN9rY9byLPdRPZ2OFjvI/7PYO9 +9w7Aw0OebEflrpDlvKGUg0YOBwU4qBgXcsuz0XpZdqWMnNN3aLmg4ZtXHxu+H9/2 +RFm06rUuSqGB4ceScEuZudDHVsohIwARAQABiQI2BBgBAgAgFiEEI0sjptzishAX +gdAOZoJyNLx7dQ4FAl8S6MMCGwwACgkQZoJyNLx7dQ5HWw//c3gNOEXlQ+Z+sY2g +0DX3nekIJiWOcO5PpaCF8K1PFnj/cP72qdoHcTt+4W5ex74jZg5KrXgKXaduE1vm +s/O5i99LtCe5j6NcsEYfHUGqnaLhWgSBWfnx/TbRBNHavoJZQBjvPSyNYTCeYnW+ +b3YPS8c3cOuDIr7uD1wNx2ryzH/iPt8NY7C5jBR32KzGmGEQjIAnlIWy742UQfs6 +JBhkjZ9nDIDDG17IHeIFUCl3GKd6cgC2WEamojRbna5gHC7TrfPIDqRTqzo1IcqP +D7UTt7u13mCLq4SzCBMznUsiAQepsKJ5ZkhgqgH8lVXWtFIBtWasgKsNOg3Zyh8b +Gxhf2o0IzKZ1QI9/Q8/LUIggPH4dIVzDUVlw7WEESPtkkAbhI9zSNgOwQH/A+r8l +ILl2xf1/6kkkgto+Evz9VGPtxpJQxeWmWFe9i+Jc3m1hYEllIjD1ZYBLzRCXHySP +fBWO2jj59r67KJVz7Pj4K3Zv7RxgUKUerQ6L1GkUtrOpnH4D/uaFDV2wTH+gBxWk +mCsmwak23go1vrpViZ4gx1sTkHheTeKKJx+KDW/CQx2JNUS+YWR35U6PryV//6sx +OxHayKvJF8j36oH7MCHbSTKuXnp77rLv8gLO6jX2PVSK3dGU0rB0D6yOEzJiZswM +Hy4V/RJiJHCHekSXHCNoxgJz8Jc= +=+90F +-END PGP PUBLIC KEY BLOCK- + - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r41420 - /dev/spark/v2.4.7-rc3-bin/ /release/spark/spark-2.4.7/
Author: prashant Date: Sat Sep 12 07:32:59 2020 New Revision: 41420 Log: Finalize release 2.4.7 Added: release/spark/spark-2.4.7/ - copied from r41419, dev/spark/v2.4.7-rc3-bin/ Removed: dev/spark/v2.4.7-rc3-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
