Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18805
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r148184755
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
Snapp
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r147629043
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
SnappyOut
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r147618796
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
Snapp
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r147340655
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
SnappyOut
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r147215825
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
Snapp
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r147213697
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
SnappyOut
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r139898945
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
SnappyOut
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r139635152
--- Diff: LICENSE ---
@@ -269,6 +269,7 @@ The text of each license is also included at
licenses/LICENSE-[project].txt.
(BSD 3 Clause) d3.min.js
(h
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r139634333
--- Diff: dev/deps/spark-deps-hadoop-2.6 ---
@@ -186,3 +186,4 @@ xercesImpl-2.9.1.jar
xmlenc-0.52.jar
xz-1.0.jar
zookeeper-3.4.6.jar
+zstd-
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130892528
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,33 @@ private final class SnappyOutputStreamWrapper(os:
SnappyOutp
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130889998
--- Diff: docs/configuration.md ---
@@ -886,6 +887,23 @@ Apart from these, the following properties are also
available, and may be useful
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130889423
--- Diff: docs/configuration.md ---
@@ -866,7 +866,8 @@ Apart from these, the following properties are also
available, and may be useful
e.g.
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130787262
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -50,13 +51,14 @@ private[spark] object CompressionCodec {
pri
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130787287
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,30 @@ private final class SnappyOutputStreamWrapper(os:
Snapp
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130787269
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,30 @@ private final class SnappyOutputStreamWrapper(os:
Snapp
Github user sitalkedia commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130787205
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,30 @@ private final class SnappyOutputStreamWrapper(os:
Snapp
Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130769482
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -50,13 +51,14 @@ private[spark] object CompressionCodec {
pr
Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130769858
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,30 @@ private final class SnappyOutputStreamWrapper(os:
Snap
Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130769646
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,30 @@ private final class SnappyOutputStreamWrapper(os:
Snap
Github user tejasapatil commented on a diff in the pull request:
https://github.com/apache/spark/pull/18805#discussion_r130769548
--- Diff: core/src/main/scala/org/apache/spark/io/CompressionCodec.scala ---
@@ -216,3 +218,30 @@ private final class SnappyOutputStreamWrapper(os:
Snap
GitHub user sitalkedia opened a pull request:
https://github.com/apache/spark/pull/18805
[SPARK-19112][CORE] Support for ZStandard codec
## What changes were proposed in this pull request?
Using zstd compression for Spark jobs spilling 100s of TBs of data, we
could reduce t
22 matches
Mail list logo
