[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-121437302 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642055 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -160,6 +162,20 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642048 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -160,6 +162,20 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642102 --- Diff: core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala --- @@ -0,0 +1,151 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642440 --- Diff: core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala --- @@ -0,0 +1,151 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-121466596 [Test build #37289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37289/console) for PR 7004 at commit

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642355 --- Diff: core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala --- @@ -0,0 +1,151 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642343 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -160,6 +162,20 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-121438591 Thanks for changing the codec @JDrit but unfortunately I think Snappy is the one bad choice for a hard-coded compression codec, because it depends on native libs. A

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-12144 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642172 --- Diff: core/src/test/scala/org/apache/spark/serializer/GenericAvroSerializerSuite.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642220 --- Diff: core/src/test/scala/org/apache/spark/serializer/GenericAvroSerializerSuite.scala --- @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642141 --- Diff: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala --- @@ -21,6 +21,8 @@ import java.io.{EOFException, IOException, InputStream,

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/7004#discussion_r34642083 --- Diff: core/src/main/scala/org/apache/spark/serializer/GenericAvroSerializer.scala --- @@ -0,0 +1,151 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-121437785 [Test build #37289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37289/consoleFull) for PR 7004 at commit

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-121437664 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-121437656 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-07-07 Thread JDrit
Github user JDrit commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-119288485 @JoshRosen does that satisfy your concerns and are there other changes you would want me to make? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-06-24 Thread JDrit
GitHub user JDrit opened a pull request: https://github.com/apache/spark/pull/7004 [SPARK-746][CORE] Added Avro Serialization to Kryo Added a custom Kryo serializer for generic Avro records to reduce the network IO involved during a shuffle. This compresses the schema and

[GitHub] spark pull request: [SPARK-746][CORE] Added Avro Serialization to ...

2015-06-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7004#issuecomment-115048440 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    1   2