[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6780 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-115001504 Thanks! Merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114788600 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114788562 [Test build #35652 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35652/console) for PR 6780 at commit [`34aa07b`](https://github.com/apache/spark/commit/34aa07bd601999222d95e51a5dc1365e38b0ad23). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114748738 [Test build #35652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35652/consoleFull) for PR 6780 at commit [`34aa07b`](https://github.com/apache/spark/commit/34aa07bd601999222d95e51a5dc1365e38b0ad23). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114747598 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114747637 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114747461 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114745263 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114745188 [Test build #35634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35634/console) for PR 6780 at commit [`34aa07b`](https://github.com/apache/spark/commit/34aa07bd601999222d95e51a5dc1365e38b0ad23). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114724791 [Test build #35634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35634/consoleFull) for PR 6780 at commit [`34aa07b`](https://github.com/apache/spark/commit/34aa07bd601999222d95e51a5dc1365e38b0ad23). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114724550 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114724542 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114587583 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114587448 [Test build #35558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35558/console) for PR 6780 at commit [`72c3f69`](https://github.com/apache/spark/commit/72c3f6967350da0985082c349bf3fc5d975d468c). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114562787 [Test build #35558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35558/consoleFull) for PR 6780 at commit [`72c3f69`](https://github.com/apache/spark/commit/72c3f6967350da0985082c349bf3fc5d975d468c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114562054 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-114562018 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6780#discussion_r32991598 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -106,12 +103,16 @@ case class InsertIntoHiveTable( } writerContainer - .getLocalFileWriter(row, table.schema) - .write(serializer.serialize(outputData, standardOI)) + .getLocalFileWriter(row, schema) + .write(newSer(fileSinkConf.getTableInfo).serialize(outputData, standardOI)) } writerContainer.close() -} +}: Unit + +writerContainer.driverSideSetup() +sc.sparkContext.runJob(rdd, sc.sparkContext.clean(writeToFile)) +writerContainer.commitJob() --- End diff -- It appears the change is breaking something in the serialization debugger. ``` 15/06/22 22:25:41.020 main WARN SerializationDebugger: Exception in serialization debugger java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.spark.serializer.SerializationDebugger$ObjectStreamClassMethods$.getObjFieldValues$extension(SerializationDebugger.scala:248) at org.apache.spark.serializer.SerializationDebugger$SerializationDebugger.visitSerializable(SerializationDebugger.scala:158) at org.apache.spark.serializer.SerializationDebugger$SerializationDebugger.visit(SerializationDebugger.scala:107) at org.apache.spark.serializer.SerializationDebugger$SerializationDebugger.visitSerializable(SerializationDebugger.scala:166) at org.apache.spark.serializer.SerializationDebugger$SerializationDebugger.visit(SerializationDebugger.scala:107) at org.apache.spark.serializer.SerializationDebugger$.find(SerializationDebugger.scala:66) at org.apache.spark.serializer.SerializationDebugger$.improveException(SerializationDebugger.scala:41) at org.apache.spark.serializer.JavaSerializationStream.writeObject(JavaSerializer.scala:47) at org.apache.spark.serializer.JavaSerializerInstance.serialize(JavaSerializer.scala:81) at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:319) at org.apache.spark.util.ClosureCleaner$.org$apache$spark$util$ClosureCleaner$$clean(ClosureCleaner.scala:312) at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:139) at org.apache.spark.SparkContext.clean(SparkContext.scala:1891) at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.saveAsHiveFile(InsertIntoHiveTable.scala:114) at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.sideEffectResult$lzycompute(InsertIntoHiveTable.scala:186) at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.sideEffectResult(InsertIntoHiveTable.scala:125) at org.apache.spark.sql.hive.execution.InsertIntoHiveTable.doExecute(InsertIntoHiveTable.scala:263) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:89) at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:89) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:147) at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:88) at org.apache.spark.sql.SQLContext$QueryExecution.toRdd$lzycompute(SQLContext.scala:986) at org.apache.spark.sql.SQLContext$QueryExecution.toRdd(SQLContext.scala:986) at org.apache.spark.sql.DataFrame.(DataFrame.scala:143) at org.apache.spark.sql.DataFrame.(DataFrame.scala:127) at org.apache.spark.sql.DataFrame$.apply(DataFrame.scala:50) at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:786) at org.apache.spark.sql.hive.thriftserver.SparkSQLDriver.run(SparkSQLDriver.scala:61) at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.processCmd(SparkSQLCLIDriver.scala:283) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423) at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$.main(SparkSQLCLIDriver.scala:218) at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.main(SparkSQLCLIDriver.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMetho
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/6780#discussion_r32902049 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala --- @@ -106,12 +103,16 @@ case class InsertIntoHiveTable( } writerContainer - .getLocalFileWriter(row, table.schema) - .write(serializer.serialize(outputData, standardOI)) + .getLocalFileWriter(row, schema) + .write(newSer(fileSinkConf.getTableInfo).serialize(outputData, standardOI)) } writerContainer.close() -} +}: Unit + +writerContainer.driverSideSetup() +sc.sparkContext.runJob(rdd, sc.sparkContext.clean(writeToFile)) +writerContainer.commitJob() --- End diff -- I made these changes to clean the closure and avoid referencing the `$out` so that we don't need to add a lot of `@ transient`. However, it fails a test `CliSuite.Commands using SerDe provided in --jars` with timeout. Does anybody know the reason? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113949998 [Test build #35410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35410/console) for PR 6780 at commit [`b65dd6b`](https://github.com/apache/spark/commit/b65dd6b475d145f5b524c768c1c4c864e3ce04a5). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113950001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113944947 [Test build #35410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35410/consoleFull) for PR 6780 at commit [`b65dd6b`](https://github.com/apache/spark/commit/b65dd6b475d145f5b524c768c1c4c864e3ce04a5). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113944426 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113944400 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113943127 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113943049 [Test build #35408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35408/console) for PR 6780 at commit [`e5c19c8`](https://github.com/apache/spark/commit/e5c19c846327571d6946b71b0507fc9c1a90711b). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113941696 [Test build #35406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35406/console) for PR 6780 at commit [`9420510`](https://github.com/apache/spark/commit/94205100d295c169e7c486650829e63602463507). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113941706 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113938328 [Test build #35408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35408/consoleFull) for PR 6780 at commit [`e5c19c8`](https://github.com/apache/spark/commit/e5c19c846327571d6946b71b0507fc9c1a90711b). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113938201 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113938207 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113937702 [Test build #35406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35406/consoleFull) for PR 6780 at commit [`9420510`](https://github.com/apache/spark/commit/94205100d295c169e7c486650829e63602463507). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113937693 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113937687 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113937616 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-11397 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113933322 [Test build #35400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35400/console) for PR 6780 at commit [`9420510`](https://github.com/apache/spark/commit/94205100d295c169e7c486650829e63602463507). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113926937 [Test build #35400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35400/consoleFull) for PR 6780 at commit [`9420510`](https://github.com/apache/spark/commit/94205100d295c169e7c486650829e63602463507). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113926409 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113926383 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113918454 [Test build #35395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35395/console) for PR 6780 at commit [`ec57bad`](https://github.com/apache/spark/commit/ec57badbb4f68218e4f3082d5f8f4e5d86458a7a). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113918463 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113911003 [Test build #35395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35395/consoleFull) for PR 6780 at commit [`ec57bad`](https://github.com/apache/spark/commit/ec57badbb4f68218e4f3082d5f8f4e5d86458a7a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113910814 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113910811 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113880280 cc @marmbrus , `NotSerializableException` error will exist at `HiveCompatibilitySuite` when insert into hive table. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113395075 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113395050 [Test build #35230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35230/console) for PR 6780 at commit [`d11fa9e`](https://github.com/apache/spark/commit/d11fa9e26ed9c37c2f85f70eacb69399522e5d6d). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class SerializableConfiguration(@transient var value: Configuration) extends Serializable ` * `class SerializableJobConf(@transient var value: JobConf) extends Serializable ` * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113382396 [Test build #35230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35230/consoleFull) for PR 6780 at commit [`d11fa9e`](https://github.com/apache/spark/commit/d11fa9e26ed9c37c2f85f70eacb69399522e5d6d). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113382300 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-113382314 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6780#discussion_r32668112 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -160,17 +166,22 @@ case class TakeOrdered(limit: Int, sortOrder: Seq[SortOrder], child: SparkPlan) private val ord: RowOrdering = new RowOrdering(sortOrder, child.output) - private def collectData(): Array[InternalRow] = -child.execute().map(_.copy()).takeOrdered(limit)(ord) + @transient private val projection = projectList.map(newProjection(_, child.output)) --- End diff -- How did you see errors here? I removed `@transient` and `sbt sql/test` still works for me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-112834131 Hmm...this PR doesn't change the handling of `Limit(Sort(Aggregate))`, it just swap `Limit` and `Project`(and combine them) for case `Project(Limit(Sort(...)))`, is it safe to do so? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-112664289 How about the `Limit(Sort(Aggregate))`, will that be a bug? Sorry, I didn't test it, can you confirm that? Probably it's not a good idea to put 3 functionalities into a single physical operator. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/6780#discussion_r32394261 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -160,17 +166,22 @@ case class TakeOrdered(limit: Int, sortOrder: Seq[SortOrder], child: SparkPlan) private val ord: RowOrdering = new RowOrdering(sortOrder, child.output) - private def collectData(): Array[InternalRow] = -child.execute().map(_.copy()).takeOrdered(limit)(ord) + @transient private val projection = projectList.map(newProjection(_, child.output)) --- End diff -- I'm confused here that we have to add `@transient` for it to avoid `NotSerializableException` . It looks to me that `TakeOrderedAndProject` should run on driver side and it doesn't pass its reference to RDD functions. Sorry if I missed something here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111932724 [Test build #34904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34904/console) for PR 6780 at commit [`0d53727`](https://github.com/apache/spark/commit/0d53727f91048007c10973358e5ae580aaf3187e). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111932787 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111912520 [Test build #34904 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34904/consoleFull) for PR 6780 at commit [`0d53727`](https://github.com/apache/spark/commit/0d53727f91048007c10973358e5ae580aaf3187e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111912002 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111911994 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111910688 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111910677 [Test build #34901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34901/console) for PR 6780 at commit [`edfdc6f`](https://github.com/apache/spark/commit/edfdc6f3c52653155b38574b0fc93a03ce7baf50). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111905596 [Test build #34901 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34901/consoleFull) for PR 6780 at commit [`edfdc6f`](https://github.com/apache/spark/commit/edfdc6f3c52653155b38574b0fc93a03ce7baf50). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111905415 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111905428 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111856384 [Test build #34892 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34892/console) for PR 6780 at commit [`91d798d`](https://github.com/apache/spark/commit/91d798d66e2dbc3375ea20aabfbdb13aaff5f243). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class JoinedRow extends InternalRow ` * `class JoinedRow2 extends InternalRow ` * `class JoinedRow3 extends InternalRow ` * `class JoinedRow4 extends InternalRow ` * `class JoinedRow5 extends InternalRow ` * `class JoinedRow6 extends InternalRow ` * `class BaseOrdering extends Ordering[InternalRow] ` * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111856389 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111854594 [Test build #34892 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34892/consoleFull) for PR 6780 at commit [`91d798d`](https://github.com/apache/spark/commit/91d798d66e2dbc3375ea20aabfbdb13aaff5f243). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111854468 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111854434 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111852504 [Test build #34890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34890/console) for PR 6780 at commit [`3c7dab0`](https://github.com/apache/spark/commit/3c7dab0f38442a8b5c635c7439b9bf1ff8670ebc). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class JoinedRow extends InternalRow ` * `class JoinedRow2 extends InternalRow ` * `class JoinedRow3 extends InternalRow ` * `class JoinedRow4 extends InternalRow ` * `class JoinedRow5 extends InternalRow ` * `class JoinedRow6 extends InternalRow ` * `class BaseOrdering extends Ordering[InternalRow] ` * `case class TakeOrderedAndProject(` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111852511 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111851845 [Test build #34890 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/34890/consoleFull) for PR 6780 at commit [`3c7dab0`](https://github.com/apache/spark/commit/3c7dab0f38442a8b5c635c7439b9bf1ff8670ebc). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111851807 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7289] handle project -> limit -> sort e...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6780#issuecomment-111851812 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
