[GitHub] purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel

purijatin commented on issue #23549: [SPARK-26616][MLlib] Expose document frequency in IDFModel URL: https://github.com/apache/spark/pull/23549#issuecomment-456303653 Squashed the commits. I believe nothing more to be done? T

[GitHub] zjf2012 commented on a change in pull request #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

zjf2012 commented on a change in pull request #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r249670978 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] gczsjdy commented on a change in pull request #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

gczsjdy commented on a change in pull request #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r249665643 ## File path: core/src/main/scala/org/apache/spark/network/netty/SparkTranspor

[GitHub] gczsjdy commented on a change in pull request #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

gczsjdy commented on a change in pull request #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#discussion_r249665381 ## File path: core/src/main/scala/org/apache/spark/rpc/netty/Dispatcher.scala

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r249662928 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r249663038 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] carsonwang commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

carsonwang commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-456297978 cc @cloud-fan @vanzin @jerryshao, can you please help review this? In our test, configuring RPC threa

[GitHub] AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456297600 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456297601 Test PASSed. Refer to this link for build resu

[GitHub] AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456297600 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456297601 Test PASSed. Refer to this link for build results (acc

[GitHub] SparkQA removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

SparkQA removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456255753 **[Test build #101507 has started](https://amplab.cs.b

[GitHub] SparkQA commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

SparkQA commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456297149 **[Test build #101507 has finished](https://amplab.cs.berkeley.

[GitHub] carsonwang commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor

carsonwang commented on issue #23560: [SPARK-26632][Spark Core] Separate Thread Configurations of Driver and Executor URL: https://github.com/apache/spark/pull/23560#issuecomment-456296713 @zjf2012 , can you please update the PR description with the performance test result? --

[GitHub] AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456296072 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456296066 Merged build finished. Test FAILed.

[GitHub] SparkQA removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

SparkQA removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456293946 **[Test build #101514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1015

[GitHub] SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456296053 **[Test build #101514 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101514/test

[GitHub] AmplabJenkins commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

AmplabJenkins commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456296072 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] AmplabJenkins commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

AmplabJenkins commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456296066 Merged build finished. Test FAILed. This is

[GitHub] AmplabJenkins removed a comment on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

AmplabJenkins removed a comment on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#issuecomment-456295503 Test FAILed. Refer to this link for build results (access rig

[GitHub] AmplabJenkins removed a comment on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

AmplabJenkins removed a comment on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#issuecomment-456295496 Merged build finished. Test FAILed. ---

[GitHub] AmplabJenkins commented on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

AmplabJenkins commented on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#issuecomment-456295503 Test FAILed. Refer to this link for build results (access rights to C

[GitHub] AmplabJenkins commented on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

AmplabJenkins commented on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#issuecomment-456295496 Merged build finished. Test FAILed. ---

[GitHub] SparkQA removed a comment on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

SparkQA removed a comment on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#issuecomment-456259921 **[Test build #101508 has started](https://amplab.cs.berkeley.edu/jen

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r249662928 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r249663038 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] SparkQA commented on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

SparkQA commented on issue #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#issuecomment-456295278 **[Test build #101508 has finished](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456293946 **[Test build #101514 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101514/testR

[GitHub] AmplabJenkins removed a comment on issue #18324: [SPARK-21045][PYSPARK]Fixed executor blocked because traceback.format_exc throw UnicodeDecodeError

AmplabJenkins removed a comment on issue #18324: [SPARK-21045][PYSPARK]Fixed executor blocked because traceback.format_exc throw UnicodeDecodeError URL: https://github.com/apache/spark/pull/18324#issuecomment-395924661 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins commented on issue #18324: [SPARK-21045][PYSPARK]Fixed executor blocked because traceback.format_exc throw UnicodeDecodeError

AmplabJenkins commented on issue #18324: [SPARK-21045][PYSPARK]Fixed executor blocked because traceback.format_exc throw UnicodeDecodeError URL: https://github.com/apache/spark/pull/18324#issuecomment-456292552 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456291694 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456291701 Test PASSed. Refer to this link for build resu

[GitHub] AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456291701 Test PASSed. Refer to this link for build results (acc

[GitHub] AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

AmplabJenkins commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456291694 Merged build finished. Test PASSed.

[GitHub] asfgit closed pull request #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

asfgit closed pull request #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807 This is an automated message from the Apache Git Service.

[GitHub] SparkQA removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

SparkQA removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456249692 **[Test build #101505 has started](https://amplab.cs.b

[GitHub] SparkQA commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

SparkQA commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456291305 **[Test build #101505 has finished](https://amplab.cs.berkeley.

[GitHub] AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456290717 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456290719 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456290717 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456290719 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] SparkQA removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

SparkQA removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456252235 **[Test build #101506 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] HyukjinKwon commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

HyukjinKwon commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456290424 Merged to master. This is an au

[GitHub] SparkQA commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

SparkQA commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456290355 **[Test build #101506 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] HyukjinKwon removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

HyukjinKwon removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-456268682 retest this please T

[GitHub] j-esse commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

j-esse commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#issuecomment-456285994 That's right, the primary concern is memory usage, since the exponential increase in memory usage c

[GitHub] ayudovin commented on a change in pull request #23569: [SPARK-25713][SQL] - adding copy for ColumnArray

ayudovin commented on a change in pull request #23569: [SPARK-25713][SQL] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r249653823 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46,

[GitHub] HyukjinKwon commented on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

HyukjinKwon commented on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456285286 Gotya, yea, I am interested in it of course. I'll start to work on that after this PR merged.

[GitHub] AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456285049 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456285047 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456285047 Merged build finished. Test PASSed. This is an auto

[GitHub] SparkQA removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

SparkQA removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456273555 **[Test build #101511 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101511/testR

[GitHub] AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456285049 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] SparkQA commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

SparkQA commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456284865 **[Test build #101511 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101511/testReport)*

[GitHub] felixcheung commented on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

felixcheung commented on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456283298 I was thinking a blog post in the Arrow project ;)

[GitHub] AmplabJenkins commented on issue #22954: [SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

AmplabJenkins commented on issue #22954: [SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456282202 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] AmplabJenkins removed a comment on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

AmplabJenkins removed a comment on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456282200 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins removed a comment on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

AmplabJenkins removed a comment on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456282202 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] AmplabJenkins commented on issue #22954: [SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

AmplabJenkins commented on issue #22954: [SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456282200 Merged build finished. Test PASSed. --

[GitHub] gatorsmile commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

gatorsmile commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r249650498 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExterna

[GitHub] gatorsmile commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

gatorsmile commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r249650183 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExterna

[GitHub] SparkQA commented on issue #22954: [SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

SparkQA commented on issue #22954: [SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456281016 **[Test build #101513 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456279408 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456279404 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456279404 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456279408 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] SparkQA commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

SparkQA commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456279226 **[Test build #101512 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101512/testRe

[GitHub] liupc commented on issue #23445: [SPARK-26530]Validate heartheat arguments in HeartbeatReceiver

liupc commented on issue #23445: [SPARK-26530]Validate heartheat arguments in HeartbeatReceiver URL: https://github.com/apache/spark/pull/23445#issuecomment-456278546 > I think these need to reference the new config.* fields rather than use the properties by string key? @srowen done

[GitHub] LuciferYang commented on issue #22149: [SPARK-25158][SQL]Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException.

LuciferYang commented on issue #22149: [SPARK-25158][SQL]Executor accidentally exit because ScriptTransformationWriterThread throws TaskKilledException. URL: https://github.com/apache/spark/pull/22149#issuecomment-456276774 @cloud-fan ok~ ---

[GitHub] shahidki31 commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

shahidki31 commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#discussion_r249644358 ## File path: core/src/main/scala/org/apache/sp

[GitHub] LantaoJin commented on a change in pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

LantaoJin commented on a change in pull request #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#discussion_r249644658 ## File path: core/src/main/scala/org/apache/spark/metrics/ExecutorMetricType.scala ## @

[GitHub] liupc commented on a change in pull request #23580: [SPARK-26660]Add warning logs when broadcasting large task binary

liupc commented on a change in pull request #23580: [SPARK-26660]Add warning logs when broadcasting large task binary URL: https://github.com/apache/spark/pull/23580#discussion_r249644541 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@

[GitHub] shahidki31 commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

shahidki31 commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#discussion_r249644358 ## File path: core/src/main/scala/org/apache/sp

[GitHub] shahidki31 commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

shahidki31 commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#discussion_r249644358 ## File path: core/src/main/scala/org/apache/sp

[GitHub] shahidki31 closed pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

shahidki31 closed pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605 This is an automated message f

[GitHub] AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456273754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins removed a comment on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456273749 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456273749 Merged build finished. Test PASSed. This is an auto

[GitHub] AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

AmplabJenkins commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456273754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] kiszk commented on a change in pull request #23416: [SPARK-26463][CORE] Use ConfigEntry for hardcoded configs for scheduler categories.

kiszk commented on a change in pull request #23416: [SPARK-26463][CORE] Use ConfigEntry for hardcoded configs for scheduler categories. URL: https://github.com/apache/spark/pull/23416#discussion_r249643440 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseG

[GitHub] SparkQA commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees

SparkQA commented on issue #21632: [SPARK-19591][ML][MLlib] Add sample weights to decision trees URL: https://github.com/apache/spark/pull/21632#issuecomment-456273555 **[Test build #101511 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101511/testReport)**

[GitHub] HeartSaVioR commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration'

HeartSaVioR commented on a change in pull request #23605: [SPARK-26650][CORE]Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' URL: https://github.com/apache/spark/pull/23605#discussion_r249643313 ## File path: core/src/main/scala/org/apache/s

[GitHub] kiszk commented on a change in pull request #23416: [SPARK-26463][CORE] Use ConfigEntry for hardcoded configs for scheduler categories.

kiszk commented on a change in pull request #23416: [SPARK-26463][CORE] Use ConfigEntry for hardcoded configs for scheduler categories. URL: https://github.com/apache/spark/pull/23416#discussion_r249643254 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/sp

[GitHub] AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271584 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271564 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271582 Merged build finished. Test FAILed.

[GitHub] SparkQA removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

SparkQA removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271351 **[Test build #101510 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10151

[GitHub] AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins removed a comment on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271562 Merged build finished. Test PASSed.

[GitHub] cloud-fan commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

cloud-fan commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#discussion_r249641960 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTy

[GitHub] cloud-fan commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

cloud-fan commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#discussion_r249641907 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalys

[GitHub] AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271582 Merged build finished. Test FAILed. This is

[GitHub] AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456271560 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456271557 Merged build finished. Test PASSed. This is an aut

[GitHub] AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456271557 Merged build finished. Test PASSed. This i

[GitHub] SparkQA commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

SparkQA commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271578 **[Test build #101510 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101510/testR

[GitHub] AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271584 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271564 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456271560 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

AmplabJenkins commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456271562 Merged build finished. Test PASSed. This is

  1   2   3   4   5   6   7   8   >