[GitHub] maropu commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
maropu commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451074885 Thanks, @dongjoon-hyun! btw, we need `[BACKPORT-2.2]` in the title? -

[GitHub] dongjoon-hyun commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
dongjoon-hyun commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451071964 Also, cc @gatorsmile and @cloud-fan -

[GitHub] dongjoon-hyun edited a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
dongjoon-hyun edited a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451054965 This is a cherry-pick of #20174 (correctness fix) and will be merged as @liufengdb

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244924182 ## File path: core/src/main/scala/org/apache/spark/internal/con

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244924272 ## File path: core/src/main/scala/org/apache/spark/internal/con

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244924182 ## File path: core/src/main/scala/org/apache/spark/internal/con

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244924182 ## File path: core/src/main/scala/org/apache/spark/internal/con

[GitHub] AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451069894 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451069894 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451069898 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451069898 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451055195 **[Test build #100668 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] SparkQA commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
SparkQA commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451069787 **[Test build #100668 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] AmplabJenkins commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-451068599 Build finished. Test PASSed. This is an automated mes

[GitHub] AmplabJenkins removed a comment on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-451068599 Build finished. Test PASSed. This is an autom

[GitHub] AmplabJenkins commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-451068600 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] AmplabJenkins removed a comment on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-451068600 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] SparkQA removed a comment on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-451038864 **[Test build #100664 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100664/testRep

[GitHub] SparkQA commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2019-01-02 Thread GitBox
SparkQA commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-451068440 **[Test build #100664 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100664/testReport)**

[GitHub] SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451067593 **[Test build #100675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451066910 Test FAILed. Refer to this link for build results (access r

[GitHub] AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451066909 Merged build finished. Test FAILed. -

[GitHub] AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451066910 Test FAILed. Refer to this link for build results (access rights to

[GitHub] AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451066909 Merged build finished. Test FAILed. --

[GitHub] SparkQA removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064129 **[Test build #100674 has started](https://amplab.cs.berkeley.edu/je

[GitHub] SparkQA commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
SparkQA commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451066842 **[Test build #100674 has finished](https://amplab.cs.berkeley.edu/jenkins/j

[GitHub] SandishKumarHN commented on a change in pull request #23401: [SPARK-26513][Core] : Trigger GC on executor node idle

2019-01-02 Thread GitBox
SandishKumarHN commented on a change in pull request #23401: [SPARK-26513][Core] : Trigger GC on executor node idle URL: https://github.com/apache/spark/pull/23401#discussion_r244906556 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -628,6

[GitHub] xuanyuanking commented on a change in pull request #22962: [SPARK-25921][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
xuanyuanking commented on a change in pull request #22962: [SPARK-25921][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/22962#discussion_r233283645 ## File path: python/pyspark/taskcontext.py ##

[GitHub] AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064815 Test PASSed. Refer to this link for build results (access r

[GitHub] AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064813 Merged build finished. Test PASSed. -

[GitHub] xuanyuanking commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-02 Thread GitBox
xuanyuanking commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-451064869 Gentle ping @gatorsmile and @cloud-fan. More details described in description of [SPARK-26397](https://issues.apache.org/jir

[GitHub] AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064815 Test PASSed. Refer to this link for build results (access rights to

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244919000 ## File path: core/src/main/scala/org/apache/spark/internal/con

[GitHub] AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064813 Merged build finished. Test PASSed. --

[GitHub] xuanyuanking commented on issue #23378: [SPARK-26225][SQL] Track decoding time for each record in scan node

2019-01-02 Thread GitBox
xuanyuanking commented on issue #23378: [SPARK-26225][SQL] Track decoding time for each record in scan node URL: https://github.com/apache/spark/pull/23378#issuecomment-451064561 Gentle ping @cloud-fan and @gatorsmile. This i

[GitHub] xuanyuanking commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
xuanyuanking commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064249 cc @HyukjinKwon and @cloud-fan. Sorry for the late about this follow-

[GitHub] SparkQA commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
SparkQA commented on issue #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435#issuecomment-451064129 **[Test build #100674 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] xuanyuanking opened a new pull request #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse

2019-01-02 Thread GitBox
xuanyuanking opened a new pull request #23435: [SPARK-25921][Follow Up][PySpark] Fix barrier task run without BarrierTaskContext while python worker reuse URL: https://github.com/apache/spark/pull/23435 ## What changes were proposed in this pull request? It's the follow-up PR for #2

[GitHub] HeartSaVioR commented on issue #23020: [MINOR][BUILD] Remove *.crc from .gitignore

2019-01-02 Thread GitBox
HeartSaVioR commented on issue #23020: [MINOR][BUILD] Remove *.crc from .gitignore URL: https://github.com/apache/spark/pull/23020#issuecomment-451063954 @srowen Never mind. Looks like I added these files to #22170 but forgot to delete them. This patch made them reappear. Sorry for fal

[GitHub] srowen commented on a change in pull request #23424: [SPARK-24421][CORE][FOLLOWUP] Use normal direct ByteBuffer allocation if Cleaner can't be set

2019-01-02 Thread GitBox
srowen commented on a change in pull request #23424: [SPARK-24421][CORE][FOLLOWUP] Use normal direct ByteBuffer allocation if Cleaner can't be set URL: https://github.com/apache/spark/pull/23424#discussion_r244918136 ## File path: common/unsafe/src/main/java/org/apache/spark/unsafe

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244917210 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllo

[GitHub] AmplabJenkins removed a comment on issue #23426: [CORE][MINOR] Let acquireUnrollMemory fail fast if required space exceeds memory limit

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23426: [CORE][MINOR] Let acquireUnrollMemory fail fast if required space exceeds memory limit URL: https://github.com/apache/spark/pull/23426#issuecomment-450824795 Can one of the admins verify this patch? --

[GitHub] SparkQA commented on issue #23426: [CORE][MINOR] Let acquireUnrollMemory fail fast if required space exceeds memory limit

2019-01-02 Thread GitBox
SparkQA commented on issue #23426: [CORE][MINOR] Let acquireUnrollMemory fail fast if required space exceeds memory limit URL: https://github.com/apache/spark/pull/23426#issuecomment-451063064 **[Test build #4494 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBu

[GitHub] srowen commented on issue #23020: [MINOR][BUILD] Remove *.crc from .gitignore

2019-01-02 Thread GitBox
srowen commented on issue #23020: [MINOR][BUILD] Remove *.crc from .gitignore URL: https://github.com/apache/spark/pull/23020#issuecomment-451062931 @HeartSaVioR that could be fine, but what is the problem? I'm not clear. Files that are in git should not be covered by ignore rules. .crc fil

[GitHub] dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories.

2019-01-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #23415: [SPARK-26445][CORE] Use ConfigEntry for hardcoded configs for driver/executor categories. URL: https://github.com/apache/spark/pull/23415#discussion_r244917210 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllo

[GitHub] AmplabJenkins removed a comment on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort URL: https://github.com/apache/spark/pull/23163#issuecomment-451061853 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort URL: https://github.com/apache/spark/pull/23163#issuecomment-451061857 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] AmplabJenkins commented on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort URL: https://github.com/apache/spark/pull/23163#issuecomment-451061853 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort URL: https://github.com/apache/spark/pull/23163#issuecomment-451061857 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] SparkQA commented on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort

2019-01-02 Thread GitBox
SparkQA commented on issue #23163: [SPARK-26164][SQL] Allow FileFormatWriter to write multiple partitions/buckets without sort URL: https://github.com/apache/spark/pull/23163#issuecomment-451061785 **[Test build #100673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] yeikel edited a comment on issue #16881: [SPARK-19543] from_json fails when the input row is empty

2019-01-02 Thread GitBox
yeikel edited a comment on issue #16881: [SPARK-19543] from_json fails when the input row is empty URL: https://github.com/apache/spark/pull/16881#issuecomment-451060746 @HyukjinKwon I fixed it. Problem was the string `'[]'` replacing it with `'{}'` fixed the issue . I am not sure if the f

[GitHub] yeikel edited a comment on issue #16881: [SPARK-19543] from_json fails when the input row is empty

2019-01-02 Thread GitBox
yeikel edited a comment on issue #16881: [SPARK-19543] from_json fails when the input row is empty URL: https://github.com/apache/spark/pull/16881#issuecomment-451060746 @HyukjinKwon I fixed it. Problem was the string `'[]'` replacing it with '{}' fixed the issue . I am not sure if the fun

[GitHub] yeikel commented on issue #16881: [SPARK-19543] from_json fails when the input row is empty

2019-01-02 Thread GitBox
yeikel commented on issue #16881: [SPARK-19543] from_json fails when the input row is empty URL: https://github.com/apache/spark/pull/16881#issuecomment-451060746 @HyukjinKwon I fixed it. Problem was the string `'[]'` replacing it with '{}' fixed the issue . I commented here because I thou

[GitHub] AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451059382 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451058541 **[Test build #100672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451059379 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451059377 **[Test build #100672 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451059382 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451059379 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451058541 **[Test build #100672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] SparkQA commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451058085 **[Test build #100671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100671

[GitHub] AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451057545 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451056875 **[Test build #100670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451057541 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451057541 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451057545 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451057536 **[Test build #100670 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] HyukjinKwon commented on issue #16881: [SPARK-19543] from_json fails when the input row is empty

2019-01-02 Thread GitBox
HyukjinKwon commented on issue #16881: [SPARK-19543] from_json fails when the input row is empty URL: https://github.com/apache/spark/pull/16881#issuecomment-451057425 Can you show your df? Btw let's ask a question to mailing list next time. Here usually is supposed to discuss about the ch

[GitHub] AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451057009 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] SparkQA removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451055193 **[Test build #100669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100669/testRe

[GitHub] AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451057007 Merged build finished. Test PASSed. This is

[GitHub] SparkQA commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
SparkQA commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451056988 **[Test build #100669 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100669/testReport)**

[GitHub] AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451057007 Merged build finished. Test PASSed. This is an autom

[GitHub] AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451057009 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23428: [SPARK-26489][CORE] Use ConfigEntry for hardcoded configs for python/r categories URL: https://github.com/apache/spark/pull/23428#issuecomment-451056875 **[Test build #100670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] yeikel commented on issue #16881: [SPARK-19543] from_json fails when the input row is empty

2019-01-02 Thread GitBox
yeikel commented on issue #16881: [SPARK-19543] from_json fails when the input row is empty URL: https://github.com/apache/spark/pull/16881#issuecomment-451056164 @HyukjinKwon I've tried your suggestion with the following attempt : ``` val empty = df.na.fill("{}",Seq("phone"))

[GitHub] AmplabJenkins removed a comment on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens. URL: https://github.com/apache/spark/pull/23348#issuecomment-451055902 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins removed a comment on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens. URL: https://github.com/apache/spark/pull/23348#issuecomment-451055903 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens. URL: https://github.com/apache/spark/pull/23348#issuecomment-451055902 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens. URL: https://github.com/apache/spark/pull/23348#issuecomment-451055903 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] SparkQA removed a comment on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens. URL: https://github.com/apache/spark/pull/23348#issuecomment-451026526 **[Test build #100663 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] SparkQA commented on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

2019-01-02 Thread GitBox
SparkQA commented on issue #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens. URL: https://github.com/apache/spark/pull/23348#issuecomment-451055697 **[Test build #100663 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1006

[GitHub] AmplabJenkins removed a comment on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451055486 Test FAILed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] AmplabJenkins removed a comment on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451055484 Merged build finished. Test FAILed. --

[GitHub] SparkQA removed a comment on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
SparkQA removed a comment on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451054720 **[Test build #100667 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] AmplabJenkins commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451055484 Merged build finished. Test FAILed. T

[GitHub] AmplabJenkins commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451055486 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] SparkQA commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories

2019-01-02 Thread GitBox
SparkQA commented on issue #23423: [SPARK-26482][CORE] Use ConfigEntry for hardcoded configs for ui categories URL: https://github.com/apache/spark/pull/23423#issuecomment-451055478 **[Test build #100667 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10066

[GitHub] AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451055290 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451055293 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451055248 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451055290 Merged build finished. Test PASSed. This is an autom

[GitHub] AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451055293 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451055248 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins removed a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451055249 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
AmplabJenkins commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451055249 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
SparkQA commented on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451055195 **[Test build #100668 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] SparkQA commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2019-01-02 Thread GitBox
SparkQA commented on issue #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#issuecomment-451055193 **[Test build #100669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100669/testReport)**

[GitHub] dongjoon-hyun edited a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
dongjoon-hyun edited a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451054965 This is a cherry-pick of #20174 and will be merged as @liufengdb 's commit. cc @l

[GitHub] dongjoon-hyun edited a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes

2019-01-02 Thread GitBox
dongjoon-hyun edited a comment on issue #23434: [SPARK-22951][SQL][BRANCH-2.2] fix aggregation after dropDuplicates on empty dataframes URL: https://github.com/apache/spark/pull/23434#issuecomment-451054965 This is a cherry-pick of #20174 and will be merged as @liufengdb 's commit. cc @l

  1   2   3   4   5   6   7   >