[jira] [Assigned] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18106: Assignee: Apache Spark > Analyze Table accepts a garbage identifier at the end >

[jira] [Assigned] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18106: Assignee: (was: Apache Spark) > Analyze Table accepts a garbage identifier at the end

[jira] [Commented] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607496#comment-15607496 ] Apache Spark commented on SPARK-18106: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-18110) Missing parameter in Python for RandomForest regression and classification

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18110: Assignee: Felix Cheung (was: Apache Spark) > Missing parameter in Python for

[jira] [Commented] (SPARK-18110) Missing parameter in Python for RandomForest regression and classification

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607444#comment-15607444 ] Apache Spark commented on SPARK-18110: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-18110) Missing parameter in Python for RandomForest regression and classification

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18110: Assignee: Apache Spark (was: Felix Cheung) > Missing parameter in Python for

[jira] [Created] (SPARK-18110) Missing parameter in Python for RandomForest regression and classification

2016-10-25 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-18110: Summary: Missing parameter in Python for RandomForest regression and classification Key: SPARK-18110 URL: https://issues.apache.org/jira/browse/SPARK-18110 Project:

[jira] [Resolved] (SPARK-18007) update SparkR MLP - add initalWeights parameter

2016-10-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18007. -- Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 2.1.0 > update SparkR

[jira] [Comment Edited] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607374#comment-15607374 ] Dongjoon Hyun edited comment on SPARK-18106 at 10/26/16 4:31 AM: - Thank

[jira] [Comment Edited] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607374#comment-15607374 ] Dongjoon Hyun edited comment on SPARK-18106 at 10/26/16 4:30 AM: - Thank

[jira] [Commented] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607374#comment-15607374 ] Dongjoon Hyun commented on SPARK-18106: --- Thank you for reporting this bug, [~skomatir]. I'll make a

[jira] [Commented] (SPARK-18036) Decision Trees do not handle edge cases

2016-10-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607357#comment-15607357 ] Weichen Xu commented on SPARK-18036: i am working on this... > Decision Trees do not handle edge

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607343#comment-15607343 ] Dilip Biswal commented on SPARK-18009: -- [~smilegator][~jerryjung] [~martha.solarte] Thanks. I am

[jira] [Closed] (SPARK-17881) Aggregation function for generating string histograms

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang closed SPARK-17881. Resolution: Duplicate > Aggregation function for generating string histograms >

[jira] [Commented] (SPARK-17881) Aggregation function for generating string histograms

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607308#comment-15607308 ] Zhenhua Wang commented on SPARK-17881: -- This issue is included in another issue SPARK-18000, so I'll

[jira] [Issue Comment Deleted] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18000: - Comment: was deleted (was: This issue is included in another issue SPARK-17881, so I'll close

[jira] [Commented] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607306#comment-15607306 ] Zhenhua Wang commented on SPARK-18000: -- This issue is included in another issue SPARK-17881, so I'll

[jira] [Updated] (SPARK-17074) generate histogram information for column

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17074: - Description: We support two kinds of histograms: - Equi-width histogram: We have a fixed

[jira] [Assigned] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18000: Assignee: Apache Spark > Aggregation function for computing endpoints for histograms >

[jira] [Commented] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607297#comment-15607297 ] Apache Spark commented on SPARK-18000: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18000: Assignee: (was: Apache Spark) > Aggregation function for computing endpoints for

[jira] [Commented] (SPARK-18109) Log instrumentation in GMM

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607289#comment-15607289 ] Apache Spark commented on SPARK-18109: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-18109) Log instrumentation in GMM

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18109: Assignee: (was: Apache Spark) > Log instrumentation in GMM >

[jira] [Assigned] (SPARK-18109) Log instrumentation in GMM

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18109: Assignee: Apache Spark > Log instrumentation in GMM > -- > >

[jira] [Created] (SPARK-18109) Log instrumentation in GMM

2016-10-25 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-18109: Summary: Log instrumentation in GMM Key: SPARK-18109 URL: https://issues.apache.org/jira/browse/SPARK-18109 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18000: - Description: For a column, we will generate a equi-width or equi-height histogram, depending on

[jira] [Comment Edited] (SPARK-17935) Add KafkaForeachWriter in external kafka-0.8.0 for structured streaming module

2016-10-25 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601778#comment-15601778 ] zhangxinyu edited comment on SPARK-17935 at 10/26/16 3:26 AM: -- h2. KafkaSink

[jira] [Updated] (SPARK-18000) Aggregation function for computing endpoints for histograms

2016-10-25 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18000: - Summary: Aggregation function for computing endpoints for histograms (was: Aggregation function

[jira] [Commented] (SPARK-18100) Improve the performance of get_json_object using Gson

2016-10-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607204#comment-15607204 ] Liang-Chi Hsieh commented on SPARK-18100: - Looks like Gson has no native support for json path?

[jira] [Updated] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-10-25 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Moorhead updated SPARK-18108: - Attachment: stacktrace.out > Partition discovery fails with explicitly written long

[jira] [Created] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-10-25 Thread Richard Moorhead (JIRA)
Richard Moorhead created SPARK-18108: Summary: Partition discovery fails with explicitly written long partitions Key: SPARK-18108 URL: https://issues.apache.org/jira/browse/SPARK-18108 Project:

[jira] [Created] (SPARK-18107) Insert overwrite statement runs much slower in spark-sql than it does in hive-client

2016-10-25 Thread J.P Feng (JIRA)
J.P Feng created SPARK-18107: Summary: Insert overwrite statement runs much slower in spark-sql than it does in hive-client Key: SPARK-18107 URL: https://issues.apache.org/jira/browse/SPARK-18107

[jira] [Comment Edited] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Jerryjung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607052#comment-15607052 ] Jerryjung edited comment on SPARK-18009 at 10/26/16 1:44 AM: - Yes! In my

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Jerryjung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607052#comment-15607052 ] Jerryjung commented on SPARK-18009: --- Yes! But In my case, it's necessary option for integration with BI

[jira] [Assigned] (SPARK-18103) Rename *FileCatalog to *FileProvider

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18103: Assignee: (was: Apache Spark) > Rename *FileCatalog to *FileProvider >

[jira] [Assigned] (SPARK-18103) Rename *FileCatalog to *FileProvider

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18103: Assignee: Apache Spark > Rename *FileCatalog to *FileProvider >

[jira] [Commented] (SPARK-18103) Rename *FileCatalog to *FileProvider

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607020#comment-15607020 ] Apache Spark commented on SPARK-18103: -- User 'ericl' has created a pull request for this issue:

[jira] [Closed] (SPARK-18077) Run insert overwrite statements in spark to overwrite a partitioned table is very slow

2016-10-25 Thread J.P Feng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.P Feng closed SPARK-18077. Resolution: Won't Fix i would try to open another one, for there are some mistakes in this issue. > Run

[jira] [Assigned] (SPARK-18087) Optimize insert to not require REPAIR TABLE

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18087: Assignee: Apache Spark > Optimize insert to not require REPAIR TABLE >

[jira] [Assigned] (SPARK-18087) Optimize insert to not require REPAIR TABLE

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18087: Assignee: (was: Apache Spark) > Optimize insert to not require REPAIR TABLE >

[jira] [Commented] (SPARK-18087) Optimize insert to not require REPAIR TABLE

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606990#comment-15606990 ] Apache Spark commented on SPARK-18087: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18087) Optimize insert to not require REPAIR TABLE

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18087: Assignee: (was: Apache Spark) > Optimize insert to not require REPAIR TABLE >

[jira] [Assigned] (SPARK-18087) Optimize insert to not require REPAIR TABLE

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18087: Assignee: Apache Spark > Optimize insert to not require REPAIR TABLE >

[jira] [Updated] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Srinath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinath updated SPARK-18106: Description: {noformat} scala> sql("create table test(a int)") res2: org.apache.spark.sql.DataFrame = []

[jira] [Updated] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Srinath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinath updated SPARK-18106: Description: {noformat} scala> sql("create table test(a int)") res2: org.apache.spark.sql.DataFrame = []

[jira] [Created] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

2016-10-25 Thread Srinath (JIRA)
Srinath created SPARK-18106: --- Summary: Analyze Table accepts a garbage identifier at the end Key: SPARK-18106 URL: https://issues.apache.org/jira/browse/SPARK-18106 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606896#comment-15606896 ] Tathagata Das commented on SPARK-17829: --- Based on [~tcondie] PR above, I think its better we also

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606849#comment-15606849 ] Apache Spark commented on SPARK-18105: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18105: Assignee: Apache Spark (was: Davies Liu) > LZ4 failed to decompress a stream of shuffled

[jira] [Assigned] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18105: Assignee: Davies Liu (was: Apache Spark) > LZ4 failed to decompress a stream of shuffled

[jira] [Created] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2016-10-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-18105: -- Summary: LZ4 failed to decompress a stream of shuffled data Key: SPARK-18105 URL: https://issues.apache.org/jira/browse/SPARK-18105 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-18104) Don't build KafkaSource doc

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18104: Assignee: Shixiong Zhu (was: Apache Spark) > Don't build KafkaSource doc >

[jira] [Commented] (SPARK-18104) Don't build KafkaSource doc

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606795#comment-15606795 ] Apache Spark commented on SPARK-18104: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18104) Don't build KafkaSource doc

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18104: Assignee: Apache Spark (was: Shixiong Zhu) > Don't build KafkaSource doc >

[jira] [Created] (SPARK-18104) Don't build KafkaSource doc

2016-10-25 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-18104: Summary: Don't build KafkaSource doc Key: SPARK-18104 URL: https://issues.apache.org/jira/browse/SPARK-18104 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606693#comment-15606693 ] Xiao Li commented on SPARK-18009: - [~dkbiswal] Please fix it tonight. Thanks! > Spark 2.0.1 SQL Thrift

[jira] [Updated] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18009: Labels: thrift (was: sql thrift) > Spark 2.0.1 SQL Thrift Error > > >

[jira] [Updated] (SPARK-18009) Spark 2.0.1 SQL Thrift Error

2016-10-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18009: Target Version/s: 2.0.1, 2.1.0 > Spark 2.0.1 SQL Thrift Error > > >

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: (was: Spark Core) Web UI > spark history server log needs

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: (was: Spark Shell) > spark history server log needs to be fixed to show

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Component/s: Spark Core > spark history server log needs to be fixed to show https url when

[jira] [Resolved] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-16988. Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 > spark history

[jira] [Updated] (SPARK-16988) spark history server log needs to be fixed to show https url when ssl is enabled

2016-10-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-16988: --- Assignee: chie hayashida > spark history server log needs to be fixed to show https url when

[jira] [Commented] (SPARK-15482) ClassCast exception when join two tables.

2016-10-25 Thread roberto sancho rojas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606601#comment-15606601 ] roberto sancho rojas commented on SPARK-15482: -- I have the same problem, whe i execute this

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

2016-10-25 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606523#comment-15606523 ] Alex Bozarth commented on SPARK-18085: -- I am *very* interested in working with you on this project

[jira] [Updated] (SPARK-18014) Filters are incorrectly being grouped together when there is processing in between

2016-10-25 Thread Michael Patterson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Patterson updated SPARK-18014: -- Environment: Pyspark 2.0.0, Ipython 4.2 (was: Pyspark 2.0.1, Ipython 4.2) > Filters

[jira] [Commented] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access

2016-10-25 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606484#comment-15606484 ] Nicholas Chammas commented on SPARK-18084: -- cc [~marmbrus] - Dunno if this is actually bug or

[jira] [Created] (SPARK-18103) Rename *FileCatalog to *FileProvider

2016-10-25 Thread Eric Liang (JIRA)
Eric Liang created SPARK-18103: -- Summary: Rename *FileCatalog to *FileProvider Key: SPARK-18103 URL: https://issues.apache.org/jira/browse/SPARK-18103 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18102) Failed to deserialize the result of task

2016-10-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-18102: -- Summary: Failed to deserialize the result of task Key: SPARK-18102 URL: https://issues.apache.org/jira/browse/SPARK-18102 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18101) ExternalCatalogSuite should test with mixed case fields

2016-10-25 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Liang updated SPARK-18101: --- Issue Type: Sub-task (was: Test) Parent: SPARK-17861 > ExternalCatalogSuite should test

[jira] [Created] (SPARK-18101) ExternalCatalogSuite should test with mixed case fields

2016-10-25 Thread Eric Liang (JIRA)
Eric Liang created SPARK-18101: -- Summary: ExternalCatalogSuite should test with mixed case fields Key: SPARK-18101 URL: https://issues.apache.org/jira/browse/SPARK-18101 Project: Spark Issue

[jira] [Assigned] (SPARK-17471) Add compressed method for Matrix class

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17471: Assignee: Apache Spark > Add compressed method for Matrix class >

[jira] [Commented] (SPARK-17471) Add compressed method for Matrix class

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606347#comment-15606347 ] Apache Spark commented on SPARK-17471: -- User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17471) Add compressed method for Matrix class

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17471: Assignee: (was: Apache Spark) > Add compressed method for Matrix class >

[jira] [Resolved] (SPARK-18019) Log instrumentation in GBTs

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18019. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15574

[jira] [Updated] (SPARK-18100) Improve the performance of get_json_object using Gson

2016-10-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18100: --- Issue Type: Improvement (was: Bug) > Improve the performance of get_json_object using Gson >

[jira] [Created] (SPARK-18100) Improve the performance of get_json_object using Gson

2016-10-25 Thread Davies Liu (JIRA)
Davies Liu created SPARK-18100: -- Summary: Improve the performance of get_json_object using Gson Key: SPARK-18100 URL: https://issues.apache.org/jira/browse/SPARK-18100 Project: Spark Issue

[jira] [Issue Comment Deleted] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Comment: was deleted (was: Calling this a bug since FPR is not implemented correctly.)

[jira] [Resolved] (SPARK-18070) binary operator should not consider nullability when comparing input types

2016-10-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18070. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 Issue resolved by pull request

[jira] [Commented] (SPARK-17692) Document ML/MLlib behavior changes in Spark 2.1

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606178#comment-15606178 ] Joseph K. Bradley commented on SPARK-17692: --- [SPARK-17870] changes the output of ChiSqSelector.

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606146#comment-15606146 ] Joseph K. Bradley commented on SPARK-18088: --- How do you feel about renaming the selectorType

[jira] [Updated] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Priority: Minor (was: Major) > ChiSqSelector FPR PR cleanups >

[jira] [Updated] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Issue Type: Improvement (was: Bug) > ChiSqSelector FPR PR cleanups >

[jira] [Commented] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606142#comment-15606142 ] Joseph K. Bradley commented on SPARK-18088: --- Ahh, you're right, sorry, I see that now that I'm

[jira] [Updated] (SPARK-18088) ChiSqSelector FPR PR cleanups

2016-10-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18088: -- Description: There are several cleanups I'd like to make as a follow-up to the PRs

[jira] [Assigned] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18099: Assignee: Apache Spark > Spark distributed cache should throw exception if same file is

[jira] [Assigned] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18099: Assignee: (was: Apache Spark) > Spark distributed cache should throw exception if

[jira] [Commented] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15606068#comment-15606068 ] Apache Spark commented on SPARK-18099: -- User 'kishorvpatil' has created a pull request for this

[jira] [Created] (SPARK-18099) Spark distributed cache should throw exception if same file is specified to dropped in --files --archives

2016-10-25 Thread Kishor Patil (JIRA)
Kishor Patil created SPARK-18099: Summary: Spark distributed cache should throw exception if same file is specified to dropped in --files --archives Key: SPARK-18099 URL:

[jira] [Updated] (SPARK-16183) Large Spark SQL commands cause StackOverflowError in parser when using sqlContext.sql

2016-10-25 Thread Matthew Porter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Porter updated SPARK-16183: --- Affects Version/s: 2.0.0 > Large Spark SQL commands cause StackOverflowError in parser when

[jira] [Resolved] (SPARK-18010) Remove unneeded heavy work performed by FsHistoryProvider for building up the application listing UI page

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18010. Resolution: Fixed Assignee: Vinayak Joshi Fix Version/s: 2.1.0 > Remove

[jira] [Commented] (SPARK-18098) Broadcast creates 1 instance / core, not 1 instance / executor

2016-10-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605898#comment-15605898 ] Sean Owen commented on SPARK-18098: --- It shouldn't work that way. The value is loaded in a lazy val, at

[jira] [Commented] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605879#comment-15605879 ] Apache Spark commented on SPARK-17829: -- User 'tcondie' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17829: Assignee: Tyson Condie (was: Apache Spark) > Stable format for offset log >

[jira] [Assigned] (SPARK-17829) Stable format for offset log

2016-10-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17829: Assignee: Apache Spark (was: Tyson Condie) > Stable format for offset log >

[jira] [Created] (SPARK-18098) Broadcast creates 1 instance / core, not 1 instance / executor

2016-10-25 Thread Anthony Sciola (JIRA)
Anthony Sciola created SPARK-18098: -- Summary: Broadcast creates 1 instance / core, not 1 instance / executor Key: SPARK-18098 URL: https://issues.apache.org/jira/browse/SPARK-18098 Project: Spark

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605820#comment-15605820 ] Marcelo Vanzin commented on SPARK-6951: --- I reopened this after discussion in the bug; the other

[jira] [Reopened] (SPARK-6951) History server slow startup if the event log directory is large

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-6951: --- > History server slow startup if the event log directory is large >

[jira] [Commented] (SPARK-18085) Scalability enhancements for the History Server

2016-10-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605815#comment-15605815 ] Marcelo Vanzin commented on SPARK-18085: It's mildly related. The changes here don't do anything

[jira] [Updated] (SPARK-18097) Can't drop a table from Hive if the schema is corrupt

2016-10-25 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18097: --- Description: When the schema of Hive table is broken, we can't drop the table using Spark SQL, for

  1   2   >