[jira] [Commented] (SPARK-14736) Deadlock in registering applications while the Master is in the RECOVERING mode

[ https://issues.apache.org/jira/browse/SPARK-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326203#comment-15326203 ] niranda perera commented on SPARK-14736: Hi guys, Any update on this? We are seeing this

[jira] [Assigned] (SPARK-15898) DataFrameReader.text should return DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15898: Assignee: Apache Spark (was: Wenchen Fan) > DataFrameReader.text should return DataFrame

[jira] [Assigned] (SPARK-15898) DataFrameReader.text should return DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15898: Assignee: Wenchen Fan (was: Apache Spark) > DataFrameReader.text should return DataFrame

[jira] [Commented] (SPARK-15898) DataFrameReader.text should return DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326193#comment-15326193 ] Apache Spark commented on SPARK-15898: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-15900) please add a map param on MQTTUtils.createStream for setting MqttConnectOptions

[ https://issues.apache.org/jira/browse/SPARK-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lichenglin updated SPARK-15900: --- Summary: please add a map param on MQTTUtils.createStream for setting MqttConnectOptions (was:

[jira] [Updated] (SPARK-15900) please add a map param on MQTTUtils.createStreamfor setting MqttConnectOptions

[ https://issues.apache.org/jira/browse/SPARK-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lichenglin updated SPARK-15900: --- Summary: please add a map param on MQTTUtils.createStreamfor setting MqttConnectOptions (was:

[jira] [Created] (SPARK-15900) please add a map param on MQTTUtils.create for setting MqttConnectOptions

lichenglin created SPARK-15900: -- Summary: please add a map param on MQTTUtils.create for setting MqttConnectOptions Key: SPARK-15900 URL: https://issues.apache.org/jira/browse/SPARK-15900 Project:

[jira] [Commented] (SPARK-15857) Add Caller Context in Spark

[ https://issues.apache.org/jira/browse/SPARK-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326153#comment-15326153 ] Sun Rui commented on SPARK-15857: - +1 for this feature > Add Caller Context in Spark >

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326146#comment-15326146 ] Sun Rui commented on SPARK-15799: - This request has been asked before. The question is that SparkR needs

[jira] [Commented] (SPARK-15874) HBase rowkey optimization support for Hbase-Storage-handler

[ https://issues.apache.org/jira/browse/SPARK-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326127#comment-15326127 ] Weichen Xu commented on SPARK-15874: en...I got it. But there is another problem, if I want to

[jira] [Assigned] (SPARK-2623) Stacked Auto Encoder (Deep Learning )

[ https://issues.apache.org/jira/browse/SPARK-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2623: --- Assignee: Apache Spark (was: Victor Fang) > Stacked Auto Encoder (Deep Learning ) >

[jira] [Commented] (SPARK-2623) Stacked Auto Encoder (Deep Learning )

[ https://issues.apache.org/jira/browse/SPARK-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326126#comment-15326126 ] Apache Spark commented on SPARK-2623: - User 'avulanov' has created a pull request for this issue:

[jira] [Commented] (SPARK-15874) HBase rowkey optimization support for Hbase-Storage-handler

[ https://issues.apache.org/jira/browse/SPARK-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326119#comment-15326119 ] Reynold Xin commented on SPARK-15874: - Got it. There are already multiple hbase connectors for Spark

[jira] [Commented] (SPARK-15874) HBase rowkey optimization support for Hbase-Storage-handler

[ https://issues.apache.org/jira/browse/SPARK-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326114#comment-15326114 ] Weichen Xu commented on SPARK-15874: The hbase connector is implements in hive and spark-SQL can use

[jira] [Commented] (SPARK-15882) Discuss distributed linear algebra in spark.ml package

[ https://issues.apache.org/jira/browse/SPARK-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326101#comment-15326101 ] Matthias Boehm commented on SPARK-15882: I really like this direction and think it has the

[jira] [Created] (SPARK-15899) file scheme should be used correctly

Kazuaki Ishizaki created SPARK-15899: Summary: file scheme should be used correctly Key: SPARK-15899 URL: https://issues.apache.org/jira/browse/SPARK-15899 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15874) HBase rowkey optimization support for Hbase-Storage-handler

[ https://issues.apache.org/jira/browse/SPARK-15874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326069#comment-15326069 ] Reynold Xin commented on SPARK-15874: - I'm confused -- Apache Spark's code base itself does not

[jira] [Resolved] (SPARK-15807) Support varargs for dropDuplicates in Dataset/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15807. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Support varargs

[jira] [Resolved] (SPARK-14851) Support radix sort with nullable longs

[ https://issues.apache.org/jira/browse/SPARK-14851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14851. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.0 > Support radix sort

[jira] [Created] (SPARK-15898) DataFrameReader.text should return DataFrame

Reynold Xin created SPARK-15898: --- Summary: DataFrameReader.text should return DataFrame Key: SPARK-15898 URL: https://issues.apache.org/jira/browse/SPARK-15898 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15856) Revert API breaking changes made in SQLContext.range

[ https://issues.apache.org/jira/browse/SPARK-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326065#comment-15326065 ] Reynold Xin commented on SPARK-15856: - Note that we have decided to only revert the SQLContext.range

[jira] [Updated] (SPARK-15856) Revert API breaking changes made in SQLContext.range

[ https://issues.apache.org/jira/browse/SPARK-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15856: Summary: Revert API breaking changes made in SQLContext.range (was: Revert API breaking changes

[jira] [Resolved] (SPARK-15856) Revert API breaking changes made in SQLContext.range

[ https://issues.apache.org/jira/browse/SPARK-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15856. - Resolution: Fixed Fix Version/s: 2.0.0 > Revert API breaking changes made in

[jira] [Resolved] (SPARK-15881) Update microbenchmark results

[ https://issues.apache.org/jira/browse/SPARK-15881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15881. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Update

[jira] [Resolved] (SPARK-15585) Don't use null in data source options to indicate default value

[ https://issues.apache.org/jira/browse/SPARK-15585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15585. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 > Don't use

[jira] [Updated] (SPARK-15881) Update microbenchmark results

[ https://issues.apache.org/jira/browse/SPARK-15881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15881: -- Fix Version/s: (was: 2.0.0) > Update microbenchmark results > - > >

[jira] [Updated] (SPARK-15639) Try to push down filter at RowGroups level for parquet reader

[ https://issues.apache.org/jira/browse/SPARK-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15639: -- Fix Version/s: (was: 2.0.0) > Try to push down filter at RowGroups level for parquet reader >

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326036#comment-15326036 ] Josh Rosen commented on SPARK-12661: Yeah, I think that just messaging that Python 2.6 users should

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Assignee: Hyukjin Kwon > Incorrectly merged AFTAggregator with zero total count >

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Summary: Incorrectly merged AFTAggregator with zero total count (was:

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Shepherd: Joseph K. Bradley > Incorrectly merged AFTAggregator with zero total count >

[jira] [Updated] (SPARK-15892) Incorrectly merged AFTAggregator with zero total count

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15892: -- Affects Version/s: 1.6.1 > Incorrectly merged AFTAggregator with zero total count >

[jira] [Assigned] (SPARK-15590) Paginate Job Table in Jobs tab

[ https://issues.apache.org/jira/browse/SPARK-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15590: Assignee: Apache Spark (was: Tao Lin) > Paginate Job Table in Jobs tab >

[jira] [Assigned] (SPARK-15590) Paginate Job Table in Jobs tab

[ https://issues.apache.org/jira/browse/SPARK-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15590: Assignee: Tao Lin (was: Apache Spark) > Paginate Job Table in Jobs tab >

[jira] [Commented] (SPARK-15590) Paginate Job Table in Jobs tab

[ https://issues.apache.org/jira/browse/SPARK-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325971#comment-15325971 ] Apache Spark commented on SPARK-15590: -- User 'nblintao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15892) aft_survival_regression.py example fails in branch-2.0

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15892: Assignee: Apache Spark > aft_survival_regression.py example fails in branch-2.0 >

[jira] [Commented] (SPARK-15892) aft_survival_regression.py example fails in branch-2.0

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325955#comment-15325955 ] Apache Spark commented on SPARK-15892: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-15892) aft_survival_regression.py example fails in branch-2.0

[ https://issues.apache.org/jira/browse/SPARK-15892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15892: Assignee: (was: Apache Spark) > aft_survival_regression.py example fails in

[jira] [Resolved] (SPARK-15883) Fix broken links on MLLIB documentations

[ https://issues.apache.org/jira/browse/SPARK-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15883. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13608

[jira] [Updated] (SPARK-15883) Fix broken links on MLLIB documentations

[ https://issues.apache.org/jira/browse/SPARK-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15883: -- Assignee: Dongjoon Hyun > Fix broken links on MLLIB documentations >

[jira] [Assigned] (SPARK-15796) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

[ https://issues.apache.org/jira/browse/SPARK-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15796: Assignee: Apache Spark > Reduce spark.memory.fraction default to avoid overrunning old

[jira] [Commented] (SPARK-15796) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

[ https://issues.apache.org/jira/browse/SPARK-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325833#comment-15325833 ] Apache Spark commented on SPARK-15796: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15796) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

[ https://issues.apache.org/jira/browse/SPARK-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15796: Assignee: (was: Apache Spark) > Reduce spark.memory.fraction default to avoid

[jira] [Updated] (SPARK-15879) Update logo in UI and docs to add "Apache"

[ https://issues.apache.org/jira/browse/SPARK-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15879: -- Assignee: Sean Owen Priority: Minor (was: Major) > Update logo in UI and docs to add "Apache" >

[jira] [Resolved] (SPARK-15879) Update logo in UI and docs to add "Apache"

[ https://issues.apache.org/jira/browse/SPARK-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15879. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13609

[jira] [Commented] (SPARK-15897) Function Registry should just take in FunctionIdentifier for type safety and avoid duplicating

[ https://issues.apache.org/jira/browse/SPARK-15897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325826#comment-15325826 ] Sandeep Singh commented on SPARK-15897: --- I'm working on this, will create a PR soon. > Function

[jira] [Created] (SPARK-15897) Function Registry should just take in FunctionIdentifier for type safety and avoid duplicating

Sandeep Singh created SPARK-15897: - Summary: Function Registry should just take in FunctionIdentifier for type safety and avoid duplicating Key: SPARK-15897 URL: https://issues.apache.org/jira/browse/SPARK-15897

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325761#comment-15325761 ] Pete Robbins commented on SPARK-15822: -- has failed on latest Branch 2.0 and master. Currently using

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325759#comment-15325759 ] Pete Robbins commented on SPARK-15822: -- The stack trace is taken earlier when I detect that the

[jira] [Assigned] (SPARK-10409) Multilayer perceptron regression

[ https://issues.apache.org/jira/browse/SPARK-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10409: Assignee: Apache Spark > Multilayer perceptron regression >

[jira] [Assigned] (SPARK-10409) Multilayer perceptron regression

[ https://issues.apache.org/jira/browse/SPARK-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10409: Assignee: (was: Apache Spark) > Multilayer perceptron regression >

[jira] [Commented] (SPARK-10409) Multilayer perceptron regression

[ https://issues.apache.org/jira/browse/SPARK-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325755#comment-15325755 ] Apache Spark commented on SPARK-10409: -- User 'JeremyNixon' has created a pull request for this

[jira] [Created] (SPARK-15896) Clean shuffle files after finish the SQL query

Davies Liu created SPARK-15896: -- Summary: Clean shuffle files after finish the SQL query Key: SPARK-15896 URL: https://issues.apache.org/jira/browse/SPARK-15896 Project: Spark Issue Type:

[jira] [Updated] (SPARK-15895) _common_metadata and _metadata appearing in the inner partitioning dirs of a partitioned parquet datasets break partitioning discovery

[ https://issues.apache.org/jira/browse/SPARK-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15895: - Assignee: Cheng Lian > _common_metadata and _metadata appearing in the inner partitioning dirs of a >

[jira] [Commented] (SPARK-15895) _common_metadata and _metadata appearing in the inner partitioning dirs of a partitioned parquet datasets break partitioning discovery

[ https://issues.apache.org/jira/browse/SPARK-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325750#comment-15325750 ] Yin Huai commented on SPARK-15895: -- Probably we can just exclude those files from

[jira] [Commented] (SPARK-13207) _SUCCESS should not break partition discovery

[ https://issues.apache.org/jira/browse/SPARK-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325749#comment-15325749 ] Yin Huai commented on SPARK-13207: -- Created https://issues.apache.org/jira/browse/SPARK-15895 >

[jira] [Created] (SPARK-15895) _common_metadata and _metadata appearing in the inner partitioning dirs of a partitioned parquet datasets break partitioning discovery

Yin Huai created SPARK-15895: Summary: _common_metadata and _metadata appearing in the inner partitioning dirs of a partitioned parquet datasets break partitioning discovery Key: SPARK-15895 URL:

[jira] [Updated] (SPARK-15895) _common_metadata and _metadata appearing in the inner partitioning dirs of a partitioned parquet datasets break partitioning discovery

[ https://issues.apache.org/jira/browse/SPARK-15895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15895: - Description: see

[jira] [Commented] (SPARK-13207) _SUCCESS should not break partition discovery

[ https://issues.apache.org/jira/browse/SPARK-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325744#comment-15325744 ] Yin Huai commented on SPARK-13207: -- oh, I only looked at the title. OK. It is not fixed. Can you create