[jira] [Assigned] (SPARK-20994) Alleviate memory pressure in StreamManager

[ https://issues.apache.org/jira/browse/SPARK-20994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20994: Assignee: (was: Apache Spark) > Alleviate memory pressure in StreamManager > -

[jira] [Assigned] (SPARK-20994) Alleviate memory pressure in StreamManager

[ https://issues.apache.org/jira/browse/SPARK-20994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20994: Assignee: Apache Spark > Alleviate memory pressure in StreamManager >

[jira] [Assigned] (SPARK-20993) The configuration item about 'Spark.blacklist.enabled' need to set the default value 'false'

[ https://issues.apache.org/jira/browse/SPARK-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20993: Assignee: (was: Apache Spark) > The configuration item about 'Spark.blacklist.enabled'

[jira] [Commented] (SPARK-20994) Alleviate memory pressure in StreamManager

[ https://issues.apache.org/jira/browse/SPARK-20994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038280#comment-16038280 ] Apache Spark commented on SPARK-20994: -- User 'jinxing64' has created a pull request

[jira] [Assigned] (SPARK-20993) The configuration item about 'Spark.blacklist.enabled' need to set the default value 'false'

[ https://issues.apache.org/jira/browse/SPARK-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20993: Assignee: Apache Spark > The configuration item about 'Spark.blacklist.enabled' need to s

[jira] [Commented] (SPARK-20993) The configuration item about 'Spark.blacklist.enabled' need to set the default value 'false'

[ https://issues.apache.org/jira/browse/SPARK-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038281#comment-16038281 ] Apache Spark commented on SPARK-20993: -- User 'guoxiaolongzte' has created a pull req

[jira] [Created] (SPARK-20994) Alleviate memory pressure in StreamManager

jin xing created SPARK-20994: Summary: Alleviate memory pressure in StreamManager Key: SPARK-20994 URL: https://issues.apache.org/jira/browse/SPARK-20994 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-20993) The configuration item about 'Spark.blacklist.enabled' need to set the default value 'false'

guoxiaolongzte created SPARK-20993: -- Summary: The configuration item about 'Spark.blacklist.enabled' need to set the default value 'false' Key: SPARK-20993 URL: https://issues.apache.org/jira/browse/SPARK-20993

[jira] [Commented] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038267#comment-16038267 ] Mahesh commented on SPARK-20984: I checked the orc code and that is failing with near sim

[jira] [Closed] (SPARK-19236) Add createOrReplaceGlobalTempView

[ https://issues.apache.org/jira/browse/SPARK-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arman Yazdani closed SPARK-19236. - > Add createOrReplaceGlobalTempView > - > > Key: SPAR

[jira] [Updated] (SPARK-18085) Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Buzolin updated SPARK-18085: --- Your contact with NYSE has changed, please visit https://www.nyse.com/contact or call +1 866 873

[jira] [Commented] (SPARK-18085) Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038210#comment-16038210 ] DjvuLee commented on SPARK-18085: - [~vanzin] I want to try your branch. Does all the info

[jira] [Commented] (SPARK-16599) java.util.NoSuchElementException: None.get at at org.apache.spark.storage.BlockInfoManager.releaseAllLocksForTask(BlockInfoManager.scala:343)

[ https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038185#comment-16038185 ] Randy Kerber commented on SPARK-16599: -- I've been trying to resolve this error for p

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038086#comment-16038086 ] Hyukjin Kwon commented on SPARK-20943: -- [~canbinzheng], I think (as I see no positiv

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038083#comment-16038083 ] Hyukjin Kwon commented on SPARK-20943: -- I guess we could resolve the issue in any ev

[jira] [Resolved] (SPARK-20983) AnalysisException when joining data frames derived from the same duplicates-dropped one.

[ https://issues.apache.org/jira/browse/SPARK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20983. -- Resolution: Cannot Reproduce I am also able to reproduce this in 2.1.0. Fortunately, it looks

[jira] [Assigned] (SPARK-20992) Support for Nomad as scheduler backend

[ https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20992: Assignee: Apache Spark > Support for Nomad as scheduler backend >

[jira] [Assigned] (SPARK-20992) Support for Nomad as scheduler backend

[ https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20992: Assignee: (was: Apache Spark) > Support for Nomad as scheduler backend > -

[jira] [Commented] (SPARK-20992) Support for Nomad as scheduler backend

[ https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038023#comment-16038023 ] Apache Spark commented on SPARK-20992: -- User 'barnardb' has created a pull request f

[jira] [Created] (SPARK-20992) Support for Nomad as scheduler backend

Ben Barnard created SPARK-20992: --- Summary: Support for Nomad as scheduler backend Key: SPARK-20992 URL: https://issues.apache.org/jira/browse/SPARK-20992 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037998#comment-16037998 ] Saisai Shao commented on SPARK-20943: - >From my point, it is not really necessary to

[jira] [Commented] (SPARK-20982) Consider adding SSL support for Spark REST submission server and client

[ https://issues.apache.org/jira/browse/SPARK-20982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037994#comment-16037994 ] Saisai Shao commented on SPARK-20982: - Thanks a lot [~vanzin] for your response. Thou

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037987#comment-16037987 ] CanBin Zheng commented on SPARK-20943: -- [~srowen][~saisai_shao] What's the final con

[jira] [Assigned] (SPARK-20991) BROADCAST_TIMEOUT conf should be a timeoutConf

[ https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-20991: Assignee: Feng Liu > BROADCAST_TIMEOUT conf should be a timeoutConf >

[jira] [Resolved] (SPARK-20991) BROADCAST_TIMEOUT conf should be a timeoutConf

[ https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20991. -- Resolution: Fixed Fix Version/s: 2.3.0 > BROADCAST_TIMEOUT conf should be a timeoutConf

[jira] [Resolved] (SPARK-20957) Flaky Test: o.a.s.sql.streaming.StreamingQueryManagerSuite listing

[ https://issues.apache.org/jira/browse/SPARK-20957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-20957. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Resolved] (SPARK-20926) Exposure to Guava libraries by directly accessing tableRelationCache in SessionCatalog caused failures

[ https://issues.apache.org/jira/browse/SPARK-20926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20926. Resolution: Fixed Assignee: Reza Safi Fix Version/s: 2.3.0 I chose not to p

[jira] [Assigned] (SPARK-20991) BROADCAST_TIMEOUT conf should be a timeoutConf

[ https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20991: Assignee: (was: Apache Spark) > BROADCAST_TIMEOUT conf should be a timeoutConf > -

[jira] [Assigned] (SPARK-20991) BROADCAST_TIMEOUT conf should be a timeoutConf

[ https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20991: Assignee: Apache Spark > BROADCAST_TIMEOUT conf should be a timeoutConf >

[jira] [Commented] (SPARK-20991) BROADCAST_TIMEOUT conf should be a timeoutConf

[ https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037489#comment-16037489 ] Apache Spark commented on SPARK-20991: -- User 'liufengdb' has created a pull request

[jira] [Created] (SPARK-20991) BROADCAST_TIMEOUT conf should be a timeoutConf

Feng Liu created SPARK-20991: Summary: BROADCAST_TIMEOUT conf should be a timeoutConf Key: SPARK-20991 URL: https://issues.apache.org/jira/browse/SPARK-20991 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20989) Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-20989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20989: -- Priority: Minor (was: Major) I'm not clear that this is intended to work this way, but if it's not, ma

[jira] [Commented] (SPARK-20980) Rename the option `wholeFile` to `multiLine` for JSON and CSV

[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037416#comment-16037416 ] Michael Armbrust commented on SPARK-20980: -- I already cut RC4, I think we may ju

[jira] [Created] (SPARK-20990) Multi-line support for JSON

Xiao Li created SPARK-20990: --- Summary: Multi-line support for JSON Key: SPARK-20990 URL: https://issues.apache.org/jira/browse/SPARK-20990 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-20980) Rename the option `wholeFile` to `multiLine` for JSON and CSV

[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20980: Description: The current option name `wholeFile` is misleading for CSV. Currently, it is not representing

[jira] [Updated] (SPARK-20980) Rename the option `wholeFile` to `multiLine` for JSON and CSV

[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20980: Summary: Rename the option `wholeFile` to `multiLine` for JSON and CSV (was: CSV: rename the option `whole

[jira] [Resolved] (SPARK-20981) Add --repositories equivalent configuration for Spark

[ https://issues.apache.org/jira/browse/SPARK-20981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20981. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.3.0 > Add --reposi

[jira] [Created] (SPARK-20989) Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode

Jiang Xingbo created SPARK-20989: Summary: Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode Key: SPARK-20989 URL: https://issues.apache.org/jira/browse/SPARK-209

[jira] [Commented] (SPARK-20982) Consider adding SSL support for Spark REST submission server and client

[ https://issues.apache.org/jira/browse/SPARK-20982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037195#comment-16037195 ] Marcelo Vanzin commented on SPARK-20982: Really not familiar with that stuff. But

[jira] [Commented] (SPARK-20754) Add Function Alias For MOD/TRUNCT/POSITION

[ https://issues.apache.org/jira/browse/SPARK-20754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037193#comment-16037193 ] Apache Spark commented on SPARK-20754: -- User 'wangyum' has created a pull request fo

[jira] [Commented] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037186#comment-16037186 ] Dongjoon Hyun commented on SPARK-20984: --- Thank you for confirming! > Reading back

[jira] [Assigned] (SPARK-20986) Reset table's statistics after PruneFileSourcePartitions rule.

[ https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20986: Assignee: (was: Apache Spark) > Reset table's statistics after PruneFileSourcePartitio

[jira] [Updated] (SPARK-20986) Reset table's statistics after PruneFileSourcePartitions rule.

[ https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-20986: - Description: After PruneFileSourcePartitions rule, It needs reset table's statistics because Prun

[jira] [Assigned] (SPARK-20986) Reset table's statistics after PruneFileSourcePartitions rule.

[ https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20986: Assignee: Apache Spark > Reset table's statistics after PruneFileSourcePartitions rule. >

[jira] [Commented] (SPARK-20986) Reset table's statistics after PruneFileSourcePartitions rule.

[ https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037079#comment-16037079 ] Apache Spark commented on SPARK-20986: -- User 'lianhuiwang' has created a pull reques

[jira] [Created] (SPARK-20988) Convert logistic regression to new aggregator framework

Seth Hendrickson created SPARK-20988: Summary: Convert logistic regression to new aggregator framework Key: SPARK-20988 URL: https://issues.apache.org/jira/browse/SPARK-20988 Project: Spark

[jira] [Commented] (SPARK-20193) Selecting empty struct causes ExpressionEncoder error.

[ https://issues.apache.org/jira/browse/SPARK-20193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037001#comment-16037001 ] Michael Smith commented on SPARK-20193: --- Would be nice for the error message to des

[jira] [Commented] (SPARK-20987) columns with name having dots caused issues with VectorAssemblor

[ https://issues.apache.org/jira/browse/SPARK-20987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036952#comment-16036952 ] Sean Owen commented on SPARK-20987: --- Looks like a duplicate of one of several issues, l

[jira] [Commented] (SPARK-20199) GradientBoostedTreesModel doesn't have featureSubsetStrategy parameter

[ https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036950#comment-16036950 ] pralabhkumar commented on SPARK-20199: -- [~josephkb] Please review the pull request.

[jira] [Created] (SPARK-20987) columns with name having dots caused issues with VectorAssemblor

Maher Hattabi created SPARK-20987: - Summary: columns with name having dots caused issues with VectorAssemblor Key: SPARK-20987 URL: https://issues.apache.org/jira/browse/SPARK-20987 Project: Spark

[jira] [Created] (SPARK-20986) Reset table's statistics after PruneFileSourcePartitions rule.

Lianhui Wang created SPARK-20986: Summary: Reset table's statistics after PruneFileSourcePartitions rule. Key: SPARK-20986 URL: https://issues.apache.org/jira/browse/SPARK-20986 Project: Spark

[jira] [Updated] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jin xing updated SPARK-20985: - Description: SparkContext should always be stopped after using, thus other tests won't complain that ther

[jira] [Comment Edited] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036750#comment-16036750 ] Mahesh edited comment on SPARK-20984 at 6/5/17 10:00 AM: - **Parqu

[jira] [Commented] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036750#comment-16036750 ] Mahesh commented on SPARK-20984: Parquet is fine. > testOnly org.apache.spark.sql.hive.Hi

[jira] [Assigned] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20985: Assignee: Apache Spark > Improve KryoSerializerResizableOutputSuite >

[jira] [Assigned] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20985: Assignee: (was: Apache Spark) > Improve KryoSerializerResizableOutputSuite > -

[jira] [Commented] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036740#comment-16036740 ] Apache Spark commented on SPARK-20985: -- User 'jinxing64' has created a pull request

[jira] [Updated] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20985: -- Priority: Trivial (was: Minor) Issue Type: Improvement (was: Bug) Actually, it should extend Lo

[jira] [Created] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

jin xing created SPARK-20985: Summary: Improve KryoSerializerResizableOutputSuite Key: SPARK-20985 URL: https://issues.apache.org/jira/browse/SPARK-20985 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036723#comment-16036723 ] Dongjoon Hyun commented on SPARK-15731: --- Hi, All. I simply tested on HDFS with the

[jira] [Resolved] (SPARK-19762) Implement aggregator/loss function hierarchy and apply to linear regression

[ https://issues.apache.org/jira/browse/SPARK-19762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19762. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17094 [https://github.co

[jira] [Assigned] (SPARK-19762) Implement aggregator/loss function hierarchy and apply to linear regression

[ https://issues.apache.org/jira/browse/SPARK-19762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19762: - Assignee: Seth Hendrickson > Implement aggregator/loss function hierarchy and apply to linear re

[jira] [Resolved] (SPARK-20977) NPE in CollectionAccumulator

[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20977. --- Resolution: Invalid Questions should go to the mailing list. There's no info about how you encounter

[jira] [Assigned] (SPARK-20930) Destroy broadcasted centers after computing cost

[ https://issues.apache.org/jira/browse/SPARK-20930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20930: - Assignee: zhengruifeng Affects Version/s: (was: 2.3.0) 2.

[jira] [Resolved] (SPARK-20930) Destroy broadcasted centers after computing cost

[ https://issues.apache.org/jira/browse/SPARK-20930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20930. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18152 [https://github.co

[jira] [Assigned] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20945: - Assignee: liupengcheng Priority: Minor (was: Major) > NoSuchElementException key not found

[jira] [Resolved] (SPARK-20945) NoSuchElementException key not found in TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20945. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18171 [https://github.co

[jira] [Commented] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036692#comment-16036692 ] Dongjoon Hyun commented on SPARK-20984: --- Hi, do you experience this on ORC only? Wh

[jira] [Commented] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036690#comment-16036690 ] Liang-Chi Hsieh commented on SPARK-20969: - It seems to me that the second result

[jira] [Updated] (SPARK-20983) AnalysisException when joining data frames derived from the same duplicates-dropped one.

[ https://issues.apache.org/jira/browse/SPARK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pen Xiao updated SPARK-20983: - Description: reproduce steps: val df = sc.parallelize(Array((1,1,1),(1,1,2),(1,2,1))).toDF("c1","c2","c3

[jira] [Updated] (SPARK-20983) AnalysisException when joining data frames derived from the same duplicates-dropped one.

[ https://issues.apache.org/jira/browse/SPARK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pen Xiao updated SPARK-20983: - Description: reproduce steps: ``` scala val df = sc.parallelize(Array((1,1,1),(1,1,2),(1,2,1))).toDF("c1

[jira] [Commented] (SPARK-20199) GradientBoostedTreesModel doesn't have featureSubsetStrategy parameter

[ https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036681#comment-16036681 ] pralabhkumar commented on SPARK-20199: -- [~peng.m...@intel.com][~sowen] Please review

[jira] [Commented] (SPARK-13736) Big-Endian plataform issues

[ https://issues.apache.org/jira/browse/SPARK-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036679#comment-16036679 ] Mahesh commented on SPARK-13736: [~luciano resende] I found a problem with orc on Big-End

[jira] [Created] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

Mahesh created SPARK-20984: -- Summary: Reading back from ORC format gives error on big endian systems. Key: SPARK-20984 URL: https://issues.apache.org/jira/browse/SPARK-20984 Project: Spark Issue Ty

[jira] [Created] (SPARK-20983) AnalysisException when joining data frames derived from the same duplicates-dropped one.

Pen Xiao created SPARK-20983: Summary: AnalysisException when joining data frames derived from the same duplicates-dropped one. Key: SPARK-20983 URL: https://issues.apache.org/jira/browse/SPARK-20983 Proj

[jira] [Resolved] (SPARK-20968) Support separator in Tokenizer

[ https://issues.apache.org/jira/browse/SPARK-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20968. --- Resolution: Not A Problem > Support separator in Tokenizer > -- > >

[jira] [Reopened] (SPARK-20968) Support separator in Tokenizer

[ https://issues.apache.org/jira/browse/SPARK-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-20968: --- > Support separator in Tokenizer > -- > > Key: SPARK-20968 >

[jira] [Commented] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036628#comment-16036628 ] Sean Owen commented on SPARK-20922: --- This is already publicly disclosed, which isn't a

[jira] [Created] (SPARK-20982) Consider adding SSL support for Spark REST submission server and client

Saisai Shao created SPARK-20982: --- Summary: Consider adding SSL support for Spark REST submission server and client Key: SPARK-20982 URL: https://issues.apache.org/jira/browse/SPARK-20982 Project: Spark