Saisai Shao created SPARK-20982:
---
Summary: Consider adding SSL support for Spark REST submission
server and client
Key: SPARK-20982
URL: https://issues.apache.org/jira/browse/SPARK-20982
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036628#comment-16036628
]
Sean Owen commented on SPARK-20922:
---
This is already publicly disclosed, which isn't a
[
https://issues.apache.org/jira/browse/SPARK-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reopened SPARK-20968:
---
> Support separator in Tokenizer
> --
>
> Key: SPARK-20968
>
[
https://issues.apache.org/jira/browse/SPARK-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-20968.
---
Resolution: Not A Problem
> Support separator in Tokenizer
> --
>
>
Pen Xiao created SPARK-20983:
Summary: AnalysisException when joining data frames derived from
the same duplicates-dropped one.
Key: SPARK-20983
URL: https://issues.apache.org/jira/browse/SPARK-20983
Proj
Mahesh created SPARK-20984:
--
Summary: Reading back from ORC format gives error on big endian
systems.
Key: SPARK-20984
URL: https://issues.apache.org/jira/browse/SPARK-20984
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036679#comment-16036679
]
Mahesh commented on SPARK-13736:
[~luciano resende] I found a problem with orc on Big-End
[
https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036681#comment-16036681
]
pralabhkumar commented on SPARK-20199:
--
[~peng.m...@intel.com][~sowen]
Please review
[
https://issues.apache.org/jira/browse/SPARK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pen Xiao updated SPARK-20983:
-
Description:
reproduce steps:
``` scala
val df =
sc.parallelize(Array((1,1,1),(1,1,2),(1,2,1))).toDF("c1
[
https://issues.apache.org/jira/browse/SPARK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pen Xiao updated SPARK-20983:
-
Description:
reproduce steps:
val df =
sc.parallelize(Array((1,1,1),(1,1,2),(1,2,1))).toDF("c1","c2","c3
[
https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036690#comment-16036690
]
Liang-Chi Hsieh commented on SPARK-20969:
-
It seems to me that the second result
[
https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036692#comment-16036692
]
Dongjoon Hyun commented on SPARK-20984:
---
Hi, do you experience this on ORC only? Wh
[
https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-20945.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18171
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-20945:
-
Assignee: liupengcheng
Priority: Minor (was: Major)
> NoSuchElementException key not found
[
https://issues.apache.org/jira/browse/SPARK-20930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-20930.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18152
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-20930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-20930:
-
Assignee: zhengruifeng
Affects Version/s: (was: 2.3.0)
2.
[
https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-20977.
---
Resolution: Invalid
Questions should go to the mailing list. There's no info about how you
encounter
[
https://issues.apache.org/jira/browse/SPARK-19762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-19762:
-
Assignee: Seth Hendrickson
> Implement aggregator/loss function hierarchy and apply to linear re
[
https://issues.apache.org/jira/browse/SPARK-19762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-19762.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 17094
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036723#comment-16036723
]
Dongjoon Hyun commented on SPARK-15731:
---
Hi, All.
I simply tested on HDFS with the
jin xing created SPARK-20985:
Summary: Improve KryoSerializerResizableOutputSuite
Key: SPARK-20985
URL: https://issues.apache.org/jira/browse/SPARK-20985
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-20985:
--
Priority: Trivial (was: Minor)
Issue Type: Improvement (was: Bug)
Actually, it should extend Lo
[
https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036740#comment-16036740
]
Apache Spark commented on SPARK-20985:
--
User 'jinxing64' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20985:
Assignee: (was: Apache Spark)
> Improve KryoSerializerResizableOutputSuite
> -
[
https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20985:
Assignee: Apache Spark
> Improve KryoSerializerResizableOutputSuite
>
[
https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036750#comment-16036750
]
Mahesh commented on SPARK-20984:
Parquet is fine.
> testOnly org.apache.spark.sql.hive.Hi
[
https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036750#comment-16036750
]
Mahesh edited comment on SPARK-20984 at 6/5/17 10:00 AM:
-
**Parqu
[
https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-20985:
-
Description: SparkContext should always be stopped after using, thus other
tests won't complain that ther
Lianhui Wang created SPARK-20986:
Summary: Reset table's statistics after PruneFileSourcePartitions
rule.
Key: SPARK-20986
URL: https://issues.apache.org/jira/browse/SPARK-20986
Project: Spark
Maher Hattabi created SPARK-20987:
-
Summary: columns with name having dots caused issues with
VectorAssemblor
Key: SPARK-20987
URL: https://issues.apache.org/jira/browse/SPARK-20987
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036950#comment-16036950
]
pralabhkumar commented on SPARK-20199:
--
[~josephkb] Please review the pull request.
[
https://issues.apache.org/jira/browse/SPARK-20987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16036952#comment-16036952
]
Sean Owen commented on SPARK-20987:
---
Looks like a duplicate of one of several issues, l
[
https://issues.apache.org/jira/browse/SPARK-20193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037001#comment-16037001
]
Michael Smith commented on SPARK-20193:
---
Would be nice for the error message to des
Seth Hendrickson created SPARK-20988:
Summary: Convert logistic regression to new aggregator framework
Key: SPARK-20988
URL: https://issues.apache.org/jira/browse/SPARK-20988
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037079#comment-16037079
]
Apache Spark commented on SPARK-20986:
--
User 'lianhuiwang' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20986:
Assignee: Apache Spark
> Reset table's statistics after PruneFileSourcePartitions rule.
>
[
https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20986:
Assignee: (was: Apache Spark)
> Reset table's statistics after PruneFileSourcePartitio
[
https://issues.apache.org/jira/browse/SPARK-20986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lianhui Wang updated SPARK-20986:
-
Description: After PruneFileSourcePartitions rule, It needs reset table's
statistics because Prun
[
https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037186#comment-16037186
]
Dongjoon Hyun commented on SPARK-20984:
---
Thank you for confirming!
> Reading back
[
https://issues.apache.org/jira/browse/SPARK-20754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037193#comment-16037193
]
Apache Spark commented on SPARK-20754:
--
User 'wangyum' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-20982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037195#comment-16037195
]
Marcelo Vanzin commented on SPARK-20982:
Really not familiar with that stuff. But
Jiang Xingbo created SPARK-20989:
Summary: Fail to start multiple workers on one host if external
shuffle service is enabled in standalone mode
Key: SPARK-20989
URL: https://issues.apache.org/jira/browse/SPARK-209
[
https://issues.apache.org/jira/browse/SPARK-20981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-20981.
Resolution: Fixed
Assignee: Saisai Shao
Fix Version/s: 2.3.0
> Add --reposi
[
https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-20980:
Summary: Rename the option `wholeFile` to `multiLine` for JSON and CSV
(was: CSV: rename the option `whole
[
https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-20980:
Description:
The current option name `wholeFile` is misleading for CSV. Currently, it is not
representing
Xiao Li created SPARK-20990:
---
Summary: Multi-line support for JSON
Key: SPARK-20990
URL: https://issues.apache.org/jira/browse/SPARK-20990
Project: Spark
Issue Type: Bug
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037416#comment-16037416
]
Michael Armbrust commented on SPARK-20980:
--
I already cut RC4, I think we may ju
[
https://issues.apache.org/jira/browse/SPARK-20989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-20989:
--
Priority: Minor (was: Major)
I'm not clear that this is intended to work this way, but if it's not, ma
Feng Liu created SPARK-20991:
Summary: BROADCAST_TIMEOUT conf should be a timeoutConf
Key: SPARK-20991
URL: https://issues.apache.org/jira/browse/SPARK-20991
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037489#comment-16037489
]
Apache Spark commented on SPARK-20991:
--
User 'liufengdb' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20991:
Assignee: Apache Spark
> BROADCAST_TIMEOUT conf should be a timeoutConf
>
[
https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20991:
Assignee: (was: Apache Spark)
> BROADCAST_TIMEOUT conf should be a timeoutConf
> -
[
https://issues.apache.org/jira/browse/SPARK-20926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-20926.
Resolution: Fixed
Assignee: Reza Safi
Fix Version/s: 2.3.0
I chose not to p
[
https://issues.apache.org/jira/browse/SPARK-20957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-20957.
---
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-20991.
--
Resolution: Fixed
Fix Version/s: 2.3.0
> BROADCAST_TIMEOUT conf should be a timeoutConf
[
https://issues.apache.org/jira/browse/SPARK-20991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu reassigned SPARK-20991:
Assignee: Feng Liu
> BROADCAST_TIMEOUT conf should be a timeoutConf
>
[
https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037987#comment-16037987
]
CanBin Zheng commented on SPARK-20943:
--
[~srowen][~saisai_shao] What's the final con
[
https://issues.apache.org/jira/browse/SPARK-20982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037994#comment-16037994
]
Saisai Shao commented on SPARK-20982:
-
Thanks a lot [~vanzin] for your response. Thou
[
https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037998#comment-16037998
]
Saisai Shao commented on SPARK-20943:
-
>From my point, it is not really necessary to
Ben Barnard created SPARK-20992:
---
Summary: Support for Nomad as scheduler backend
Key: SPARK-20992
URL: https://issues.apache.org/jira/browse/SPARK-20992
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20992:
Assignee: (was: Apache Spark)
> Support for Nomad as scheduler backend
> -
[
https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038023#comment-16038023
]
Apache Spark commented on SPARK-20992:
--
User 'barnardb' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-20992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20992:
Assignee: Apache Spark
> Support for Nomad as scheduler backend
>
[
https://issues.apache.org/jira/browse/SPARK-20983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-20983.
--
Resolution: Cannot Reproduce
I am also able to reproduce this in 2.1.0.
Fortunately, it looks
[
https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038083#comment-16038083
]
Hyukjin Kwon commented on SPARK-20943:
--
I guess we could resolve the issue in any ev
[
https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038086#comment-16038086
]
Hyukjin Kwon commented on SPARK-20943:
--
[~canbinzheng], I think (as I see no positiv
[
https://issues.apache.org/jira/browse/SPARK-16599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038185#comment-16038185
]
Randy Kerber commented on SPARK-16599:
--
I've been trying to resolve this error for p
[
https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038210#comment-16038210
]
DjvuLee commented on SPARK-18085:
-
[~vanzin] I want to try your branch. Does all the info
[
https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitry Buzolin updated SPARK-18085:
---
Your contact with NYSE has changed, please visit https://www.nyse.com/contact
or call +1 866 873
[
https://issues.apache.org/jira/browse/SPARK-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arman Yazdani closed SPARK-19236.
-
> Add createOrReplaceGlobalTempView
> -
>
> Key: SPAR
[
https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038267#comment-16038267
]
Mahesh commented on SPARK-20984:
I checked the orc code and that is failing with near sim
guoxiaolongzte created SPARK-20993:
--
Summary: The configuration item about 'Spark.blacklist.enabled'
need to set the default value 'false'
Key: SPARK-20993
URL: https://issues.apache.org/jira/browse/SPARK-20993
jin xing created SPARK-20994:
Summary: Alleviate memory pressure in StreamManager
Key: SPARK-20994
URL: https://issues.apache.org/jira/browse/SPARK-20994
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20993:
Assignee: Apache Spark
> The configuration item about 'Spark.blacklist.enabled' need to s
[
https://issues.apache.org/jira/browse/SPARK-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038281#comment-16038281
]
Apache Spark commented on SPARK-20993:
--
User 'guoxiaolongzte' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-20994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038280#comment-16038280
]
Apache Spark commented on SPARK-20994:
--
User 'jinxing64' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-20994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20994:
Assignee: (was: Apache Spark)
> Alleviate memory pressure in StreamManager
> -
[
https://issues.apache.org/jira/browse/SPARK-20994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20994:
Assignee: Apache Spark
> Alleviate memory pressure in StreamManager
>
[
https://issues.apache.org/jira/browse/SPARK-20993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20993:
Assignee: (was: Apache Spark)
> The configuration item about 'Spark.blacklist.enabled'
79 matches
Mail list logo