[jira] [Updated] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10981: -- Assignee: Monica Liu > R semijoin leads to Java errors, R leftsemi leads to

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956129#comment-14956129 ] Apache Spark commented on SPARK-11067: -- User 'navis' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11067: Assignee: Apache Spark > Spark SQL thrift server fails to handle decimal value >

[jira] [Commented] (SPARK-9443) Expose sampleByKey in SparkR

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956179#comment-14956179 ] Sun Rui commented on SPARK-9443: close it as it duplicates SPARK-10996 > Expose sampleByKey in SparkR >

[jira] [Closed] (SPARK-9443) Expose sampleByKey in SparkR

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-9443. -- Resolution: Duplicate > Expose sampleByKey in SparkR > > > Key:

[jira] [Closed] (SPARK-9302) Handle complex JSON types in collect()/head()

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-9302. -- Resolution: Fixed > Handle complex JSON types in collect()/head() >

[jira] [Commented] (SPARK-10382) Make example code in user guide testable

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956250#comment-14956250 ] Apache Spark commented on SPARK-10382: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10382) Make example code in user guide testable

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10382: Assignee: Xusen Yin (was: Apache Spark) > Make example code in user guide testable >

[jira] [Created] (SPARK-11095) Simplify Netty RPC implementation by using a separate thread pool for each endpoint

2015-10-13 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11095: --- Summary: Simplify Netty RPC implementation by using a separate thread pool for each endpoint Key: SPARK-11095 URL: https://issues.apache.org/jira/browse/SPARK-11095

[jira] [Assigned] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11094: Assignee: (was: Apache Spark) > Test runner script fails to parse Java version. >

[jira] [Commented] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956288#comment-14956288 ] Apache Spark commented on SPARK-11094: -- User 'jodersky' has created a pull request for this issue:

[jira] [Commented] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956234#comment-14956234 ] Apache Spark commented on SPARK-9694: - User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9694: --- Assignee: (was: Apache Spark) > Add random seed Param to Scala CrossValidator >

[jira] [Assigned] (SPARK-9694) Add random seed Param to Scala CrossValidator

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9694: --- Assignee: Apache Spark > Add random seed Param to Scala CrossValidator >

[jira] [Resolved] (SPARK-10981) R semijoin leads to Java errors, R leftsemi leads to Spark errors

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10981. --- Resolution: Fixed Fix Version/s: 1.6.0 1.5.2

[jira] [Commented] (SPARK-9302) Handle complex JSON types in collect()/head()

2015-10-13 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956237#comment-14956237 ] Sun Rui commented on SPARK-9302: This is fixed after supporting complex types in DataFrame was done. >

[jira] [Commented] (SPARK-10055) San Francisco Crime Classification

2015-10-13 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956276#comment-14956276 ] Xusen Yin commented on SPARK-10055: --- Yes, I will find a new dataset soon and ping you on JIRA. > San

[jira] [Assigned] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11094: Assignee: Apache Spark > Test runner script fails to parse Java version. >

[jira] [Resolved] (SPARK-10996) Implement sampleBy() in DataFrameStatFunctions

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10996. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0

[jira] [Commented] (SPARK-9338) Aliases from SELECT not available in GROUP BY

2015-10-13 Thread fang fang chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956196#comment-14956196 ] fang fang chen commented on SPARK-9338: --- Also encounter this issue, the sql is very simple: select

[jira] [Assigned] (SPARK-10382) Make example code in user guide testable

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10382: Assignee: Apache Spark (was: Xusen Yin) > Make example code in user guide testable >

[jira] [Assigned] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11092: Assignee: (was: Apache Spark) > Add source URLs to API documentation. >

[jira] [Commented] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956270#comment-14956270 ] Apache Spark commented on SPARK-11092: -- User 'jodersky' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11092) Add source URLs to API documentation.

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11092: Assignee: Apache Spark > Add source URLs to API documentation. >

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

2015-10-13 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956279#comment-14956279 ] Xusen Yin commented on SPARK-10935: --- [~mengxr] [~kpl...@gmail.com] Are you still love to work on this?

[jira] [Created] (SPARK-11094) Test runner script fails to parse Java version.

2015-10-13 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-11094: - Summary: Test runner script fails to parse Java version. Key: SPARK-11094 URL: https://issues.apache.org/jira/browse/SPARK-11094 Project: Spark Issue

[jira] [Updated] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11078: -- Description: The new unified memory management model in SPARK-10983 uncovered many brittle tests that

[jira] [Commented] (SPARK-11079) Review Netty based RPC implementation

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954531#comment-14954531 ] Apache Spark commented on SPARK-11079: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11079) Review Netty based RPC implementation

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11079: Assignee: Apache Spark (was: Reynold Xin) > Review Netty based RPC implementation >

[jira] [Commented] (SPARK-6230) Provide authentication and encryption for Spark's RPC

2015-10-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954523#comment-14954523 ] Patrick Wendell commented on SPARK-6230: Should we update Spark's documentation to explain this? I

[jira] [Assigned] (SPARK-11079) Review Netty based RPC implementation

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11079: Assignee: Reynold Xin (was: Apache Spark) > Review Netty based RPC implementation >

[jira] [Created] (SPARK-11080) NamedExpression.newExprId should only be called on driver

2015-10-13 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11080: -- Summary: NamedExpression.newExprId should only be called on driver Key: SPARK-11080 URL: https://issues.apache.org/jira/browse/SPARK-11080 Project: Spark Issue

[jira] [Created] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

2015-10-13 Thread Mingyu Kim (JIRA)
Mingyu Kim created SPARK-11081: -- Summary: Shade Jersey dependency to work around the compatibility issue with Jersey2 Key: SPARK-11081 URL: https://issues.apache.org/jira/browse/SPARK-11081 Project:

[jira] [Updated] (SPARK-10582) using dynamic-executor-allocation, if AM failed. the new AM will be started. But the new AM does not allocate executors to dirver

2015-10-13 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-10582: -- Affects Version/s: 1.5.1 > using dynamic-executor-allocation, if AM failed. the new AM will be

[jira] [Created] (SPARK-11078) Ensure spilling tests are actually spilling

2015-10-13 Thread Andrew Or (JIRA)
Andrew Or created SPARK-11078: - Summary: Ensure spilling tests are actually spilling Key: SPARK-11078 URL: https://issues.apache.org/jira/browse/SPARK-11078 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-5293) Enable Spark user applications to use different versions of Akka

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5293: --- Target Version/s: 2+ (was: 1.6.0) > Enable Spark user applications to use different versions of Akka

[jira] [Created] (SPARK-11079) Review Netty based RPC implementation

2015-10-13 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11079: --- Summary: Review Netty based RPC implementation Key: SPARK-11079 URL: https://issues.apache.org/jira/browse/SPARK-11079 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-7995) Move AkkaRpcEnv to a separate project and remove Akka from the dependencies of Core

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7995: --- Target Version/s: 2+ (was: ) > Move AkkaRpcEnv to a separate project and remove Akka from the

[jira] [Assigned] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11082: Assignee: (was: Apache Spark) > Cores per executor is wrong when response vcore

[jira] [Assigned] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11082: Assignee: Apache Spark > Cores per executor is wrong when response vcore number is less

[jira] [Assigned] (SPARK-11036) AttributeReference should not be created outside driver

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11036: Assignee: Apache Spark > AttributeReference should not be created outside driver >

[jira] [Commented] (SPARK-11036) AttributeReference should not be created outside driver

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954590#comment-14954590 ] Apache Spark commented on SPARK-11036: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11036) AttributeReference should not be created outside driver

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11036: Assignee: (was: Apache Spark) > AttributeReference should not be created outside

[jira] [Commented] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954629#comment-14954629 ] Apache Spark commented on SPARK-11082: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Updated] (SPARK-10582) using dynamic-executor-allocation, if AM failed. the new AM will be started. But the new AM does not allocate executors to dirver

2015-10-13 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-10582: -- Description: During running tasks, when the total number of executors is the value of

[jira] [Commented] (SPARK-7402) JSON serialization of params

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954493#comment-14954493 ] Apache Spark commented on SPARK-7402: - User 'mengxr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11069: Assignee: (was: Apache Spark) > Add RegexTokenizer option to convert to lowercase >

[jira] [Assigned] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11069: Assignee: Apache Spark > Add RegexTokenizer option to convert to lowercase >

[jira] [Commented] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954536#comment-14954536 ] Apache Spark commented on SPARK-11069: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11051: -- Priority: Critical (was: Major) > NullPointerException when action called on localCheckpointed RDD

[jira] [Assigned] (SPARK-11080) NamedExpression.newExprId should only be called on driver

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11080: Assignee: Apache Spark (was: Josh Rosen) > NamedExpression.newExprId should only be

[jira] [Assigned] (SPARK-11080) NamedExpression.newExprId should only be called on driver

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11080: Assignee: Josh Rosen (was: Apache Spark) > NamedExpression.newExprId should only be

[jira] [Commented] (SPARK-11064) spark streaming checkpoint question

2015-10-13 Thread jason kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954677#comment-14954677 ] jason kim commented on SPARK-11064: --- sorry,Can you give me a link,Because I'm here to open Google has

[jira] [Resolved] (SPARK-7796) Use the new RPC implementation by default

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7796. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Target

[jira] [Updated] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

2015-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11047: -- Priority: Critical (was: Major) > Internal accumulators miss the internal flag when replaying events

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

2015-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11051: -- Affects Version/s: (was: 1.6.0) 1.5.0 Target Version/s: 1.5.2, 1.6.0 >

[jira] [Updated] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

2015-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11047: -- Affects Version/s: (was: 1.5.1) 1.5.0 Target Version/s: 1.5.2, 1.6.0 >

[jira] [Commented] (SPARK-11080) NamedExpression.newExprId should only be called on driver

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954558#comment-14954558 ] Apache Spark commented on SPARK-11080: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal

2015-10-13 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954582#comment-14954582 ] Bolke de Bruin commented on SPARK-10181: Yes that is correct. > HiveContext is not used with

[jira] [Created] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

2015-10-13 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-11082: --- Summary: Cores per executor is wrong when response vcore number is less than requested number Key: SPARK-11082 URL: https://issues.apache.org/jira/browse/SPARK-11082

[jira] [Commented] (SPARK-11064) spark streaming checkpoint question

2015-10-13 Thread jason kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954675#comment-14954675 ] jason kim commented on SPARK-11064: --- I'm not here to find the right solution. my code: def

[jira] [Commented] (SPARK-8813) Combine files when there're many small files in table

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954698#comment-14954698 ] Apache Spark commented on SPARK-8813: - User 'zhichao-li' has created a pull request for this issue:

[jira] [Updated] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11052: -- Priority: Minor (was: Major) > Spaces in the build dir causes failures in the build/mvn script >

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954757#comment-14954757 ] Sean Owen commented on SPARK-11066: --- Yes, the problem is anyone who submits a JIRA presumably wants to

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-13 Thread Dr Stephen A Hellberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954736#comment-14954736 ] Dr Stephen A Hellberg commented on SPARK-11066: --- Sean : apologies, re: Fix Version and

[jira] [Commented] (SPARK-11026) spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954928#comment-14954928 ] Thomas Graves commented on SPARK-11026: --- if you use --jars hdfs://users/foo.jar with

[jira] [Resolved] (SPARK-11026) spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-11026. --- Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 1.6.0

[jira] [Resolved] (SPARK-6187) Report full executor exceptions to the driver

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6187. -- Resolution: Duplicate Ah, is this what was already resolved in

[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

2015-10-13 Thread Don Drake (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954989#comment-14954989 ] Don Drake commented on SPARK-11085: --- Neither of the options work. > Add support for HTTP proxy >

[jira] [Updated] (SPARK-11026) spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

2015-10-13 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11026: -- Summary: spark.yarn.user.classpath.first does work for 'spark-submit --jars

[jira] [Created] (SPARK-11085) Add support for HTTP proxy

2015-10-13 Thread Dustin Cote (JIRA)
Dustin Cote created SPARK-11085: --- Summary: Add support for HTTP proxy Key: SPARK-11085 URL: https://issues.apache.org/jira/browse/SPARK-11085 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11085) Add support for HTTP proxy

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11085: -- Priority: Minor (was: Major) > Add support for HTTP proxy > --- > >

[jira] [Commented] (SPARK-6987) Node Locality is determined with String Matching instead of Inet Comparison

2015-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954983#comment-14954983 ] Piotr Kołaczkowski commented on SPARK-6987: --- Probably just having ability to list the host-names

[jira] [Created] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-13 Thread Weizhong (JIRA)
Weizhong created SPARK-11083: Summary: insert overwrite table failed when beeline reconnect Key: SPARK-11083 URL: https://issues.apache.org/jira/browse/SPARK-11083 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11084: Assignee: Apache Spark > SparseVector.__getitem__ should check if value can be non-zero

[jira] [Commented] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

2015-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954861#comment-14954861 ] Apache Spark commented on SPARK-11084: -- User 'zero323' has created a pull request for this issue:

[jira] [Updated] (SPARK-11083) insert overwrite table failed when beeline reconnect

2015-10-13 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-11083: - Description: 1. Start Thriftserver 2. Use beeline connect to thriftserver, then execute "insert

[jira] [Created] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

2015-10-13 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-11084: -- Summary: SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted Key: SPARK-11084 URL:

[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

2015-10-13 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955001#comment-14955001 ] Dustin Cote commented on SPARK-11085: - [~sowen] The problem here is that the dependencies to be

[jira] [Updated] (SPARK-11064) spark streaming checkpoint question

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11064: -- Target Version/s: (was: 1.4.1) Fix Version/s: (was: 2+) > spark streaming checkpoint

[jira] [Updated] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8170: - Assignee: Ashwin Shankar > Ctrl-C in pyspark shell doesn't kill running job >

[jira] [Resolved] (SPARK-11064) spark streaming checkpoint question

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11064. --- Resolution: Duplicate [~leehom] Please do not open any more JIRAs until you read

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10959: -- Labels: backport-needed (was: ) > PySpark StreamingLogisticRegressionWithSGD does not train with

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Johnathan Garrett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955107#comment-14955107 ] Johnathan Garrett commented on SPARK-11008: --- As an additional test, I created two separate

[jira] [Comment Edited] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Johnathan Garrett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955107#comment-14955107 ] Johnathan Garrett edited comment on SPARK-11008 at 10/13/15 3:23 PM: -

[jira] [Commented] (SPARK-6187) Report full executor exceptions to the driver

2015-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954954#comment-14954954 ] Piotr Kołaczkowski commented on SPARK-6187: --- The problem is not that the exception is not

[jira] [Updated] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11023: -- Assignee: Marcelo Vanzin > Error initializing SparkContext. java.net.URISyntaxException >

[jira] [Updated] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11081: -- Component/s: Spark Core Issue Type: Improvement (was: Bug) > Shade Jersey dependency to work

[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954980#comment-14954980 ] Sean Owen commented on SPARK-11085: --- Dustin so I'm clear, do those alternatives work? > Add support

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Johnathan Garrett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955035#comment-14955035 ] Johnathan Garrett commented on SPARK-11008: --- We are seeing this issue as well since upgrading

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

2015-10-13 Thread Dr Stephen A Hellberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955085#comment-14955085 ] Dr Stephen A Hellberg commented on SPARK-11066: --- Thanks for the clarification Sean. And,

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

2015-10-13 Thread Prasad Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955139#comment-14955139 ] Prasad Chalasani commented on SPARK-11008: -- yes that's exactly what I was seeing. You're seeing

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955308#comment-14955308 ] Reynold Xin commented on SPARK-: [~sandyr] I thought a lot about doing this on top of the existing

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955341#comment-14955341 ] Alex Liu commented on SPARK-11067: -- [~navis] Can you elaborate what could be done to improve Hive JDBC

[jira] [Resolved] (SPARK-11079) Post-hoc review Netty based RPC implementation - round 1

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11079. - Resolution: Fixed Fix Version/s: 1.6.0 > Post-hoc review Netty based RPC implementation -

[jira] [Updated] (SPARK-9844) File appender race condition during SparkWorker shutdown

2015-10-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9844: --- Priority: Major (was: Minor) > File appender race condition during SparkWorker shutdown >

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

2015-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955304#comment-14955304 ] Sean Owen commented on SPARK-: -- I had a similar question about how much more this is than the current

[jira] [Updated] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

2015-10-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11084: -- Shepherd: Joseph K. Bradley Assignee: Maciej Szymkiewicz Target

[jira] [Updated] (SPARK-10913) Add attach() function for DataFrame

2015-10-13 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10913: -- Assignee: Weiqiang Zhuang > Add attach() function for DataFrame >

[jira] [Created] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

2015-10-13 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-11086: -- Summary: createDataFrame should dropFactor column-wise not cell-wise Key: SPARK-11086 URL: https://issues.apache.org/jira/browse/SPARK-11086 Project:

  1   2   3   >