[jira] [Commented] (SPARK-6230) Provide authentication and encryption for Spark's RPC

[ https://issues.apache.org/jira/browse/SPARK-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954523#comment-14954523 ] Patrick Wendell commented on SPARK-6230: Should we update Spark's documentation to

[jira] [Resolved] (SPARK-7796) Use the new RPC implementation by default

[ https://issues.apache.org/jira/browse/SPARK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7796. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Target Ver

[jira] [Updated] (SPARK-7995) Move AkkaRpcEnv to a separate project and remove Akka from the dependencies of Core

[ https://issues.apache.org/jira/browse/SPARK-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7995: --- Target Version/s: 2+ (was: ) > Move AkkaRpcEnv to a separate project and remove Akka from the depende

[jira] [Updated] (SPARK-5293) Enable Spark user applications to use different versions of Akka

[ https://issues.apache.org/jira/browse/SPARK-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5293: --- Target Version/s: 2+ (was: 1.6.0) > Enable Spark user applications to use different versions of Akka

[jira] [Created] (SPARK-11079) Review Netty based RPC implementation

Reynold Xin created SPARK-11079: --- Summary: Review Netty based RPC implementation Key: SPARK-11079 URL: https://issues.apache.org/jira/browse/SPARK-11079 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-11079) Review Netty based RPC implementation

[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954531#comment-14954531 ] Apache Spark commented on SPARK-11079: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11079) Review Netty based RPC implementation

[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11079: Assignee: Apache Spark (was: Reynold Xin) > Review Netty based RPC implementation > -

[jira] [Assigned] (SPARK-11079) Review Netty based RPC implementation

[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11079: Assignee: Reynold Xin (was: Apache Spark) > Review Netty based RPC implementation > -

[jira] [Commented] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954536#comment-14954536 ] Apache Spark commented on SPARK-11069: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11069: Assignee: (was: Apache Spark) > Add RegexTokenizer option to convert to lowercase > --

[jira] [Assigned] (SPARK-11069) Add RegexTokenizer option to convert to lowercase

[ https://issues.apache.org/jira/browse/SPARK-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11069: Assignee: Apache Spark > Add RegexTokenizer option to convert to lowercase > -

[jira] [Updated] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11047: -- Priority: Critical (was: Major) > Internal accumulators miss the internal flag when replaying events i

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11051: -- Affects Version/s: (was: 1.6.0) 1.5.0 Target Version/s: 1.5.2, 1.6.0 >

[jira] [Updated] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11047: -- Affects Version/s: (was: 1.5.1) 1.5.0 Target Version/s: 1.5.2, 1.6.0 >

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11051: -- Priority: Critical (was: Major) > NullPointerException when action called on localCheckpointed RDD (th

[jira] [Created] (SPARK-11080) NamedExpression.newExprId should only be called on driver

Josh Rosen created SPARK-11080: -- Summary: NamedExpression.newExprId should only be called on driver Key: SPARK-11080 URL: https://issues.apache.org/jira/browse/SPARK-11080 Project: Spark Issue T

[jira] [Commented] (SPARK-11080) NamedExpression.newExprId should only be called on driver

[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954558#comment-14954558 ] Apache Spark commented on SPARK-11080: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-11080) NamedExpression.newExprId should only be called on driver

[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11080: Assignee: Apache Spark (was: Josh Rosen) > NamedExpression.newExprId should only be calle

[jira] [Assigned] (SPARK-11080) NamedExpression.newExprId should only be called on driver

[ https://issues.apache.org/jira/browse/SPARK-11080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11080: Assignee: Josh Rosen (was: Apache Spark) > NamedExpression.newExprId should only be calle

[jira] [Created] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

Mingyu Kim created SPARK-11081: -- Summary: Shade Jersey dependency to work around the compatibility issue with Jersey2 Key: SPARK-11081 URL: https://issues.apache.org/jira/browse/SPARK-11081 Project: Spar

[jira] [Commented] (SPARK-10181) HiveContext is not used with keytab principal but with user principal

[ https://issues.apache.org/jira/browse/SPARK-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954582#comment-14954582 ] Bolke de Bruin commented on SPARK-10181: Yes that is correct. > HiveContext is

[jira] [Assigned] (SPARK-11036) AttributeReference should not be created outside driver

[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11036: Assignee: Apache Spark > AttributeReference should not be created outside driver > ---

[jira] [Commented] (SPARK-11036) AttributeReference should not be created outside driver

[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954590#comment-14954590 ] Apache Spark commented on SPARK-11036: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-11036) AttributeReference should not be created outside driver

[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11036: Assignee: (was: Apache Spark) > AttributeReference should not be created outside drive

[jira] [Created] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

Saisai Shao created SPARK-11082: --- Summary: Cores per executor is wrong when response vcore number is less than requested number Key: SPARK-11082 URL: https://issues.apache.org/jira/browse/SPARK-11082 Pr

[jira] [Commented] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954629#comment-14954629 ] Apache Spark commented on SPARK-11082: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11082: Assignee: (was: Apache Spark) > Cores per executor is wrong when response vcore number

[jira] [Assigned] (SPARK-11082) Cores per executor is wrong when response vcore number is less than requested number

[ https://issues.apache.org/jira/browse/SPARK-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11082: Assignee: Apache Spark > Cores per executor is wrong when response vcore number is less th

[jira] [Updated] (SPARK-10582) using dynamic-executor-allocation, if AM failed. the new AM will be started. But the new AM does not allocate executors to dirver

[ https://issues.apache.org/jira/browse/SPARK-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-10582: -- Description: During running tasks, when the total number of executors is the value of spark.dyn

[jira] [Updated] (SPARK-10582) using dynamic-executor-allocation, if AM failed. the new AM will be started. But the new AM does not allocate executors to dirver

[ https://issues.apache.org/jira/browse/SPARK-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-10582: -- Affects Version/s: 1.5.1 > using dynamic-executor-allocation, if AM failed. the new AM will be

[jira] [Commented] (SPARK-11064) spark streaming checkpoint question

[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954675#comment-14954675 ] jason kim commented on SPARK-11064: --- I'm not here to find the right solution. my code:

[jira] [Commented] (SPARK-11064) spark streaming checkpoint question

[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954677#comment-14954677 ] jason kim commented on SPARK-11064: --- sorry，Can you give me a link，Because I'm here to o

[jira] [Commented] (SPARK-8813) Combine files when there're many small files in table

[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954698#comment-14954698 ] Apache Spark commented on SPARK-8813: - User 'zhichao-li' has created a pull request fo

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954736#comment-14954736 ] Dr Stephen A Hellberg commented on SPARK-11066: --- Sean : apologies, re: Fix

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954757#comment-14954757 ] Sean Owen commented on SPARK-11066: --- Yes, the problem is anyone who submits a JIRA pres

[jira] [Updated] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11052: -- Priority: Minor (was: Major) > Spaces in the build dir causes failures in the build/mvn script > -

[jira] [Created] (SPARK-11083) insert overwrite table failed when beeline reconnect

Weizhong created SPARK-11083: Summary: insert overwrite table failed when beeline reconnect Key: SPARK-11083 URL: https://issues.apache.org/jira/browse/SPARK-11083 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11083) insert overwrite table failed when beeline reconnect

[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-11083: - Description: 1. Start Thriftserver 2. Use beeline connect to thriftserver, then execute "insert overwrite

[jira] [Created] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

Maciej Szymkiewicz created SPARK-11084: -- Summary: SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted Key: SPARK-11084 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Assigned] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11084: Assignee: Apache Spark > SparseVector.__getitem__ should check if value can be non-zero be

[jira] [Assigned] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11084: Assignee: (was: Apache Spark) > SparseVector.__getitem__ should check if value can be

[jira] [Commented] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954861#comment-14954861 ] Apache Spark commented on SPARK-11084: -- User 'zero323' has created a pull request fo

[jira] [Updated] (SPARK-11026) spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

[ https://issues.apache.org/jira/browse/SPARK-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11026: -- Summary: spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar

[jira] [Commented] (SPARK-11026) spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

[ https://issues.apache.org/jira/browse/SPARK-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954928#comment-14954928 ] Thomas Graves commented on SPARK-11026: --- if you use --jars hdfs://users/foo.jar wit

[jira] [Resolved] (SPARK-11026) spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

[ https://issues.apache.org/jira/browse/SPARK-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-11026. --- Resolution: Fixed Assignee: Lianhui Wang Fix Version/s: 1.6.0

[jira] [Created] (SPARK-11085) Add support for HTTP proxy

Dustin Cote created SPARK-11085: --- Summary: Add support for HTTP proxy Key: SPARK-11085 URL: https://issues.apache.org/jira/browse/SPARK-11085 Project: Spark Issue Type: Improvement C

[jira] [Resolved] (SPARK-6187) Report full executor exceptions to the driver

[ https://issues.apache.org/jira/browse/SPARK-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6187. -- Resolution: Duplicate Ah, is this what was already resolved in https://issues.apache.org/jira/browse/SP

[jira] [Updated] (SPARK-11085) Add support for HTTP proxy

[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11085: -- Priority: Minor (was: Major) > Add support for HTTP proxy > --- > >

[jira] [Commented] (SPARK-6987) Node Locality is determined with String Matching instead of Inet Comparison

[ https://issues.apache.org/jira/browse/SPARK-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954983#comment-14954983 ] Piotr Kołaczkowski commented on SPARK-6987: --- Probably just having ability to lis

[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954989#comment-14954989 ] Don Drake commented on SPARK-11085: --- Neither of the options work. > Add support for HT

[jira] [Commented] (SPARK-6187) Report full executor exceptions to the driver

[ https://issues.apache.org/jira/browse/SPARK-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954954#comment-14954954 ] Piotr Kołaczkowski commented on SPARK-6187: --- The problem is not that the excepti

[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954980#comment-14954980 ] Sean Owen commented on SPARK-11085: --- Dustin so I'm clear, do those alternatives work?

[jira] [Commented] (SPARK-11085) Add support for HTTP proxy

[ https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955001#comment-14955001 ] Dustin Cote commented on SPARK-11085: - [~sowen] The problem here is that the dependen

[jira] [Updated] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11023: -- Assignee: Marcelo Vanzin > Error initializing SparkContext. java.net.URISyntaxException > -

[jira] [Updated] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8170: - Assignee: Ashwin Shankar > Ctrl-C in pyspark shell doesn't kill running job >

[jira] [Updated] (SPARK-11064) spark streaming checkpoint question

[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11064: -- Target Version/s: (was: 1.4.1) Fix Version/s: (was: 2+) > spark streaming checkpoint quest

[jira] [Resolved] (SPARK-11064) spark streaming checkpoint question

[ https://issues.apache.org/jira/browse/SPARK-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11064. --- Resolution: Duplicate [~leehom] Please do not open any more JIRAs until you read https://cwiki.apach

[jira] [Updated] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11081: -- Component/s: Spark Core Issue Type: Improvement (was: Bug) > Shade Jersey dependency to work arou

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10959: -- Labels: backport-needed (was: ) > PySpark StreamingLogisticRegressionWithSGD does not train with given

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955035#comment-14955035 ] Johnathan Garrett commented on SPARK-11008: --- We are seeing this issue as well s

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955085#comment-14955085 ] Dr Stephen A Hellberg commented on SPARK-11066: --- Thanks for the clarificati

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955107#comment-14955107 ] Johnathan Garrett commented on SPARK-11008: --- As an additional test, I created t

[jira] [Comment Edited] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955107#comment-14955107 ] Johnathan Garrett edited comment on SPARK-11008 at 10/13/15 3:23 PM: --

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955139#comment-14955139 ] Prasad Chalasani commented on SPARK-11008: -- yes that's exactly what I was seeing

[jira] [Commented] (SPARK-10504) aggregate where NULL is defined as the value expression aborts when SUM used

[ https://issues.apache.org/jira/browse/SPARK-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955214#comment-14955214 ] Charmee Patel commented on SPARK-10504: --- This fix only works when tungsten is enabl

[jira] [Resolved] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11009. -- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull request 9

[jira] [Updated] (SPARK-2750) Add Https support for Web UI

[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2750: --- Description: Now I try to add https support for web ui using Jetty ssl integration.Below is the plan:

[jira] [Updated] (SPARK-11079) Post-hoc review Netty based RPC implementation - round 1

[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11079: Summary: Post-hoc review Netty based RPC implementation - round 1 (was: Review Netty based RPC imp

[jira] [Resolved] (SPARK-11079) Post-hoc review Netty based RPC implementation - round 1

[ https://issues.apache.org/jira/browse/SPARK-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11079. - Resolution: Fixed Fix Version/s: 1.6.0 > Post-hoc review Netty based RPC implementation -

[jira] [Commented] (SPARK-2563) Re-open sockets to handle connect timeouts

[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955264#comment-14955264 ] Romi Kuntsman commented on SPARK-2563: -- i got a socket timeout in spark 1.4.0 is this

[jira] [Commented] (SPARK-2563) Re-open sockets to handle connect timeouts

[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955269#comment-14955269 ] Shivaram Venkataraman commented on SPARK-2563: -- This bug was for the old NIO

[jira] [Resolved] (SPARK-11030) SQLTab should be shared by across sessions

[ https://issues.apache.org/jira/browse/SPARK-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11030. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9048 [https://github.com/a

[jira] [Resolved] (SPARK-10051) Support collecting data of StructType in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10051. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.0 Reso

[jira] [Updated] (SPARK-9844) File appender race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9844: --- Priority: Major (was: Minor) > File appender race condition during SparkWorker shutdown > ---

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955286#comment-14955286 ] Sandy Ryza commented on SPARK-: --- To ask the obvious question: what are the reasons t

[jira] [Resolved] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10888. --- Resolution: Fixed Assignee: Narine Kokhlikyan Fix Version/s: 1

[jira] [Updated] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10913: -- Assignee: Weiqiang Zhuang > Add attach() function for DataFrame > -

[jira] [Resolved] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10913. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolved by https://github.com/

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955304#comment-14955304 ] Sean Owen commented on SPARK-: -- I had a similar question about how much more this is

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955308#comment-14955308 ] Reynold Xin commented on SPARK-: [~sandyr] I thought a lot about doing this on top

[jira] [Created] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

Maciej Szymkiewicz created SPARK-11086: -- Summary: createDataFrame should dropFactor column-wise not cell-wise Key: SPARK-11086 URL: https://issues.apache.org/jira/browse/SPARK-11086 Project: Spa

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955320#comment-14955320 ] Sandy Ryza commented on SPARK-: --- [~rxin] where are the places where the API would ne

[jira] [Updated] (SPARK-11084) SparseVector.__getitem__ should check if value can be non-zero before executing searchsorted

[ https://issues.apache.org/jira/browse/SPARK-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11084: -- Shepherd: Joseph K. Bradley Assignee: Maciej Szymkiewicz Target

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955335#comment-14955335 ] Reynold Xin commented on SPARK-: The big ones are: 1. encoders (which breaks almos

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955336#comment-14955336 ] Shivaram Venkataraman commented on SPARK-11086: --- This is a great suggestion

[jira] [Commented] (SPARK-11066) Flaky test o.a.scheduler.DAGSchedulerSuite.misbehavedResultHandler occasionally fails due to j.l.UnsupportedOperationException concerning a finished JobWaiter

[ https://issues.apache.org/jira/browse/SPARK-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955337#comment-14955337 ] Dr Stephen A Hellberg commented on SPARK-11066: --- Added some indentation to

[jira] [Resolved] (SPARK-11036) AttributeReference should not be created outside driver

[ https://issues.apache.org/jira/browse/SPARK-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11036. Resolution: Duplicate > AttributeReference should not be created outside driver > -

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955341#comment-14955341 ] Alex Liu commented on SPARK-11067: -- [~navis] Can you elaborate what could be done to imp

[jira] [Created] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

patcharee created SPARK-11087: - Summary: spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate Key: SPARK-11087 URL: https://issues.apache.org/jira/browse/SPARK-11087 Project: Spark

[jira] [Resolved] (SPARK-6561) Add partition support in saveAsParquet

[ https://issues.apache.org/jira/browse/SPARK-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6561. --- Resolution: Duplicate Assignee: Cheng Lian Fix Version/s: 1.4.0 > Add partition suppor

[jira] [Assigned] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11086: Assignee: (was: Apache Spark) > createDataFrame should dropFactor column-wise not cell

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955358#comment-14955358 ] Apache Spark commented on SPARK-11086: -- User 'zero323' has created a pull request fo

[jira] [Assigned] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11086: Assignee: Apache Spark > createDataFrame should dropFactor column-wise not cell-wise > --

[jira] [Created] (SPARK-11088) Optimize DataSourceStrategy.mergeWithPartitionValues

Cheng Lian created SPARK-11088: -- Summary: Optimize DataSourceStrategy.mergeWithPartitionValues Key: SPARK-11088 URL: https://issues.apache.org/jira/browse/SPARK-11088 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955368#comment-14955368 ] Michael Armbrust commented on SPARK-: - Other compatibility breaking things inc

[jira] [Commented] (SPARK-11057) SQL: corr and cov for many columns

[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955376#comment-14955376 ] Narine Kokhlikyan commented on SPARK-11057: --- I have one short question about th

[jira] [Commented] (SPARK-11057) SQL: corr and cov for many columns

[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955379#comment-14955379 ] Reynold Xin commented on SPARK-11057: - Not sure if there is an explicit max, but the

[jira] [Reopened] (SPARK-10617) Leap year miscalculated in sql query

[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shao lo reopened SPARK-10617: - The bug is not that add_months is wrong. The bug is that order of evaluation is wrong. The two queries in

[jira] [Created] (SPARK-11089) Add a option for thrift-server to share a single session across all connections

Davies Liu created SPARK-11089: -- Summary: Add a option for thrift-server to share a single session across all connections Key: SPARK-11089 URL: https://issues.apache.org/jira/browse/SPARK-11089 Project:

[jira] [Commented] (SPARK-10791) Optimize MLlib LDA topic distribution query performance

[ https://issues.apache.org/jira/browse/SPARK-10791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955408#comment-14955408 ] Mohamed Baddar commented on SPARK-10791: [~aspa] would you please clarify the spe

  1   2   3   >