[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251402#comment-15251402 ] Sean Owen commented on SPARK-14790: --- It's not standard in Maven to run verification che

[jira] [Commented] (SPARK-14750) Make historyServer refer application log in hdfs

[ https://issues.apache.org/jira/browse/SPARK-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251401#comment-15251401 ] Sean Owen commented on SPARK-14750: --- Can you give a specific example of what function (

[jira] [Commented] (SPARK-14798) Move native command and script transformation parsing into SparkSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251397#comment-15251397 ] Apache Spark commented on SPARK-14798: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14798) Move native command and script transformation parsing into SparkSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14798: Assignee: Apache Spark (was: Reynold Xin) > Move native command and script transformation

[jira] [Assigned] (SPARK-14798) Move native command and script transformation parsing into SparkSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14798: Assignee: Reynold Xin (was: Apache Spark) > Move native command and script transformation

[jira] [Created] (SPARK-14798) Move native command and script transformation parsing into SparkSqlAstBuilder

Reynold Xin created SPARK-14798: --- Summary: Move native command and script transformation parsing into SparkSqlAstBuilder Key: SPARK-14798 URL: https://issues.apache.org/jira/browse/SPARK-14798 Project:

[jira] [Commented] (SPARK-14760) Feature transformers should always invoke transformSchema in transform or fit

[ https://issues.apache.org/jira/browse/SPARK-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251391#comment-15251391 ] Nick Pentreath commented on SPARK-14760: In general, given the name {{transformSc

[jira] [Commented] (SPARK-14797) Spark SQL should not hardcode dependency on spark-sketch_2.11

[ https://issues.apache.org/jira/browse/SPARK-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251389#comment-15251389 ] Apache Spark commented on SPARK-14797: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-14797) Spark SQL should not hardcode dependency on spark-sketch_2.11

[ https://issues.apache.org/jira/browse/SPARK-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14797: Assignee: Apache Spark (was: Josh Rosen) > Spark SQL should not hardcode dependency on sp

[jira] [Assigned] (SPARK-14797) Spark SQL should not hardcode dependency on spark-sketch_2.11

[ https://issues.apache.org/jira/browse/SPARK-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14797: Assignee: Josh Rosen (was: Apache Spark) > Spark SQL should not hardcode dependency on sp

[jira] [Created] (SPARK-14797) Spark SQL should not hardcode dependency on spark-sketch_2.11

Josh Rosen created SPARK-14797: -- Summary: Spark SQL should not hardcode dependency on spark-sketch_2.11 Key: SPARK-14797 URL: https://issues.apache.org/jira/browse/SPARK-14797 Project: Spark Is

[jira] [Commented] (SPARK-14760) Feature transformers should always invoke transformSchema in transform or fit

[ https://issues.apache.org/jira/browse/SPARK-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251372#comment-15251372 ] Nick Pentreath commented on SPARK-14760: It seems it is there for validation now,

[jira] [Assigned] (SPARK-14796) Add spark.sql.optimizer.minSetSize config option

[ https://issues.apache.org/jira/browse/SPARK-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14796: Assignee: (was: Apache Spark) > Add spark.sql.optimizer.minSetSize config option > ---

[jira] [Assigned] (SPARK-14796) Add spark.sql.optimizer.minSetSize config option

[ https://issues.apache.org/jira/browse/SPARK-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14796: Assignee: Apache Spark > Add spark.sql.optimizer.minSetSize config option > --

[jira] [Resolved] (SPARK-14658) when executor lost DagScheduer may submit one stage twice even if the first running taskset for this stage is not finished

[ https://issues.apache.org/jira/browse/SPARK-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14658. --- Resolution: Duplicate This looks like a duplicate; at least the other JIRA already had a PR and some

[jira] [Commented] (SPARK-14796) Add spark.sql.optimizer.minSetSize config option

[ https://issues.apache.org/jira/browse/SPARK-14796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251368#comment-15251368 ] Apache Spark commented on SPARK-14796: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Created] (SPARK-14796) Add spark.sql.optimizer.minSetSize config option

Dongjoon Hyun created SPARK-14796: - Summary: Add spark.sql.optimizer.minSetSize config option Key: SPARK-14796 URL: https://issues.apache.org/jira/browse/SPARK-14796 Project: Spark Issue Type

[jira] [Commented] (SPARK-14693) Spark Streaming Context Hangs on Start

[ https://issues.apache.org/jira/browse/SPARK-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251354#comment-15251354 ] Sean Owen commented on SPARK-14693: --- The question is what the state of the application

[jira] [Commented] (SPARK-14745) CEP support in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251353#comment-15251353 ] Mario Briggs commented on SPARK-14745: -- Hi Sean, thanks for 'fixing' the target. To

[jira] [Comment Edited] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251339#comment-15251339 ] Hyukjin Kwon edited comment on SPARK-14525 at 4/21/16 6:17 AM:

[jira] [Assigned] (SPARK-14795) Remove the use of Hive's variable substitution

[ https://issues.apache.org/jira/browse/SPARK-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14795: Assignee: Apache Spark (was: Reynold Xin) > Remove the use of Hive's variable substitutio

[jira] [Commented] (SPARK-14795) Remove the use of Hive's variable substitution

[ https://issues.apache.org/jira/browse/SPARK-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251345#comment-15251345 ] Apache Spark commented on SPARK-14795: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14795) Remove the use of Hive's variable substitution

[ https://issues.apache.org/jira/browse/SPARK-14795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14795: Assignee: Reynold Xin (was: Apache Spark) > Remove the use of Hive's variable substitutio

[jira] [Created] (SPARK-14795) Remove the use of Hive's variable substitution

Reynold Xin created SPARK-14795: --- Summary: Remove the use of Hive's variable substitution Key: SPARK-14795 URL: https://issues.apache.org/jira/browse/SPARK-14795 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251339#comment-15251339 ] Hyukjin Kwon commented on SPARK-14525: -- I think it might be great if we can cc who k

[jira] [Assigned] (SPARK-14794) Don't pass analyze command into Hive

[ https://issues.apache.org/jira/browse/SPARK-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14794: Assignee: Apache Spark (was: Reynold Xin) > Don't pass analyze command into Hive > --

[jira] [Assigned] (SPARK-14794) Don't pass analyze command into Hive

[ https://issues.apache.org/jira/browse/SPARK-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14794: Assignee: Reynold Xin (was: Apache Spark) > Don't pass analyze command into Hive > --

[jira] [Commented] (SPARK-14794) Don't pass analyze command into Hive

[ https://issues.apache.org/jira/browse/SPARK-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251329#comment-15251329 ] Apache Spark commented on SPARK-14794: -- User 'rxin' has created a pull request for t

[jira] [Created] (SPARK-14794) Don't pass analyze command into Hive

Reynold Xin created SPARK-14794: --- Summary: Don't pass analyze command into Hive Key: SPARK-14794 URL: https://issues.apache.org/jira/browse/SPARK-14794 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-14760) Feature transformers should always invoke transformSchema in transform or fit

[ https://issues.apache.org/jira/browse/SPARK-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251324#comment-15251324 ] yuhao yang commented on SPARK-14760: [~holdenkarau] also shared some thoughts in the

[jira] [Resolved] (SPARK-14786) Remove hive-cli dependency from hive subproject

[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14786. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove hive-cli dependency from hive subproject >

[jira] [Resolved] (SPARK-14778) Remove HiveSessionState.substitutor

[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14778. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12550 [https://github.com/

[jira] [Assigned] (SPARK-14571) Log instrumentation in ALS

[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14571: Assignee: Apache Spark > Log instrumentation in ALS > -- > >

[jira] [Commented] (SPARK-14571) Log instrumentation in ALS

[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251311#comment-15251311 ] Apache Spark commented on SPARK-14571: -- User 'wangmiao1981' has created a pull reque

[jira] [Assigned] (SPARK-14571) Log instrumentation in ALS

[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14571: Assignee: (was: Apache Spark) > Log instrumentation in ALS > -

[jira] [Commented] (SPARK-14653) Remove NumericParser and jackson dependency from mllib-local

[ https://issues.apache.org/jira/browse/SPARK-14653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251308#comment-15251308 ] Vishnu Prasad commented on SPARK-14653: --- Hey I've just written an example of a UDT

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251304#comment-15251304 ] Jakob Odersky commented on SPARK-10001: --- FYI, I took up the issue (previous pr #821

[jira] [Commented] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251301#comment-15251301 ] Takeshi Yamamuro commented on SPARK-14525: -- Nobody here? If so, I'll try to take

[jira] [Assigned] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

[ https://issues.apache.org/jira/browse/SPARK-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14793: Assignee: Apache Spark > Code generation for large complex type exceeds JVM size limit. >

[jira] [Assigned] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

[ https://issues.apache.org/jira/browse/SPARK-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14793: Assignee: (was: Apache Spark) > Code generation for large complex type exceeds JVM siz

[jira] [Commented] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

[ https://issues.apache.org/jira/browse/SPARK-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251300#comment-15251300 ] Apache Spark commented on SPARK-14793: -- User 'ueshin' has created a pull request for

[jira] [Commented] (SPARK-14597) Streaming Listener timing metrics should include time spent in JobGenerator's graph.generateJobs

[ https://issues.apache.org/jira/browse/SPARK-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251285#comment-15251285 ] Mario Briggs commented on SPARK-14597: -- Yeah i think it is neat. Good to me. Thanks

[jira] [Created] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

Takuya Ueshin created SPARK-14793: - Summary: Code generation for large complex type exceeds JVM size limit. Key: SPARK-14793 URL: https://issues.apache.org/jira/browse/SPARK-14793 Project: Spark

[jira] [Resolved] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14782. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12550 [https://github.com/

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 3:51 AM:

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 3:49 AM:

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251201#comment-15251201 ] Zhongshuai Pei commented on SPARK-4105: --- I find that some task recompute before this

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251196#comment-15251196 ] Sun Rui commented on SPARK-12922: - cool. If possible, could you make it a WIP PR so that

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251192#comment-15251192 ] Apache Spark commented on SPARK-10001: -- User 'jodersky' has created a pull request f

[jira] [Commented] (SPARK-14750) Make historyServer refer application log in hdfs

[ https://issues.apache.org/jira/browse/SPARK-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251184#comment-15251184 ] SuYan commented on SPARK-14750: --- In yarn mode, spark user can't refer executor log on histo

[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251171#comment-15251171 ] Eric Liang commented on SPARK-14790: You can cache the style results so it's not that

[jira] [Assigned] (SPARK-14792) Move as many parsing rules as possible into SQL parser

[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14792: Assignee: Reynold Xin (was: Apache Spark) > Move as many parsing rules as possible into S

[jira] [Assigned] (SPARK-14792) Move as many parsing rules as possible into SQL parser

[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14792: Assignee: Apache Spark (was: Reynold Xin) > Move as many parsing rules as possible into S

[jira] [Commented] (SPARK-14792) Move as many parsing rules as possible into SQL parser

[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251167#comment-15251167 ] Apache Spark commented on SPARK-14792: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-14778) Remove HiveSessionState.substitutor

[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251164#comment-15251164 ] Apache Spark commented on SPARK-14778: -- User 'rxin' has created a pull request for t

[jira] [Updated] (SPARK-14792) Move as many parsing rules as possible into SQL parser

[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14792: Description: This patch moves as many parsing rules as possible into SQL parser. There are only th

[jira] [Updated] (SPARK-14792) Move as many parsing rules as possible into SQL parser

[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14792: Summary: Move as many parsing rules as possible into SQL parser (was: Move all parsing rules excep

[jira] [Created] (SPARK-14792) Move all parsing rules except view & analyze into SQL parser

Reynold Xin created SPARK-14792: --- Summary: Move all parsing rules except view & analyze into SQL parser Key: SPARK-14792 URL: https://issues.apache.org/jira/browse/SPARK-14792 Project: Spark I

[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251160#comment-15251160 ] Reynold Xin commented on SPARK-14790: - Hm I think part of the problem is that it is s

[jira] [Created] (SPARK-14791) TPCDS Q23B generate different result each time

Davies Liu created SPARK-14791: -- Summary: TPCDS Q23B generate different result each time Key: SPARK-14791 URL: https://issues.apache.org/jira/browse/SPARK-14791 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251158#comment-15251158 ] Apache Spark commented on SPARK-14790: -- User 'ericl' has created a pull request for

[jira] [Assigned] (SPARK-14790) Scalastyle should run on compile in sbt

[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14790: Assignee: Apache Spark > Scalastyle should run on compile in sbt > ---

[jira] [Assigned] (SPARK-14790) Scalastyle should run on compile in sbt

[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14790: Assignee: (was: Apache Spark) > Scalastyle should run on compile in sbt >

[jira] [Commented] (SPARK-14746) Support transformations in R source code for Dataset/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251152#comment-15251152 ] Sun Rui commented on SPARK-14746: - fine. > Support transformations in R source code for

[jira] [Comment Edited] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251144#comment-15251144 ] Sun Rui edited comment on SPARK-13525 at 4/21/16 2:43 AM: -- We ne

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251144#comment-15251144 ] Sun Rui commented on SPARK-13525: - We need to find the root cause before we have a fix fo

[jira] [Created] (SPARK-14790) Scalastyle should run on compile in sbt

Eric Liang created SPARK-14790: -- Summary: Scalastyle should run on compile in sbt Key: SPARK-14790 URL: https://issues.apache.org/jira/browse/SPARK-14790 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14789) Move FunctionResourceLoader into SessionState

[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14789: Assignee: Apache Spark (was: Andrew Or) > Move FunctionResourceLoader into SessionState >

[jira] [Commented] (SPARK-14789) Move FunctionResourceLoader into SessionState

[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251126#comment-15251126 ] Apache Spark commented on SPARK-14789: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-14789) Move FunctionResourceLoader into SessionState

[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14789: Assignee: Andrew Or (was: Apache Spark) > Move FunctionResourceLoader into SessionState >

[jira] [Created] (SPARK-14789) Move FunctionResourceLoader into SessionState

Andrew Or created SPARK-14789: - Summary: Move FunctionResourceLoader into SessionState Key: SPARK-14789 URL: https://issues.apache.org/jira/browse/SPARK-14789 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13643) Create SparkSession interface

[ https://issues.apache.org/jira/browse/SPARK-13643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251114#comment-15251114 ] Apache Spark commented on SPARK-13643: -- User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-14730) Expose ColumnPruner as feature transformer

[ https://issues.apache.org/jira/browse/SPARK-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251115#comment-15251115 ] Yanbo Liang commented on SPARK-14730: - [~BenFradet] I'm not working on it. Please fee

[jira] [Created] (SPARK-14788) Initial number of executors should honor min number if streaming dynamic allocation is enabled

Saisai Shao created SPARK-14788: --- Summary: Initial number of executors should honor min number if streaming dynamic allocation is enabled Key: SPARK-14788 URL: https://issues.apache.org/jira/browse/SPARK-14788

[jira] [Commented] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

[ https://issues.apache.org/jira/browse/SPARK-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251069#comment-15251069 ] Apache Spark commented on SPARK-14787: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

[ https://issues.apache.org/jira/browse/SPARK-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14787: Assignee: (was: Apache Spark) > Upgrade Joda-Time library from 2.9 to 2.9.3 >

[jira] [Assigned] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

[ https://issues.apache.org/jira/browse/SPARK-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14787: Assignee: Apache Spark > Upgrade Joda-Time library from 2.9 to 2.9.3 > ---

[jira] [Created] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

Hyukjin Kwon created SPARK-14787: Summary: Upgrade Joda-Time library from 2.9 to 2.9.3 Key: SPARK-14787 URL: https://issues.apache.org/jira/browse/SPARK-14787 Project: Spark Issue Type: Impro

[jira] [Assigned] (SPARK-14786) Remove hive-cli dependency from hive subproject

[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14786: Assignee: Josh Rosen (was: Apache Spark) > Remove hive-cli dependency from hive subprojec

[jira] [Commented] (SPARK-14786) Remove hive-cli dependency from hive subproject

[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251055#comment-15251055 ] Apache Spark commented on SPARK-14786: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-14786) Remove hive-cli dependency from hive subproject

[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14786: Assignee: Apache Spark (was: Josh Rosen) > Remove hive-cli dependency from hive subprojec

[jira] [Created] (SPARK-14786) Remove hive-cli dependency from hive subproject

Josh Rosen created SPARK-14786: -- Summary: Remove hive-cli dependency from hive subproject Key: SPARK-14786 URL: https://issues.apache.org/jira/browse/SPARK-14786 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14778) Remove HiveSessionState.substitutor

[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251052#comment-15251052 ] Apache Spark commented on SPARK-14778: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14778) Remove HiveSessionState.substitutor

[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14778: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveSessionState.substitutor > ---

[jira] [Assigned] (SPARK-14778) Remove HiveSessionState.substitutor

[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14778: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveSessionState.substitutor > ---

[jira] [Commented] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251050#comment-15251050 ] Apache Spark commented on SPARK-14782: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14782: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveConf dependency from HiveSqlAstBui

[jira] [Assigned] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14782: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveConf dependency from HiveSqlAstBui

[jira] [Updated] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14782: Summary: Remove HiveConf dependency from HiveSqlAstBuilder (was: Remove HiveConf dependency from H

[jira] [Resolved] (SPARK-14775) Remove TestHiveSparkSession.rewritePaths

[ https://issues.apache.org/jira/browse/SPARK-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14775. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove TestHiveSparkSession.rewritePaths > --

[jira] [Commented] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251010#comment-15251010 ] Wenchen Fan commented on SPARK-14767: - This is a known issue, the reason is that we c

[jira] [Commented] (SPARK-14765) Jenkins should run tests only based on the PR contents

[ https://issues.apache.org/jira/browse/SPARK-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251007#comment-15251007 ] Dongjoon Hyun commented on SPARK-14765: --- And, when I rebased my repository to the m

[jira] [Commented] (SPARK-14765) Jenkins should run tests only based on the PR contents

[ https://issues.apache.org/jira/browse/SPARK-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250988#comment-15250988 ] Dongjoon Hyun commented on SPARK-14765: --- By the way, it happens again. I just leave

[jira] [Updated] (SPARK-14785) Support correlated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-14785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14785: --- Description: For example: SELECT a from t where b > (select c from t2 where t.id = t2.id) TPCDS Q92

[jira] [Resolved] (SPARK-14602) [YARN+Windows] Setting SPARK_YARN_CACHE_FILES exceeds command line length limit on Windows

[ https://issues.apache.org/jira/browse/SPARK-14602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-14602. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 > [YARN+Win

[jira] [Created] (SPARK-14785) Support correlated scalar subquery

Davies Liu created SPARK-14785: -- Summary: Support correlated scalar subquery Key: SPARK-14785 URL: https://issues.apache.org/jira/browse/SPARK-14785 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-14784) Build SQL for EXISTS/IN subquery

Davies Liu created SPARK-14784: -- Summary: Build SQL for EXISTS/IN subquery Key: SPARK-14784 URL: https://issues.apache.org/jira/browse/SPARK-14784 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-14780) Add `setLogLevel` to SparkR

[ https://issues.apache.org/jira/browse/SPARK-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14780: -- Description: This issue aims to add `setLogLevel` functions to SparkR context. **Spark Shell**

[jira] [Commented] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250962#comment-15250962 ] Apache Spark commented on SPARK-14783: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14783: Assignee: Apache Spark > Log full exception stacktrace in IsolatedClientLoader > -

  1   2   3   4   >