[jira] [Commented] (SPARK-18976) in standlone mode,executor expired by HeartbeanReceiver that still take up cores but no tasks assigned to

[ https://issues.apache.org/jira/browse/SPARK-18976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777821#comment-15777821 ] liujianhui commented on SPARK-18976: thanks for your attention, I found the root caus

[jira] [Commented] (SPARK-18997) Recommended upgrade libthrift to 0.9.3

[ https://issues.apache.org/jira/browse/SPARK-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777815#comment-15777815 ] Liang-Chi Hsieh commented on SPARK-18997: - I've checked the dependency and seems

[jira] [Resolved] (SPARK-17755) Master may ask a worker to launch an executor before the worker actually got the response of registration

[ https://issues.apache.org/jira/browse/SPARK-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17755. -- Resolution: Fixed Fix Version/s: 2.2.0 > Master may ask a worker to launch an executor b

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777808#comment-15777808 ] karthik G S commented on SPARK-10872: -- So, what is the possible fix on this issue?

[jira] [Commented] (SPARK-18996) Spark SQL support for post hooks

[ https://issues.apache.org/jira/browse/SPARK-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1599#comment-1599 ] Atul Payapilly commented on SPARK-18996: Yep that's right, that's exactly what I'

[jira] [Commented] (SPARK-18996) Spark SQL support for post hooks

[ https://issues.apache.org/jira/browse/SPARK-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1587#comment-1587 ] Xiao Li commented on SPARK-18996: - Are you requesting a Hive feature like https://issues

[jira] [Assigned] (SPARK-18999) simplify Literal codegen

[ https://issues.apache.org/jira/browse/SPARK-18999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18999: Assignee: Wenchen Fan (was: Apache Spark) > simplify Literal codegen > --

[jira] [Commented] (SPARK-18999) simplify Literal codegen

[ https://issues.apache.org/jira/browse/SPARK-18999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1579#comment-1579 ] Apache Spark commented on SPARK-18999: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-18999) simplify Literal codegen

[ https://issues.apache.org/jira/browse/SPARK-18999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18999: Assignee: Apache Spark (was: Wenchen Fan) > simplify Literal codegen > --

[jira] [Created] (SPARK-18999) simplify Literal codegen

Wenchen Fan created SPARK-18999: --- Summary: simplify Literal codegen Key: SPARK-18999 URL: https://issues.apache.org/jira/browse/SPARK-18999 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-18675) CTAS for hive serde table should work for all hive versions

[ https://issues.apache.org/jira/browse/SPARK-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18675: Fix Version/s: 2.0.3 > CTAS for hive serde table should work for all hive versions > --

[jira] [Updated] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

[ https://issues.apache.org/jira/browse/SPARK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18237: Fix Version/s: 2.0.3 > hive.exec.stagingdir have no effect in spark2.0.1 >

[jira] [Updated] (SPARK-18703) Insertion/CTAS against Hive Tables: Staging Directories and Data Files Not Dropped Until Normal Termination of JVM

[ https://issues.apache.org/jira/browse/SPARK-18703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18703: Fix Version/s: 2.0.3 > Insertion/CTAS against Hive Tables: Staging Directories and Data Files Not

[jira] [Assigned] (SPARK-18998) Add a cbo conf to switch between default statistics and cbo estimated statistics

[ https://issues.apache.org/jira/browse/SPARK-18998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18998: Assignee: Apache Spark > Add a cbo conf to switch between default statistics and cbo estim

[jira] [Assigned] (SPARK-18998) Add a cbo conf to switch between default statistics and cbo estimated statistics

[ https://issues.apache.org/jira/browse/SPARK-18998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18998: Assignee: (was: Apache Spark) > Add a cbo conf to switch between default statistics an

[jira] [Commented] (SPARK-18998) Add a cbo conf to switch between default statistics and cbo estimated statistics

[ https://issues.apache.org/jira/browse/SPARK-18998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777679#comment-15777679 ] Apache Spark commented on SPARK-18998: -- User 'wzhfy' has created a pull request for

[jira] [Created] (SPARK-18998) Add a cbo conf to switch between default statistics and cbo estimated statistics

Zhenhua Wang created SPARK-18998: Summary: Add a cbo conf to switch between default statistics and cbo estimated statistics Key: SPARK-18998 URL: https://issues.apache.org/jira/browse/SPARK-18998 Proj

[jira] [Comment Edited] (SPARK-13857) Feature parity for ALS ML with MLLIB

[ https://issues.apache.org/jira/browse/SPARK-13857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777650#comment-15777650 ] Debasish Das edited comment on SPARK-13857 at 12/26/16 5:57 AM: ---

[jira] [Commented] (SPARK-13857) Feature parity for ALS ML with MLLIB

[ https://issues.apache.org/jira/browse/SPARK-13857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777650#comment-15777650 ] Debasish Das commented on SPARK-13857: -- item->item and user->user was done in an old

[jira] [Commented] (SPARK-18941) "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying locations

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777600#comment-15777600 ] Apache Spark commented on SPARK-18941: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-18941) "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying locations

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18941: Assignee: Apache Spark > "Drop Table" command doesn't delete the directory of the managed

[jira] [Assigned] (SPARK-18941) "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying locations

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18941: Assignee: (was: Apache Spark) > "Drop Table" command doesn't delete the directory of t

[jira] [Resolved] (SPARK-12613) Elimination of Outer Join by Parent Join Condition

[ https://issues.apache.org/jira/browse/SPARK-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-12613. - Resolution: Duplicate > Elimination of Outer Join by Parent Join Condition >

[jira] [Commented] (SPARK-18941) "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying locations

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777553#comment-15777553 ] Dongjoon Hyun commented on SPARK-18941: --- Yep. I'll make a PR soon. > "Drop Table"

[jira] [Commented] (SPARK-18931) Create empty staging directory in partitioned table on insert

[ https://issues.apache.org/jira/browse/SPARK-18931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777543#comment-15777543 ] Xiao Li commented on SPARK-18931: - Yeah. The PR https://github.com/apache/spark/pull/1639

[jira] [Updated] (SPARK-18941) "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying locations

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18941: Summary: "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying

[jira] [Updated] (SPARK-18941) "Drop Table" command doesn't delete the directory of the managed Hive table when users specifying locations

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-18941: Issue Type: Documentation (was: Bug) > "Drop Table" command doesn't delete the directory of the managed Hi

[jira] [Commented] (SPARK-18941) Spark thrift server, Spark 2.0.2, The "drop table" command doesn't delete the directory associated with the Hive table (not EXTERNAL table) from the HDFS file system

[ https://issues.apache.org/jira/browse/SPARK-18941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777493#comment-15777493 ] Xiao Li commented on SPARK-18941: - We should document the behavior change. Maybe [~dongjo

[jira] [Created] (SPARK-18997) Recommended upgrade libthrift to 0.9.3

meiyoula created SPARK-18997: Summary: Recommended upgrade libthrift to 0.9.3 Key: SPARK-18997 URL: https://issues.apache.org/jira/browse/SPARK-18997 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-18703) Insertion/CTAS against Hive Tables: Staging Directories and Data Files Not Dropped Until Normal Termination of JVM

[ https://issues.apache.org/jira/browse/SPARK-18703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777332#comment-15777332 ] Apache Spark commented on SPARK-18703: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

[ https://issues.apache.org/jira/browse/SPARK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777331#comment-15777331 ] Apache Spark commented on SPARK-18237: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-18675) CTAS for hive serde table should work for all hive versions

[ https://issues.apache.org/jira/browse/SPARK-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15777333#comment-15777333 ] Apache Spark commented on SPARK-18675: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-18842) De-duplicate paths in classpaths in processes for local-cluster mode to work around the length limitation on Windows

[ https://issues.apache.org/jira/browse/SPARK-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18842: Assignee: Apache Spark (was: Hyukjin Kwon) > De-duplicate paths in classpaths in processe

[jira] [Assigned] (SPARK-18842) De-duplicate paths in classpaths in processes for local-cluster mode to work around the length limitation on Windows

[ https://issues.apache.org/jira/browse/SPARK-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18842: Assignee: Hyukjin Kwon (was: Apache Spark) > De-duplicate paths in classpaths in processe

[jira] [Commented] (SPARK-18842) De-duplicate paths in classpaths in processes for local-cluster mode to work around the length limitation on Windows

[ https://issues.apache.org/jira/browse/SPARK-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15776477#comment-15776477 ] Apache Spark commented on SPARK-18842: -- User 'HyukjinKwon' has created a pull reques

[jira] [Comment Edited] (SPARK-18842) De-duplicate paths in classpaths in processes for local-cluster mode to work around the length limitation on Windows

[ https://issues.apache.org/jira/browse/SPARK-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15776461#comment-15776461 ] Hyukjin Kwon edited comment on SPARK-18842 at 12/25/16 1:19 PM: ---

[jira] [Reopened] (SPARK-18842) De-duplicate paths in classpaths in processes for local-cluster mode to work around the length limitation on Windows

[ https://issues.apache.org/jira/browse/SPARK-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-18842: -- {{ReplSuite}} hangs on Windows due to this problem. The reason is, it converts the paths into URL

[jira] [Assigned] (SPARK-18922) Fix more resource-closing-related and path-related test failures in identified ones on Windows

[ https://issues.apache.org/jira/browse/SPARK-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18922: Assignee: Hyukjin Kwon (was: Apache Spark) > Fix more resource-closing-related and path-r

[jira] [Commented] (SPARK-18922) Fix more resource-closing-related and path-related test failures in identified ones on Windows

[ https://issues.apache.org/jira/browse/SPARK-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15776431#comment-15776431 ] Apache Spark commented on SPARK-18922: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-18922) Fix more resource-closing-related and path-related test failures in identified ones on Windows

[ https://issues.apache.org/jira/browse/SPARK-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18922: Assignee: Apache Spark (was: Hyukjin Kwon) > Fix more resource-closing-related and path-r

[jira] [Reopened] (SPARK-18922) Fix more resource-closing-related and path-related test failures in identified ones on Windows

[ https://issues.apache.org/jira/browse/SPARK-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-18922: -- I am reopening this as I found some more errors as below: {code} ColumnExpressionSuite: - input_fi