[jira] [Updated] (SPARK-15535) Remove code for TRUNCATE TABLE ... COLUMN

[ https://issues.apache.org/jira/browse/SPARK-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15535: -- Priority: Minor (was: Major) > Remove code for TRUNCATE TABLE ... COLUMN > ---

[jira] [Updated] (SPARK-15534) TRUNCATE TABLE should throw exceptions, not logError

[ https://issues.apache.org/jira/browse/SPARK-15534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15534: -- Priority: Minor (was: Major) > TRUNCATE TABLE should throw exceptions, not logError >

[jira] [Updated] (SPARK-15536) Disallow TRUNCATE TABLE with external tables

[ https://issues.apache.org/jira/browse/SPARK-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15536: -- Assignee: Suresh Thalamati (was: Andrew Or) > Disallow TRUNCATE TABLE with external tables > -

[jira] [Created] (SPARK-15536) Disallow TRUNCATE TABLE with external tables

Andrew Or created SPARK-15536: - Summary: Disallow TRUNCATE TABLE with external tables Key: SPARK-15536 URL: https://issues.apache.org/jira/browse/SPARK-15536 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15535) Remove code for TRUNCATE TABLE ... COLUMN

Andrew Or created SPARK-15535: - Summary: Remove code for TRUNCATE TABLE ... COLUMN Key: SPARK-15535 URL: https://issues.apache.org/jira/browse/SPARK-15535 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15534) TRUNCATE TABLE should throw exceptions, not logError

Andrew Or created SPARK-15534: - Summary: TRUNCATE TABLE should throw exceptions, not logError Key: SPARK-15534 URL: https://issues.apache.org/jira/browse/SPARK-15534 Project: Spark Issue Type: Bu

[jira] [Resolved] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15345. --- Resolution: Fixed Assignee: Jeff Zhang (was: Reynold Xin) > SparkSession's conf doesn't take e

[jira] [Updated] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15345: -- Assignee: Reynold Xin (was: Jeff Zhang) > SparkSession's conf doesn't take effect when there's already

[jira] [Resolved] (SPARK-15511) Dropping data source table succeeds but throws exception

[ https://issues.apache.org/jira/browse/SPARK-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15511. --- Resolution: Not A Problem Assignee: Andrew Or If you run into this issue again, just delete $SP

[jira] [Updated] (SPARK-15511) Dropping data source table succeeds but throws exception

[ https://issues.apache.org/jira/browse/SPARK-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15511: -- Description: If the catalog is backed by Hive: {code} scala> sql("CREATE TABLE boxes (width INT, lengt

[jira] [Created] (SPARK-15511) Dropping data source table succeeds but throws exception

Andrew Or created SPARK-15511: - Summary: Dropping data source table succeeds but throws exception Key: SPARK-15511 URL: https://issues.apache.org/jira/browse/SPARK-15511 Project: Spark Issue Type

[jira] [Resolved] (SPARK-15388) spark sql "CREATE FUNCTION" throws exception with hive 1.2.1

[ https://issues.apache.org/jira/browse/SPARK-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15388. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > spark sql "CREATE F

[jira] [Updated] (SPARK-15388) spark sql "CREATE FUNCTION" throws exception with hive 1.2.1

[ https://issues.apache.org/jira/browse/SPARK-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15388: -- Assignee: Yang Wang > spark sql "CREATE FUNCTION" throws exception with hive 1.2.1 > --

[jira] [Commented] (SPARK-15450) Clean up SparkSession builder for python

[ https://issues.apache.org/jira/browse/SPARK-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297800#comment-15297800 ] Andrew Or commented on SPARK-15450: --- Actually I already have some ideas for this one.

[jira] [Resolved] (SPARK-15464) Replace SQLContext and SparkContext with SparkSession using builder pattern in python testsuites

[ https://issues.apache.org/jira/browse/SPARK-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15464. --- Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 2.0.0 Target Versio

[jira] [Resolved] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15311. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target Version/s

[jira] [Resolved] (SPARK-15488) Possible Accumulator bug causing OneVsRestSuite to be flaky

[ https://issues.apache.org/jira/browse/SPARK-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15488. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target V

[jira] [Resolved] (SPARK-15279) Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.)

[ https://issues.apache.org/jira/browse/SPARK-15279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15279. --- Resolution: Fixed Fix Version/s: 2.0.0 > Disallow ROW FORMAT and STORED AS (parquet | orc | av

[jira] [Updated] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15397: -- Summary: 'locate' UDF got different result with boundary value case compared to Hive engine (was: [Spa

[jira] [Updated] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15397: -- Assignee: Adrian Wang > 'locate' UDF got different result with boundary value case compared to Hive >

[jira] [Resolved] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15477. --- Resolution: Not A Bug > HiveContext is private[hive] and not accessible to users. >

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15296763#comment-15296763 ] Andrew Or commented on SPARK-15477: --- What part of the code makes you think it's private

[jira] [Resolved] (SPARK-15456) PySpark Shell fails to create SparkContext if HiveConf not found

[ https://issues.apache.org/jira/browse/SPARK-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15456. --- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.0.0 Target Vers

[jira] [Created] (SPARK-15450) Clean up SparkSession builder for python

Andrew Or created SPARK-15450: - Summary: Clean up SparkSession builder for python Key: SPARK-15450 URL: https://issues.apache.org/jira/browse/SPARK-15450 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15293899#comment-15293899 ] Andrew Or commented on SPARK-15345: --- The python part should be resolved by SPARK-15417,

[jira] [Updated] (SPARK-15417) Failed to enable hive support in PySpark shell

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15417: -- Summary: Failed to enable hive support in PySpark shell (was: Failed to enable HiveSupport in PySpark)

[jira] [Resolved] (SPARK-15417) Failed to enable HiveSupport in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15417. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Failed to enable Hi

[jira] [Resolved] (SPARK-15421) Table and Database property values need to be validated

[ https://issues.apache.org/jira/browse/SPARK-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15421. --- Resolution: Fixed Fix Version/s: 2.0.0 > Table and Database property values need to be validat

[jira] [Created] (SPARK-15421) Table and Database property values need to be validated

Andrew Or created SPARK-15421: - Summary: Table and Database property values need to be validated Key: SPARK-15421 URL: https://issues.apache.org/jira/browse/SPARK-15421 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15417) Failed to enable HiveSupport in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292159#comment-15292159 ] Andrew Or commented on SPARK-15417: --- Good catch, I have a patch to fix this. > Failed

[jira] [Assigned] (SPARK-15417) Failed to enable HiveSupport in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15417: - Assignee: Andrew Or > Failed to enable HiveSupport in PySpark >

[jira] [Resolved] (SPARK-15392) The default value of size estimation is not good

[ https://issues.apache.org/jira/browse/SPARK-15392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15392. --- Resolution: Fixed Target Version/s: 2.0.0 > The default value of size estimation is not goo

[jira] [Resolved] (SPARK-15317) JobProgressListener takes a huge amount of memory with iterative DataFrame program in local, standalone

[ https://issues.apache.org/jira/browse/SPARK-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15317. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Target Vers

[jira] [Resolved] (SPARK-15387) SessionCatalog in SimpleAnalyzer does not need to make database directory.

[ https://issues.apache.org/jira/browse/SPARK-15387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15387. --- Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 Target Ve

[jira] [Resolved] (SPARK-15300) Can't remove a block if it's under evicting

[ https://issues.apache.org/jira/browse/SPARK-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15300. --- Resolution: Fixed Fix Version/s: 2.0.0 > Can't remove a block if it's under evicting > ---

[jira] [Updated] (SPARK-15357) Cooperative spilling should check consumer memory mode

[ https://issues.apache.org/jira/browse/SPARK-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15357: -- Description: In TaskMemoryManager.java: {code} for (MemoryConsumer c: consumers) { if (c != consumer

[jira] [Created] (SPARK-15357) Cooperative spilling should check consumer memory mode

Andrew Or created SPARK-15357: - Summary: Cooperative spilling should check consumer memory mode Key: SPARK-15357 URL: https://issues.apache.org/jira/browse/SPARK-15357 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14684. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Verification of par

[jira] [Resolved] (SPARK-15277) Checking Partition Spec Existence Before Dropping

[ https://issues.apache.org/jira/browse/SPARK-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15277. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target Version/s

[jira] [Updated] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14684: -- Description: When attempting to drop partitions of a table, if the user provides an unknown column, Hi

[jira] [Commented] (SPARK-15289) SQL test compilation error from merge conflict

[ https://issues.apache.org/jira/browse/SPARK-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281678#comment-15281678 ] Andrew Or commented on SPARK-15289: --- Done, thanks for the ping. > SQL test compilation

[jira] [Resolved] (SPARK-15289) SQL test compilation error from merge conflict

[ https://issues.apache.org/jira/browse/SPARK-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15289. --- Resolution: Fixed Fix Version/s: 2.0.0 > SQL test compilation error from merge conflict >

[jira] [Resolved] (SPARK-15264) Spark 2.0 CSV Reader: NPE on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15264. --- Resolution: Fixed Fix Version/s: 2.0.0 > Spark 2.0 CSV Reader: NPE on Blank Column Names > ---

[jira] [Resolved] (SPARK-15274) CSV default column names should be consistent

[ https://issues.apache.org/jira/browse/SPARK-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15274. --- Resolution: Fixed Fix Version/s: 2.0.0 > CSV default column names should be consistent > -

[jira] [Resolved] (SPARK-15276) CREATE TABLE with LOCATION should imply EXTERNAL

[ https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15276. --- Resolution: Fixed Fix Version/s: 2.0.0 > CREATE TABLE with LOCATION should imply EXTERNAL > --

[jira] [Created] (SPARK-15279) Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.)

Andrew Or created SPARK-15279: - Summary: Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.) Key: SPARK-15279 URL: https://issues.apache.org/jira/browse/SPARK-15279 Project: Spark Issu

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Summary: CatalogTable should store sort ordering for sorted columns (was: [SQL] CatalogTable should st

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Priority: Major (was: Trivial) > CatalogTable should store sort ordering for sorted columns >

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Assignee: Tejas Patil > CatalogTable should store sort ordering for sorted columns > --

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Affects Version/s: (was: 1.6.1) 2.0.0 > CatalogTable should store sort order

[jira] [Created] (SPARK-15276) CREATE TABLE with LOCATION should imply EXTERNAL

Andrew Or created SPARK-15276: - Summary: CREATE TABLE with LOCATION should imply EXTERNAL Key: SPARK-15276 URL: https://issues.apache.org/jira/browse/SPARK-15276 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15264: -- Assignee: Bill Chambers > Spark 2.0 CSV Reader: Error on Blank Column Names > -

[jira] [Updated] (SPARK-15264) Spark 2.0 CSV Reader: NPE on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15264: -- Summary: Spark 2.0 CSV Reader: NPE on Blank Column Names (was: Spark 2.0 CSV Reader: Error on Blank Co

[jira] [Updated] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15264: -- Target Version/s: 2.0.0 > Spark 2.0 CSV Reader: Error on Blank Column Names > -

[jira] [Updated] (SPARK-15274) CSV default column names should be consistent

[ https://issues.apache.org/jira/browse/SPARK-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15274: -- Assignee: Bill Chambers > CSV default column names should be consistent > -

[jira] [Created] (SPARK-15274) CSV default column names should be consistent

Andrew Or created SPARK-15274: - Summary: CSV default column names should be consistent Key: SPARK-15274 URL: https://issues.apache.org/jira/browse/SPARK-15274 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13566) Deadlock between MemoryStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280615#comment-15280615 ] Andrew Or commented on SPARK-13566: --- [~ekeddy] This only happens with the unified memor

[jira] [Updated] (SPARK-15262) race condition in killing an executor and reregistering an executor

[ https://issues.apache.org/jira/browse/SPARK-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15262: -- Target Version/s: 1.6.2, 2.0.0 > race condition in killing an executor and reregistering an executor >

[jira] [Resolved] (SPARK-15249) Use FunctionResource instead of (String, String) in CreateFunction and CatalogFunction for resource

[ https://issues.apache.org/jira/browse/SPARK-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15249. --- Resolution: Fixed Assignee: Sandeep Singh Fix Version/s: 2.0.0 Target Ver

[jira] [Created] (SPARK-15257) Require CREATE EXTERNAL TABLE to specify LOCATION

Andrew Or created SPARK-15257: - Summary: Require CREATE EXTERNAL TABLE to specify LOCATION Key: SPARK-15257 URL: https://issues.apache.org/jira/browse/SPARK-15257 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14857) Table/Database Name Validation in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14857: -- Assignee: Xiao Li > Table/Database Name Validation in SessionCatalog >

[jira] [Resolved] (SPARK-14603) SessionCatalog needs to check if a metadata operation is valid

[ https://issues.apache.org/jira/browse/SPARK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14603. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > SessionCatalog needs to ch

[jira] [Updated] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14684: -- Assignee: Xiao Li > Verification of partition specs in SessionCatalog > ---

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Component/s: SQL > Use SparkSession instead of SQLContext in testsuites > -

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Component/s: Tests > Use SparkSession instead of SQLContext in testsuites > ---

[jira] [Resolved] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15037. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Use SparkSession in

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Component/s: Spark Shell > No way to disable Hive support in REPL > ---

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Assignee: (was: Andrew Or) > No way to disable Hive support in REPL > -

[jira] [Created] (SPARK-15236) No way to disable Hive support in REPL

Andrew Or created SPARK-15236: - Summary: No way to disable Hive support in REPL Key: SPARK-15236 URL: https://issues.apache.org/jira/browse/SPARK-15236 Project: Spark Issue Type: Bug Co

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15234: - Assignee: Andrew Or > spark.catalog.listDatabases.show() is not formatted correctly > --

[jira] [Created] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

Andrew Or created SPARK-15234: - Summary: spark.catalog.listDatabases.show() is not formatted correctly Key: SPARK-15234 URL: https://issues.apache.org/jira/browse/SPARK-15234 Project: Spark Issu

[jira] [Updated] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15234: -- Description: {code} scala> spark.catalog.listDatabases.show() ++---+---

[jira] [Commented] (SPARK-14021) Support custom context derived from HiveContext for SparkSQLEnv

[ https://issues.apache.org/jira/browse/SPARK-14021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276820#comment-15276820 ] Andrew Or commented on SPARK-14021: --- Closing as Won't Fix because the issue is outdated

[jira] [Resolved] (SPARK-14021) Support custom context derived from HiveContext for SparkSQLEnv

[ https://issues.apache.org/jira/browse/SPARK-14021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14021. --- Resolution: Won't Fix > Support custom context derived from HiveContext for SparkSQLEnv > ---

[jira] [Resolved] (SPARK-10653) Remove unnecessary things from SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10653. --- Resolution: Fixed Assignee: Alex Bozarth Fix Version/s: 2.0.0 Target Vers

[jira] [Resolved] (SPARK-15210) Add missing @DeveloperApi annotation in sql.types

[ https://issues.apache.org/jira/browse/SPARK-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15210. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Add missing @Develo

[jira] [Resolved] (SPARK-15166) Move hive-specific conf setting from SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15166. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move hive-specific conf setting from SparkSession > -

[jira] [Updated] (SPARK-15210) Add missing @DeveloperApi annotation in sql.types

[ https://issues.apache.org/jira/browse/SPARK-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15210: -- Assignee: zhengruifeng > Add missing @DeveloperApi annotation in sql.types > --

[jira] [Resolved] (SPARK-15220) Add hyperlink to "running application" and "completed application"

[ https://issues.apache.org/jira/browse/SPARK-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15220. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Add hyperlink to "r

[jira] [Resolved] (SPARK-15067) YARN executors are launched with fixed perm gen size

[ https://issues.apache.org/jira/browse/SPARK-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15067. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 Target Version

[jira] [Resolved] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

[ https://issues.apache.org/jira/browse/SPARK-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15225. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target V

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Assignee: Philipp Hoffmann > spark.executor.logs.rolling.maxSize wrongly referred to as > spark.execut

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Target Version/s: 1.6.2, 2.0.0 (was: 2.0.0) > spark.executor.logs.rolling.maxSize wrongly referred to

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Fix Version/s: 1.6.2 > spark.executor.logs.rolling.maxSize wrongly referred to as > spark.executor.log

[jira] [Resolved] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15223. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > spark.executor.logs

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Priority: Minor (was: Trivial) > spark.executor.logs.rolling.maxSize wrongly referred to as > spark.e

[jira] [Resolved] (SPARK-15093) create/delete/rename directory for InMemoryCatalog operations if needed

[ https://issues.apache.org/jira/browse/SPARK-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15093. --- Resolution: Fixed Fix Version/s: 2.0.0 > create/delete/rename directory for InMemoryCatalog op

[jira] [Resolved] (SPARK-13566) Deadlock between MemoryStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13566. --- Resolution: Fixed Fix Version/s: 1.6.2 > Deadlock between MemoryStore and BlockManager > -

[jira] [Resolved] (SPARK-15167) Add public catalog implementation method to SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15167. --- Resolution: Won't Fix > Add public catalog implementation method to SparkSession > --

[jira] [Updated] (SPARK-13566) Deadlock between MemoryStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13566: -- Assignee: cen yuhai > Deadlock between MemoryStore and BlockManager > -

[jira] [Resolved] (SPARK-15152) Scaladoc and Code style Improvements

[ https://issues.apache.org/jira/browse/SPARK-15152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15152. --- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 2.0.0 Target V

[jira] [Created] (SPARK-15167) Add public catalog implementation method to SparkSession

Andrew Or created SPARK-15167: - Summary: Add public catalog implementation method to SparkSession Key: SPARK-15167 URL: https://issues.apache.org/jira/browse/SPARK-15167 Project: Spark Issue Type

[jira] [Updated] (SPARK-15166) Move hive-specific conf setting from SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15166: -- Summary: Move hive-specific conf setting from SparkSession (was: Move hive-specific conf setting to Hi

[jira] [Created] (SPARK-15166) Move hive-specific conf setting to HiveSharedState

Andrew Or created SPARK-15166: - Summary: Move hive-specific conf setting to HiveSharedState Key: SPARK-15166 URL: https://issues.apache.org/jira/browse/SPARK-15166 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-14893) Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed

[ https://issues.apache.org/jira/browse/SPARK-14893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14893. --- Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.0.0 > Re-enable HiveSparkSu

[jira] [Updated] (SPARK-15158) Too aggressive logging in SizeBasedRollingPolicy?

[ https://issues.apache.org/jira/browse/SPARK-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15158: -- Assignee: Kai Wang > Too aggressive logging in SizeBasedRollingPolicy? > --

[jira] [Resolved] (SPARK-9926) Parallelize file listing for partitioned Hive table

[ https://issues.apache.org/jira/browse/SPARK-9926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9926. -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Parallelize file listi

[jira] [Resolved] (SPARK-15158) Too aggressive logging in SizeBasedRollingPolicy?

[ https://issues.apache.org/jira/browse/SPARK-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15158. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Too aggressive logg

[jira] [Resolved] (SPARK-15134) Indent SparkSession builder patterns and update binary_classification_metrics_example.py

[ https://issues.apache.org/jira/browse/SPARK-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15134. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 Target Ver

[jira] [Resolved] (SPARK-15135) Make sure SparkSession thread safe

[ https://issues.apache.org/jira/browse/SPARK-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15135. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make sure SparkSession thread safe >

<    1   2   3   4   5   6   7   8   9   10   >