[jira] [Updated] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

[ https://issues.apache.org/jira/browse/SPARK-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15576: -- Assignee: (was: Andrew Or) > Add back hive tests blacklisted by SPARK-15539 >

[jira] [Updated] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15520: -- Assignee: Eric Liang > SparkSession builder in python should also allow overriding confs of existing

[jira] [Resolved] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15520. --- Resolution: Fixed Fix Version/s: 2.0.0 > SparkSession builder in python should also allow

[jira] [Resolved] (SPARK-15539) DROP TABLE should throw exceptions, not logError

[ https://issues.apache.org/jira/browse/SPARK-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15539. --- Resolution: Fixed Fix Version/s: 2.0.0 > DROP TABLE should throw exceptions, not logError >

[jira] [Created] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

Andrew Or created SPARK-15576: - Summary: Add back hive tests blacklisted by SPARK-15539 Key: SPARK-15576 URL: https://issues.apache.org/jira/browse/SPARK-15576 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15506) only one notebook can define a UDF; java.sql.SQLException: Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302359#comment-15302359 ] Andrew Davidson commented on SPARK-15506: - Hi Jeff Here is how I start the notebook server. I

[jira] [Assigned] (SPARK-15536) Disallow TRUNCATE TABLE with external tables and views

[ https://issues.apache.org/jira/browse/SPARK-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15536: - Assignee: Andrew Or (was: Suresh Thalamati) > Disallow TRUNCATE TABLE with external tables and

[jira] [Updated] (SPARK-15538) Truncate table does not work on data source table

[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15538: -- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Truncate table does not work on data source

[jira] [Updated] (SPARK-15536) Disallow TRUNCATE TABLE with external tables and views

[ https://issues.apache.org/jira/browse/SPARK-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15536: -- Summary: Disallow TRUNCATE TABLE with external tables and views (was: Disallow TRUNCATE TABLE with

[jira] [Updated] (SPARK-15538) Truncate table does not work on data source table

[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15538: -- Description: Truncate table does not seem to work on data source tables. Repro: {code} val df =

[jira] [Updated] (SPARK-15538) Truncate table does not work on data source table

[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15538: -- Description: Truncate table does not seems to work on data source table. It returns success without

[jira] [Updated] (SPARK-15538) Truncate table does not work on data source table

[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15538: -- Summary: Truncate table does not work on data source table (was: Truncate table does not work on data

[jira] [Assigned] (SPARK-15538) Truncate table does not work on data source table

[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15538: - Assignee: Andrew Or (was: Suresh Thalamati) > Truncate table does not work on data source

[jira] [Created] (SPARK-15539) DROP TABLE should throw exceptions, not logError

Andrew Or created SPARK-15539: - Summary: DROP TABLE should throw exceptions, not logError Key: SPARK-15539 URL: https://issues.apache.org/jira/browse/SPARK-15539 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15538) Truncate table does not work on data source table , and does not raise error either.

[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15538: -- Assignee: Suresh Thalamati > Truncate table does not work on data source table , and does not raise

[jira] [Updated] (SPARK-15535) Remove code for TRUNCATE TABLE ... COLUMN

[ https://issues.apache.org/jira/browse/SPARK-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15535: -- Priority: Minor (was: Major) > Remove code for TRUNCATE TABLE ... COLUMN >

[jira] [Updated] (SPARK-15534) TRUNCATE TABLE should throw exceptions, not logError

[ https://issues.apache.org/jira/browse/SPARK-15534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15534: -- Priority: Minor (was: Major) > TRUNCATE TABLE should throw exceptions, not logError >

[jira] [Updated] (SPARK-15536) Disallow TRUNCATE TABLE with external tables

[ https://issues.apache.org/jira/browse/SPARK-15536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15536: -- Assignee: Suresh Thalamati (was: Andrew Or) > Disallow TRUNCATE TABLE with external tables >

[jira] [Created] (SPARK-15536) Disallow TRUNCATE TABLE with external tables

Andrew Or created SPARK-15536: - Summary: Disallow TRUNCATE TABLE with external tables Key: SPARK-15536 URL: https://issues.apache.org/jira/browse/SPARK-15536 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15535) Remove code for TRUNCATE TABLE ... COLUMN

Andrew Or created SPARK-15535: - Summary: Remove code for TRUNCATE TABLE ... COLUMN Key: SPARK-15535 URL: https://issues.apache.org/jira/browse/SPARK-15535 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15534) TRUNCATE TABLE should throw exceptions, not logError

Andrew Or created SPARK-15534: - Summary: TRUNCATE TABLE should throw exceptions, not logError Key: SPARK-15534 URL: https://issues.apache.org/jira/browse/SPARK-15534 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15345. --- Resolution: Fixed Assignee: Jeff Zhang (was: Reynold Xin) > SparkSession's conf doesn't take

[jira] [Updated] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15345: -- Assignee: Reynold Xin (was: Jeff Zhang) > SparkSession's conf doesn't take effect when there's

[jira] [Resolved] (SPARK-15511) Dropping data source table succeeds but throws exception

[ https://issues.apache.org/jira/browse/SPARK-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15511. --- Resolution: Not A Problem Assignee: Andrew Or If you run into this issue again, just delete

[jira] [Updated] (SPARK-15511) Dropping data source table succeeds but throws exception

[ https://issues.apache.org/jira/browse/SPARK-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15511: -- Description: If the catalog is backed by Hive: {code} scala> sql("CREATE TABLE boxes (width INT,

[jira] [Created] (SPARK-15511) Dropping data source table succeeds but throws exception

Andrew Or created SPARK-15511: - Summary: Dropping data source table succeeds but throws exception Key: SPARK-15511 URL: https://issues.apache.org/jira/browse/SPARK-15511 Project: Spark Issue

[jira] [Resolved] (SPARK-15388) spark sql "CREATE FUNCTION" throws exception with hive 1.2.1

[ https://issues.apache.org/jira/browse/SPARK-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15388. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > spark sql "CREATE

[jira] [Updated] (SPARK-15388) spark sql "CREATE FUNCTION" throws exception with hive 1.2.1

[ https://issues.apache.org/jira/browse/SPARK-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15388: -- Assignee: Yang Wang > spark sql "CREATE FUNCTION" throws exception with hive 1.2.1 >

[jira] [Created] (SPARK-15506) only one notebook can define a UDF; java.sql.SQLException: Another instance of Derby may have already booted the database

Andrew Davidson created SPARK-15506: --- Summary: only one notebook can define a UDF; java.sql.SQLException: Another instance of Derby may have already booted the database Key: SPARK-15506 URL:

[jira] [Commented] (SPARK-15450) Clean up SparkSession builder for python

[ https://issues.apache.org/jira/browse/SPARK-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297800#comment-15297800 ] Andrew Or commented on SPARK-15450: --- Actually I already have some ideas for this one. > Clean up

[jira] [Resolved] (SPARK-15464) Replace SQLContext and SparkContext with SparkSession using builder pattern in python testsuites

[ https://issues.apache.org/jira/browse/SPARK-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15464. --- Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15311) Disallow DML on Non-temporary Tables when Using In-Memory Catalog

[ https://issues.apache.org/jira/browse/SPARK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15311. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15488) Possible Accumulator bug causing OneVsRestSuite to be flaky

[ https://issues.apache.org/jira/browse/SPARK-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15488. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15279) Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.)

[ https://issues.apache.org/jira/browse/SPARK-15279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15279. --- Resolution: Fixed Fix Version/s: 2.0.0 > Disallow ROW FORMAT and STORED AS (parquet | orc |

[jira] [Updated] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15397: -- Summary: 'locate' UDF got different result with boundary value case compared to Hive engine (was:

[jira] [Updated] (SPARK-15397) 'locate' UDF got different result with boundary value case compared to Hive engine

[ https://issues.apache.org/jira/browse/SPARK-15397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15397: -- Assignee: Adrian Wang > 'locate' UDF got different result with boundary value case compared to Hive >

[jira] [Resolved] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15477. --- Resolution: Not A Bug > HiveContext is private[hive] and not accessible to users. >

[jira] [Commented] (SPARK-15477) HiveContext is private[hive] and not accessible to users.

[ https://issues.apache.org/jira/browse/SPARK-15477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296763#comment-15296763 ] Andrew Or commented on SPARK-15477: --- What part of the code makes you think it's private[hive]?

[jira] [Resolved] (SPARK-15456) PySpark Shell fails to create SparkContext if HiveConf not found

[ https://issues.apache.org/jira/browse/SPARK-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15456. --- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.0.0 Target

[jira] [Created] (SPARK-15450) Clean up SparkSession builder for python

Andrew Or created SPARK-15450: - Summary: Clean up SparkSession builder for python Key: SPARK-15450 URL: https://issues.apache.org/jira/browse/SPARK-15450 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293899#comment-15293899 ] Andrew Or commented on SPARK-15345: --- The python part should be resolved by SPARK-15417,

[jira] [Updated] (SPARK-15417) Failed to enable hive support in PySpark shell

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15417: -- Summary: Failed to enable hive support in PySpark shell (was: Failed to enable HiveSupport in

[jira] [Resolved] (SPARK-15417) Failed to enable HiveSupport in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15417. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Failed to enable

[jira] [Resolved] (SPARK-15421) Table and Database property values need to be validated

[ https://issues.apache.org/jira/browse/SPARK-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15421. --- Resolution: Fixed Fix Version/s: 2.0.0 > Table and Database property values need to be

[jira] [Created] (SPARK-15421) Table and Database property values need to be validated

Andrew Or created SPARK-15421: - Summary: Table and Database property values need to be validated Key: SPARK-15421 URL: https://issues.apache.org/jira/browse/SPARK-15421 Project: Spark Issue

[jira] [Commented] (SPARK-15417) Failed to enable HiveSupport in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292159#comment-15292159 ] Andrew Or commented on SPARK-15417: --- Good catch, I have a patch to fix this. > Failed to enable

[jira] [Assigned] (SPARK-15417) Failed to enable HiveSupport in PySpark

[ https://issues.apache.org/jira/browse/SPARK-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15417: - Assignee: Andrew Or > Failed to enable HiveSupport in PySpark >

[jira] [Resolved] (SPARK-15392) The default value of size estimation is not good

[ https://issues.apache.org/jira/browse/SPARK-15392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15392. --- Resolution: Fixed Target Version/s: 2.0.0 > The default value of size estimation is not

[jira] [Resolved] (SPARK-15317) JobProgressListener takes a huge amount of memory with iterative DataFrame program in local, standalone

[ https://issues.apache.org/jira/browse/SPARK-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15317. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15387) SessionCatalog in SimpleAnalyzer does not need to make database directory.

[ https://issues.apache.org/jira/browse/SPARK-15387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15387. --- Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15300) Can't remove a block if it's under evicting

[ https://issues.apache.org/jira/browse/SPARK-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15300. --- Resolution: Fixed Fix Version/s: 2.0.0 > Can't remove a block if it's under evicting >

[jira] [Updated] (SPARK-15357) Cooperative spilling should check consumer memory mode

[ https://issues.apache.org/jira/browse/SPARK-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15357: -- Description: In TaskMemoryManager.java: {code} for (MemoryConsumer c: consumers) { if (c != consumer

[jira] [Created] (SPARK-15357) Cooperative spilling should check consumer memory mode

Andrew Or created SPARK-15357: - Summary: Cooperative spilling should check consumer memory mode Key: SPARK-15357 URL: https://issues.apache.org/jira/browse/SPARK-15357 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14684. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Verification of

[jira] [Resolved] (SPARK-15277) Checking Partition Spec Existence Before Dropping

[ https://issues.apache.org/jira/browse/SPARK-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15277. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14684: -- Description: When attempting to drop partitions of a table, if the user provides an unknown column,

[jira] [Commented] (SPARK-15289) SQL test compilation error from merge conflict

[ https://issues.apache.org/jira/browse/SPARK-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281678#comment-15281678 ] Andrew Or commented on SPARK-15289: --- Done, thanks for the ping. > SQL test compilation error from

[jira] [Resolved] (SPARK-15289) SQL test compilation error from merge conflict

[ https://issues.apache.org/jira/browse/SPARK-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15289. --- Resolution: Fixed Fix Version/s: 2.0.0 > SQL test compilation error from merge conflict >

[jira] [Resolved] (SPARK-15264) Spark 2.0 CSV Reader: NPE on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15264. --- Resolution: Fixed Fix Version/s: 2.0.0 > Spark 2.0 CSV Reader: NPE on Blank Column Names >

[jira] [Resolved] (SPARK-15274) CSV default column names should be consistent

[ https://issues.apache.org/jira/browse/SPARK-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15274. --- Resolution: Fixed Fix Version/s: 2.0.0 > CSV default column names should be consistent >

[jira] [Resolved] (SPARK-15276) CREATE TABLE with LOCATION should imply EXTERNAL

[ https://issues.apache.org/jira/browse/SPARK-15276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15276. --- Resolution: Fixed Fix Version/s: 2.0.0 > CREATE TABLE with LOCATION should imply EXTERNAL >

[jira] [Created] (SPARK-15279) Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.)

Andrew Or created SPARK-15279: - Summary: Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.) Key: SPARK-15279 URL: https://issues.apache.org/jira/browse/SPARK-15279 Project: Spark

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Summary: CatalogTable should store sort ordering for sorted columns (was: [SQL] CatalogTable should

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Priority: Major (was: Trivial) > CatalogTable should store sort ordering for sorted columns >

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Assignee: Tejas Patil > CatalogTable should store sort ordering for sorted columns >

[jira] [Updated] (SPARK-15275) CatalogTable should store sort ordering for sorted columns

[ https://issues.apache.org/jira/browse/SPARK-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15275: -- Affects Version/s: (was: 1.6.1) 2.0.0 > CatalogTable should store sort

[jira] [Created] (SPARK-15276) CREATE TABLE with LOCATION should imply EXTERNAL

Andrew Or created SPARK-15276: - Summary: CREATE TABLE with LOCATION should imply EXTERNAL Key: SPARK-15276 URL: https://issues.apache.org/jira/browse/SPARK-15276 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15264: -- Assignee: Bill Chambers > Spark 2.0 CSV Reader: Error on Blank Column Names >

[jira] [Updated] (SPARK-15264) Spark 2.0 CSV Reader: NPE on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15264: -- Summary: Spark 2.0 CSV Reader: NPE on Blank Column Names (was: Spark 2.0 CSV Reader: Error on Blank

[jira] [Updated] (SPARK-15264) Spark 2.0 CSV Reader: Error on Blank Column Names

[ https://issues.apache.org/jira/browse/SPARK-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15264: -- Target Version/s: 2.0.0 > Spark 2.0 CSV Reader: Error on Blank Column Names >

[jira] [Updated] (SPARK-15274) CSV default column names should be consistent

[ https://issues.apache.org/jira/browse/SPARK-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15274: -- Assignee: Bill Chambers > CSV default column names should be consistent >

[jira] [Created] (SPARK-15274) CSV default column names should be consistent

Andrew Or created SPARK-15274: - Summary: CSV default column names should be consistent Key: SPARK-15274 URL: https://issues.apache.org/jira/browse/SPARK-15274 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13566) Deadlock between MemoryStore and BlockManager

[ https://issues.apache.org/jira/browse/SPARK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280615#comment-15280615 ] Andrew Or commented on SPARK-13566: --- [~ekeddy] This only happens with the unified memory manager, so

[jira] [Updated] (SPARK-15262) race condition in killing an executor and reregistering an executor

[ https://issues.apache.org/jira/browse/SPARK-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15262: -- Target Version/s: 1.6.2, 2.0.0 > race condition in killing an executor and reregistering an executor >

[jira] [Resolved] (SPARK-15249) Use FunctionResource instead of (String, String) in CreateFunction and CatalogFunction for resource

[ https://issues.apache.org/jira/browse/SPARK-15249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15249. --- Resolution: Fixed Assignee: Sandeep Singh Fix Version/s: 2.0.0 Target

[jira] [Created] (SPARK-15257) Require CREATE EXTERNAL TABLE to specify LOCATION

Andrew Or created SPARK-15257: - Summary: Require CREATE EXTERNAL TABLE to specify LOCATION Key: SPARK-15257 URL: https://issues.apache.org/jira/browse/SPARK-15257 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14857) Table/Database Name Validation in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14857: -- Assignee: Xiao Li > Table/Database Name Validation in SessionCatalog >

[jira] [Resolved] (SPARK-14603) SessionCatalog needs to check if a metadata operation is valid

[ https://issues.apache.org/jira/browse/SPARK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14603. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > SessionCatalog needs to

[jira] [Updated] (SPARK-14684) Verification of partition specs in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-14684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14684: -- Assignee: Xiao Li > Verification of partition specs in SessionCatalog >

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Component/s: SQL > Use SparkSession instead of SQLContext in testsuites >

[jira] [Updated] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15037: -- Component/s: Tests > Use SparkSession instead of SQLContext in testsuites >

[jira] [Resolved] (SPARK-15037) Use SparkSession instead of SQLContext in testsuites

[ https://issues.apache.org/jira/browse/SPARK-15037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15037. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Use SparkSession

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Component/s: Spark Shell > No way to disable Hive support in REPL >

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Assignee: (was: Andrew Or) > No way to disable Hive support in REPL >

[jira] [Created] (SPARK-15236) No way to disable Hive support in REPL

Andrew Or created SPARK-15236: - Summary: No way to disable Hive support in REPL Key: SPARK-15236 URL: https://issues.apache.org/jira/browse/SPARK-15236 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15234: - Assignee: Andrew Or > spark.catalog.listDatabases.show() is not formatted correctly >

[jira] [Created] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

Andrew Or created SPARK-15234: - Summary: spark.catalog.listDatabases.show() is not formatted correctly Key: SPARK-15234 URL: https://issues.apache.org/jira/browse/SPARK-15234 Project: Spark

[jira] [Updated] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15234: -- Description: {code} scala> spark.catalog.listDatabases.show()

[jira] [Commented] (SPARK-14021) Support custom context derived from HiveContext for SparkSQLEnv

[ https://issues.apache.org/jira/browse/SPARK-14021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276820#comment-15276820 ] Andrew Or commented on SPARK-14021: --- Closing as Won't Fix because the issue is outdated after

[jira] [Resolved] (SPARK-14021) Support custom context derived from HiveContext for SparkSQLEnv

[ https://issues.apache.org/jira/browse/SPARK-14021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14021. --- Resolution: Won't Fix > Support custom context derived from HiveContext for SparkSQLEnv >

[jira] [Resolved] (SPARK-10653) Remove unnecessary things from SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10653. --- Resolution: Fixed Assignee: Alex Bozarth Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15210) Add missing @DeveloperApi annotation in sql.types

[ https://issues.apache.org/jira/browse/SPARK-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15210. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Add missing

[jira] [Resolved] (SPARK-15166) Move hive-specific conf setting from SparkSession

[ https://issues.apache.org/jira/browse/SPARK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15166. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move hive-specific conf setting from SparkSession >

[jira] [Updated] (SPARK-15210) Add missing @DeveloperApi annotation in sql.types

[ https://issues.apache.org/jira/browse/SPARK-15210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15210: -- Assignee: zhengruifeng > Add missing @DeveloperApi annotation in sql.types >

[jira] [Resolved] (SPARK-15220) Add hyperlink to "running application" and "completed application"

[ https://issues.apache.org/jira/browse/SPARK-15220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15220. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Add hyperlink to

[jira] [Resolved] (SPARK-15067) YARN executors are launched with fixed perm gen size

[ https://issues.apache.org/jira/browse/SPARK-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15067. --- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.0.0 Target

[jira] [Resolved] (SPARK-15225) Replace SQLContext with SparkSession in Encoder documentation

[ https://issues.apache.org/jira/browse/SPARK-15225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15225. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Assignee: Philipp Hoffmann > spark.executor.logs.rolling.maxSize wrongly referred to as >

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Target Version/s: 1.6.2, 2.0.0 (was: 2.0.0) > spark.executor.logs.rolling.maxSize wrongly referred to

[jira] [Updated] (SPARK-15223) spark.executor.logs.rolling.maxSize wrongly referred to as spark.executor.logs.rolling.size.maxBytes

[ https://issues.apache.org/jira/browse/SPARK-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15223: -- Fix Version/s: 1.6.2 > spark.executor.logs.rolling.maxSize wrongly referred to as >

<    1   2   3   4   5   6   7   8   9   10   >