[jira] [Commented] (SPARK-25995) sparkR should ensure user args are after the argument used for the port

2018-11-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682762#comment-16682762 ] Felix Cheung commented on SPARK-25995: -- sparkR is just taking the whole string as-is

[jira] [Assigned] (SPARK-26004) InMemoryTable support StartsWith predicate push down

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26004: Assignee: (was: Apache Spark) > InMemoryTable support StartsWith predicate push down

[jira] [Commented] (SPARK-26004) InMemoryTable support StartsWith predicate push down

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682729#comment-16682729 ] Apache Spark commented on SPARK-26004: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26004) InMemoryTable support StartsWith predicate push down

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26004: Assignee: Apache Spark > InMemoryTable support StartsWith predicate push down >

[jira] [Updated] (SPARK-26004) InMemoryTable support StartsWith predicate push down

2018-11-10 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-26004: Summary: InMemoryTable support StartsWith predicate push down (was: InMemoryTable support

[jira] [Created] (SPARK-26004) InMemoryTable support StartsWith predicate

2018-11-10 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-26004: --- Summary: InMemoryTable support StartsWith predicate Key: SPARK-26004 URL: https://issues.apache.org/jira/browse/SPARK-26004 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17403) Fatal Error: Scan cached strings

2018-11-10 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682591#comment-16682591 ] Eyal Farago commented on SPARK-17403: - [~paul_lysak], [~hvanhovell], please notice the exception

[jira] [Resolved] (SPARK-25895) No test to compare Zstd and Lz4 Compression Algorithm

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25895. --- Resolution: Won't Fix > No test to compare Zstd and Lz4 Compression Algorithm >

[jira] [Resolved] (SPARK-25839) Implement use of KryoPool in KryoSerializer

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25839. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22855

[jira] [Assigned] (SPARK-25839) Implement use of KryoPool in KryoSerializer

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-25839: - Assignee: Patrick Brown > Implement use of KryoPool in KryoSerializer >

[jira] [Updated] (SPARK-17403) Fatal Error: Scan cached strings

2018-11-10 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eyal Farago updated SPARK-17403: Description: The process creates views from JDBC (SQL server) source and combines them to create

[jira] [Resolved] (SPARK-25818) WorkDirCleanup should only remove the directory at the beginning of the app

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25818. --- Resolution: Won't Fix > WorkDirCleanup should only remove the directory at the beginning of the app

[jira] [Resolved] (SPARK-21785) Support create table from a file schema

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21785. --- Resolution: Won't Fix > Support create table from a file schema >

[jira] [Resolved] (SPARK-20771) Usability issues with weekofyear()

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20771. --- Resolution: Won't Fix I'm closing for reasons given on the PR, but reopen if you disagree Xiangrui

[jira] [Resolved] (SPARK-21645) SparkSQL Left outer join get the error result when use phoenix spark plugin

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21645. --- Resolution: Duplicate > SparkSQL Left outer join get the error result when use phoenix spark plugin

[jira] [Resolved] (SPARK-24803) add support for numeric

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24803. --- Resolution: Won't Fix > add support for numeric > --- > > Key:

[jira] [Commented] (SPARK-19714) Clarify Bucketizer handling of invalid input

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682495#comment-16682495 ] Apache Spark commented on SPARK-19714: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19714) Clarify Bucketizer handling of invalid input

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19714: - Assignee: Wojciech Szymanski Priority: Minor (was: Major) Issue Type: Improvement

[jira] [Assigned] (SPARK-26003) Improve performance in SQLAppStatusListener

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26003: Assignee: Apache Spark > Improve performance in SQLAppStatusListener >

[jira] [Commented] (SPARK-26003) Improve performance in SQLAppStatusListener

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682487#comment-16682487 ] Apache Spark commented on SPARK-26003: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26003) Improve performance in SQLAppStatusListener

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26003: Assignee: (was: Apache Spark) > Improve performance in SQLAppStatusListener >

[jira] [Created] (SPARK-26003) Improve performance in SQLAppStatusListener

2018-11-10 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-26003: --- Summary: Improve performance in SQLAppStatusListener Key: SPARK-26003 URL: https://issues.apache.org/jira/browse/SPARK-26003 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-25984) Remove deprecated .newInstance(), primitive wrapper class constructor calls

2018-11-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-25984. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22988

[jira] [Commented] (SPARK-25983) spark-sql-kafka-0-10 no longer works with Kafka 0.10.0

2018-11-10 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682464#comment-16682464 ] Cody Koeninger commented on SPARK-25983: Looks like we need an equivalent warning in

[jira] [Commented] (SPARK-25983) spark-sql-kafka-0-10 no longer works with Kafka 0.10.0

2018-11-10 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682461#comment-16682461 ] Cody Koeninger commented on SPARK-25983: Documentation already explicitly says not to link to

[jira] [Assigned] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26002: Assignee: Apache Spark > SQL date operators calculates with incorrect dayOfYears for

[jira] [Commented] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682459#comment-16682459 ] Apache Spark commented on SPARK-26002: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26002: Assignee: (was: Apache Spark) > SQL date operators calculates with incorrect

[jira] [Commented] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682404#comment-16682404 ] Attila Zsolt Piros commented on SPARK-26002: I am already working on a fix. > SQL date

[jira] [Created] (SPARK-26002) SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01

2018-11-10 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-26002: -- Summary: SQL date operators calculates with incorrect dayOfYears for dates before 1500-03-01 Key: SPARK-26002 URL: https://issues.apache.org/jira/browse/SPARK-26002

[jira] [Commented] (SPARK-20319) Already quoted identifiers are getting wrapped with additional quotes

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682348#comment-16682348 ] Apache Spark commented on SPARK-20319: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-20319) Already quoted identifiers are getting wrapped with additional quotes

2018-11-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682346#comment-16682346 ] Apache Spark commented on SPARK-20319: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-11-10 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-25332: Priority: Major (was: Critical) > Instead of broadcast hash join ,Sort merge join has selected

[jira] [Commented] (SPARK-25332) Instead of broadcast hash join ,Sort merge join has selected when restart spark-shell/spark-JDBC for hive provider

2018-11-10 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682329#comment-16682329 ] Marco Gaido commented on SPARK-25332: - [~Bjangir] please don't use "Critical" and "Blocker": they

[jira] [Commented] (SPARK-25992) Accumulators giving KeyError in pyspark

2018-11-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682325#comment-16682325 ] Hyukjin Kwon commented on SPARK-25992: -- Can you share your codes to reproduce? Also please take a

[jira] [Commented] (SPARK-25995) sparkR should ensure user args are after the argument used for the port

2018-11-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682322#comment-16682322 ] Hyukjin Kwon commented on SPARK-25995: -- Sounds related with SPARK-18340 as well. > sparkR should

[jira] [Resolved] (SPARK-26000) Missing block when reading HDFS Data from Cloudera Manager

2018-11-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26000. -- Resolution: Invalid > Missing block when reading HDFS Data from Cloudera Manager >

[jira] [Resolved] (SPARK-25996) Agregaciones no retornan los valores correctos con rows con timestamps iguales

2018-11-10 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-25996. - Resolution: Not A Problem [~igomezraggio] check the ts of the first row. it is {{00:00:01}}, so

[jira] [Commented] (SPARK-23814) Couldn't read file with colon in name and new line character in one of the field.

2018-11-10 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682299#comment-16682299 ] Hyukjin Kwon commented on SPARK-23814: -- Please file a new JIRA with reproducible steps. > Couldn't

[jira] [Commented] (SPARK-16647) sparksql1.6.2 on yarn with hive metastore1.0.0 thows "alter_table_with_cascade" exception

2018-11-10 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682286#comment-16682286 ] Yuming Wang commented on SPARK-16647: - Have you set {{spark.sql.hive.metastore.version}}?