[jira] [Assigned] (SPARK-23728) ML test with expected exceptions testing streaming fails on 2.3

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23728: Assignee: Apache Spark > ML test with expected exceptions testing streaming fails on 2.3

[jira] [Assigned] (SPARK-23728) ML test with expected exceptions testing streaming fails on 2.3

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23728: Assignee: (was: Apache Spark) > ML test with expected exceptions testing streaming

[jira] [Commented] (SPARK-23728) ML test with expected exceptions testing streaming fails on 2.3

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403852#comment-16403852 ] Apache Spark commented on SPARK-23728: -- User 'attilapiros' has created a pull request for this

[jira] [Updated] (SPARK-23728) ML test with expected exceptions testing streaming fails on 2.3

2018-03-17 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-23728: --- Summary: ML test with expected exceptions testing streaming fails on 2.3 (was: ML

[jira] [Created] (SPARK-23728) ML test with expected exceptions via streaming fails on 2.3

2018-03-17 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-23728: -- Summary: ML test with expected exceptions via streaming fails on 2.3 Key: SPARK-23728 URL: https://issues.apache.org/jira/browse/SPARK-23728 Project:

[jira] [Commented] (SPARK-23728) ML test with expected exceptions via streaming fails on 2.3

2018-03-17 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403850#comment-16403850 ] Attila Zsolt Piros commented on SPARK-23728: I am soon creating a PR. > ML test with

[jira] [Assigned] (SPARK-23727) Support DATE predict push down in parquet

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23727: Assignee: (was: Apache Spark) > Support DATE predict push down in parquet >

[jira] [Assigned] (SPARK-23727) Support DATE predict push down in parquet

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23727: Assignee: Apache Spark > Support DATE predict push down in parquet >

[jira] [Commented] (SPARK-23727) Support DATE predict push down in parquet

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403846#comment-16403846 ] Apache Spark commented on SPARK-23727: -- User 'yucai' has created a pull request for this issue:

[jira] [Created] (SPARK-23727) Support DATE predict push down in parquet

2018-03-17 Thread yucai (JIRA)
yucai created SPARK-23727: - Summary: Support DATE predict push down in parquet Key: SPARK-23727 URL: https://issues.apache.org/jira/browse/SPARK-23727 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23714) Add metrics for cached KafkaConsumer

2018-03-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403792#comment-16403792 ] Ted Yu commented on SPARK-23714: Ryan reminded me of the possibility of using the existing metrics

[jira] [Updated] (SPARK-23623) Avoid concurrent use of cached KafkaConsumer in CachedKafkaConsumer (kafka-0-10-sql)

2018-03-17 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23623: - Fix Version/s: 2.3.1 > Avoid concurrent use of cached KafkaConsumer in CachedKafkaConsumer >

[jira] [Resolved] (SPARK-23726) standalone quickstart fails loading files with Hadoop's java.net.ConnectException: Connection refused

2018-03-17 Thread Tim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim resolved SPARK-23726. - Resolution: Invalid > standalone quickstart fails loading files with Hadoop's > java.net.ConnectException:

[jira] [Commented] (SPARK-23726) standalone quickstart fails loading files with Hadoop's java.net.ConnectException: Connection refused

2018-03-17 Thread Tim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403782#comment-16403782 ] Tim commented on SPARK-23726: - error is due to locally defined HADOOP_HOME and HADOOP_CONF_DIR env vars. Once

[jira] [Created] (SPARK-23726) standalone quickstart fails loading files with Hadoop's java.net.ConnectException: Connection refused

2018-03-17 Thread Tim (JIRA)
Tim created SPARK-23726: --- Summary: standalone quickstart fails loading files with Hadoop's java.net.ConnectException: Connection refused Key: SPARK-23726 URL: https://issues.apache.org/jira/browse/SPARK-23726

[jira] [Updated] (SPARK-23560) Group by on struct field can add extra shuffle

2018-03-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-23560: -- Summary: Group by on struct field can add extra shuffle (was: A joinWith followed by groupBy

[jira] [Updated] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-03-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-23715: -- Description: This produces the expected answer: {noformat}

[jira] [Updated] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-03-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-23715: -- Description: This produces the expected answer: {noformat}

[jira] [Updated] (SPARK-23715) from_utc_timestamp returns incorrect results for some UTC date/time values

2018-03-17 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-23715: -- Description: This produces the expected answer: {noformat}

[jira] [Assigned] (SPARK-23713) Clean-up UnsafeWriter classes

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23713: Assignee: (was: Apache Spark) > Clean-up UnsafeWriter classes >

[jira] [Assigned] (SPARK-23713) Clean-up UnsafeWriter classes

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23713: Assignee: Apache Spark > Clean-up UnsafeWriter classes > - >

[jira] [Commented] (SPARK-23713) Clean-up UnsafeWriter classes

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403719#comment-16403719 ] Apache Spark commented on SPARK-23713: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-19767) API Doc pages for Streaming with Kafka 0.10 not current

2018-03-17 Thread Nick Afshartous (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403702#comment-16403702 ] Nick Afshartous commented on SPARK-19767: - Sounds good [~c...@koeninger.org].  I'll close the

[jira] [Commented] (SPARK-1485) Implement AllReduce

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403463#comment-16403463 ] Apache Spark commented on SPARK-1485: - User 'mengxr' has created a pull request for this issue:

[jira] [Created] (SPARK-23725) Improve Hadoop's LineReader to support charsets different from UTF-8

2018-03-17 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-23725: -- Summary: Improve Hadoop's LineReader to support charsets different from UTF-8 Key: SPARK-23725 URL: https://issues.apache.org/jira/browse/SPARK-23725 Project: Spark

[jira] [Created] (SPARK-23724) Custom record separator for jsons in charsets different from UTF-8

2018-03-17 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-23724: -- Summary: Custom record separator for jsons in charsets different from UTF-8 Key: SPARK-23724 URL: https://issues.apache.org/jira/browse/SPARK-23724 Project: Spark

[jira] [Assigned] (SPARK-23723) New charset option for json datasource

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23723: Assignee: Apache Spark > New charset option for json datasource >

[jira] [Commented] (SPARK-23723) New charset option for json datasource

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403448#comment-16403448 ] Apache Spark commented on SPARK-23723: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23723) New charset option for json datasource

2018-03-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23723: Assignee: (was: Apache Spark) > New charset option for json datasource >

[jira] [Created] (SPARK-23723) New charset option for json datasource

2018-03-17 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-23723: -- Summary: New charset option for json datasource Key: SPARK-23723 URL: https://issues.apache.org/jira/browse/SPARK-23723 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-23710) Upgrade Hive to 2.3.2

2018-03-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Description: h1. Mainly changes * Maven dependency: hive.version from {{1.2.1.spark2}} to