[jira] [Assigned] (SPARK-27983) defer the initialization of kafka producer until used

2019-06-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27983: Assignee: (was: Apache Spark) > defer the initialization of kafka producer until used

[jira] [Assigned] (SPARK-27983) defer the initialization of kafka producer until used

2019-06-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27983: Assignee: Apache Spark > defer the initialization of kafka producer until used >

[jira] [Created] (SPARK-27983) defer the initialization of kafka producer until used

2019-06-08 Thread wenxuanguan (JIRA)
wenxuanguan created SPARK-27983: --- Summary: defer the initialization of kafka producer until used Key: SPARK-27983 URL: https://issues.apache.org/jira/browse/SPARK-27983 Project: Spark Issue Typ

[jira] [Commented] (SPARK-27981) Remove `Illegal reflective access` warning for `java.nio.Bits.unaligned()`

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859355#comment-16859355 ] Dongjoon Hyun commented on SPARK-27981: --- cc [~dbtsai] > Remove `Illegal reflectiv

[jira] [Updated] (SPARK-27981) Remove `Illegal reflective access` warning for `java.nio.Bits.unaligned()`

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27981: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-24417 > Remove `Illegal reflect

[jira] [Comment Edited] (SPARK-27881) Support CAST (... FORMAT ) expression

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859346#comment-16859346 ] Dongjoon Hyun edited comment on SPARK-27881 at 6/9/19 2:50 AM: ---

[jira] [Reopened] (SPARK-27881) Support CAST (... FORMAT ) expression

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-27881: --- > Support CAST (... FORMAT ) expression > -- > >

[jira] [Resolved] (SPARK-27881) Support CAST (... FORMAT ) expression

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27881. --- Resolution: Later The PR is valid but we decided to hold it on until the other mainstream DB

[jira] [Assigned] (SPARK-27971) MapPartitionsInRWithArrowExec.evaluate shouldn't eagerly read the first batch

2019-06-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27971: Assignee: Hyukjin Kwon > MapPartitionsInRWithArrowExec.evaluate shouldn't eagerly read th

[jira] [Resolved] (SPARK-27971) MapPartitionsInRWithArrowExec.evaluate shouldn't eagerly read the first batch

2019-06-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27971. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24818 [https://gi

[jira] [Resolved] (SPARK-27981) Remove `Illegal reflective access` warning for `java.nio.Bits.unaligned()`

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27981. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is resol

[jira] [Updated] (SPARK-27973) Streaming sample DirectKafkaWordCount should mention GroupId in usage

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27973: -- Fix Version/s: 2.4.4 > Streaming sample DirectKafkaWordCount should mention GroupId in usage >

[jira] [Resolved] (SPARK-27798) from_avro can modify variables in other rows in local mode

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27798. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 3.0.0

[jira] [Resolved] (SPARK-27961) DataSourceV2Relation should not have refresh method

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27961. --- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0 This is reso

[jira] [Comment Edited] (SPARK-27961) DataSourceV2Relation should not have refresh method

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859285#comment-16859285 ] Dongjoon Hyun edited comment on SPARK-27961 at 6/8/19 6:00 PM: ---

[jira] [Resolved] (SPARK-27979) Remove deprecated `--force` option in `build/mvn` and `run-tests.py`

2019-06-08 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27979. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is resol

[jira] [Updated] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the drop of the same column fail to filter the all the records

2019-06-08 Thread Karan Hebbar K S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Hebbar K S updated SPARK-27982: - Issue Type: Question (was: Bug) > In spark 2.2.1 filter on a particular column follwed

[jira] [Updated] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the drop of the same column fail to filter the all the records

2019-06-08 Thread Karan Hebbar K S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Hebbar K S updated SPARK-27982: - Summary: In spark 2.2.1 filter on a particular column follwed by the drop of the same co

[jira] [Updated] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the same column fail to filter the all the records

2019-06-08 Thread Karan Hebbar K S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Hebbar K S updated SPARK-27982: - Description: The issue here follows the design of the spark, If the filer is applied on

[jira] [Created] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the same column fail to filter the all the records

2019-06-08 Thread Karan Hebbar K S (JIRA)
Karan Hebbar K S created SPARK-27982: Summary: In spark 2.2.1 filter on a particular column follwed by the same column fail to filter the all the records Key: SPARK-27982 URL: https://issues.apache.org/jira/br