[jira] [Created] (SPARK-22505) toDF() / createDataFrame() type inference doesn't work as expected

2017-11-12 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SPARK-22505: - Summary: toDF() / createDataFrame() type inference doesn't work as expected Key: SPARK-22505 URL: https://issues.apache.org/jira/browse/SPARK-22505

[jira] [Commented] (SPARK-22504) Optimization in overwrite table in case of failure

2017-11-12 Thread xuchuanyin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249182#comment-16249182 ] xuchuanyin commented on SPARK-22504: Does anyone has any suggestion? I'm going to work on this using

[jira] [Created] (SPARK-22504) Optimization in overwrite table in case of failure

2017-11-12 Thread xuchuanyin (JIRA)
xuchuanyin created SPARK-22504: -- Summary: Optimization in overwrite table in case of failure Key: SPARK-22504 URL: https://issues.apache.org/jira/browse/SPARK-22504 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22503) Using current processing time to generate windows in streaming processing

2017-11-12 Thread wangsan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangsan updated SPARK-22503: Affects Version/s: 2.2.0 > Using current processing time to generate windows in streaming processing >

[jira] [Created] (SPARK-22503) Using current processing time to generate windows in streaming processing

2017-11-12 Thread wangsan (JIRA)
wangsan created SPARK-22503: --- Summary: Using current processing time to generate windows in streaming processing Key: SPARK-22503 URL: https://issues.apache.org/jira/browse/SPARK-22503 Project: Spark

[jira] [Commented] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249150#comment-16249150 ] Apache Spark commented on SPARK-22442: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22442: - Target Version/s: 2.2.1, 2.3.0 > Schema generated by Product Encoder doesn't match case class

[jira] [Commented] (SPARK-22427) StackOverFlowError when using FPGrowth

2017-11-12 Thread lyt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249097#comment-16249097 ] lyt commented on SPARK-22427: - -Xss512m didn’t work 发自我的iPhone -- Original

[jira] [Resolved] (SPARK-20791) Use Apache Arrow to Improve Spark createDataFrame from Pandas.DataFrame

2017-11-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20791. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19459

[jira] [Assigned] (SPARK-20791) Use Apache Arrow to Improve Spark createDataFrame from Pandas.DataFrame

2017-11-12 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-20791: Assignee: Bryan Cutler > Use Apache Arrow to Improve Spark createDataFrame from

[jira] [Updated] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-22442: Fix Version/s: 2.2.1 > Schema generated by Product Encoder doesn't match case class field

[jira] [Commented] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249086#comment-16249086 ] Liang-Chi Hsieh commented on SPARK-22442: - cc [~felixcheung] This will be backported to 2.2. >

[jira] [Commented] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249058#comment-16249058 ] Apache Spark commented on SPARK-22442: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249045#comment-16249045 ] Apache Spark commented on SPARK-22501: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22501: Assignee: Apache Spark > 64KB JVM bytecode limit problem with in >

[jira] [Assigned] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22501: Assignee: (was: Apache Spark) > 64KB JVM bytecode limit problem with in >

[jira] [Commented] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249043#comment-16249043 ] Liang-Chi Hsieh commented on SPARK-22442: - I think it is easy. Let me prepare a backport PR for

[jira] [Updated] (SPARK-22202) Release tgz content differences for python and R

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22202: - Affects Version/s: (was: 2.2.1) 2.2.0 > Release tgz content

[jira] [Updated] (SPARK-22054) Allow release managers to inject their keys

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22054: - Affects Version/s: (was: 2.2.1) > Allow release managers to inject their keys >

[jira] [Updated] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20536: - Affects Version/s: (was: 2.3.0) 2.2.0 > Extend ColumnName to create

[jira] [Updated] (SPARK-20536) Extend ColumnName to create StructFields with explicit nullable

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20536: - Affects Version/s: (was: 2.2.1) 2.3.0 > Extend ColumnName to create

[jira] [Updated] (SPARK-21427) Describe mapGroupsWithState and flatMapGroupsWithState for stateful aggregation in Structured Streaming

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21427: - Affects Version/s: (was: 2.2.1) 2.2.0 > Describe mapGroupsWithState

[jira] [Updated] (SPARK-22402) Allow fetcher URIs to be downloaded to specific locations relative to Mesos Sandbox

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22402: - Affects Version/s: (was: 2.2.1) 2.3.0 2.2.2 >

[jira] [Updated] (SPARK-22055) Port release scripts

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22055: - Affects Version/s: (was: 2.2.1) > Port release scripts > > >

[jira] [Commented] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249029#comment-16249029 ] Kazuaki Ishizaki commented on SPARK-22501: -- [~mgaido] I am working on this. > 64KB JVM bytecode

[jira] [Commented] (SPARK-22427) StackOverFlowError when using FPGrowth

2017-11-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249017#comment-16249017 ] yuhao yang commented on SPARK-22427: Hi [~lyt] does increasing stack size resolve your issue? If not

[jira] [Commented] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249012#comment-16249012 ] Wenchen Fan commented on SPARK-22442: - I don't have a strong preference. [~viirya] how hard it is to

[jira] [Updated] (SPARK-22411) Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic allocation is enabled

2017-11-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated SPARK-22411: -- Description: The heuristic to calculate the maxSplitSize in DataSourceScanExec

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249005#comment-16249005 ] Felix Cheung commented on SPARK-22042: -- since this is in 2.1.0 and 2.2.0, technically this isn't a

[jira] [Resolved] (SPARK-21693) AppVeyor tests reach the time limit, 1.5 hours, sometimes in SparkR tests

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21693. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249002#comment-16249002 ] Apache Spark commented on SPARK-19606: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-22442) Schema generated by Product Encoder doesn't match case class field name when using non-standard characters

2017-11-12 Thread Mikel San Vicente (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248999#comment-16248999 ] Mikel San Vicente commented on SPARK-22442: --- are you planning to make a patch to version 2.2.x

[jira] [Updated] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

2017-11-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22464: Fix Version/s: 2.2.1 > <=> is not supported by Hive metastore partition predicate pushdown >

[jira] [Updated] (SPARK-22488) The view resolution in the SparkSession internal table() API

2017-11-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22488: Fix Version/s: 2.2.1 > The view resolution in the SparkSession internal table() API >

[jira] [Assigned] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

2017-11-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21720: --- Assignee: Kazuaki Ishizaki > Filter predicate with many conditions throw stackoverflow

[jira] [Resolved] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

2017-11-12 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21720. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Created] (SPARK-22502) OnlineLDAOptimizer variationalTopicInference might be able to handle empty documents

2017-11-12 Thread yuhao yang (JIRA)
yuhao yang created SPARK-22502: -- Summary: OnlineLDAOptimizer variationalTopicInference might be able to handle empty documents Key: SPARK-22502 URL: https://issues.apache.org/jira/browse/SPARK-22502

[jira] [Commented] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-12 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248983#comment-16248983 ] Marco Gaido commented on SPARK-22501: - [~kiszk] are you working on this or can I take it? > 64KB JVM

[jira] [Created] (SPARK-22501) 64KB JVM bytecode limit problem with in

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22501: Summary: 64KB JVM bytecode limit problem with in Key: SPARK-22501 URL: https://issues.apache.org/jira/browse/SPARK-22501 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14220) Build and test Spark against Scala 2.12

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14220: Assignee: Apache Spark > Build and test Spark against Scala 2.12 >

[jira] [Assigned] (SPARK-14220) Build and test Spark against Scala 2.12

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14220: Assignee: (was: Apache Spark) > Build and test Spark against Scala 2.12 >

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248975#comment-16248975 ] Apache Spark commented on SPARK-14220: -- User 'EmergentOrder' has created a pull request for this

[jira] [Resolved] (SPARK-19606) Support constraints in spark-dispatcher

2017-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19606. -- Resolution: Fixed Assignee: paul mackles Fix Version/s: 2.3.0

[jira] [Assigned] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22500: Assignee: Apache Spark > 64KB JVM bytecode limit problem with cast >

[jira] [Commented] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248961#comment-16248961 ] Apache Spark commented on SPARK-22500: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22500: Assignee: (was: Apache Spark) > 64KB JVM bytecode limit problem with cast >

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22499: - Description: Both {{least}} and {{greatest}} can throw an exception due to the 64KB JVM

[jira] [Created] (SPARK-22500) 64KB JVM bytecode limit problem with cast

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22500: Summary: 64KB JVM bytecode limit problem with cast Key: SPARK-22500 URL: https://issues.apache.org/jira/browse/SPARK-22500 Project: Spark Issue

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat and concat_ws

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22498: - Description: Both {{concat}} and {{concat_ws}} can throw an exception due to the 64KB

[jira] [Commented] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248933#comment-16248933 ] Apache Spark commented on SPARK-22499: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22499: Assignee: Apache Spark > 64KB JVM bytecode limit problem with least and greatest >

[jira] [Assigned] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22499: Assignee: (was: Apache Spark) > 64KB JVM bytecode limit problem with least and

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22499: - Description: Both {{least}} and {{greatest}} can thow an exception due to the 64KB JVM

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22499: - Summary: 64KB JVM bytecode limit problem with least and greatest (was: 64KB JVM

[jira] [Created] (SPARK-22499) 64KB JVM bytecode limit problem with leastest and greatest

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22499: Summary: 64KB JVM bytecode limit problem with leastest and greatest Key: SPARK-22499 URL: https://issues.apache.org/jira/browse/SPARK-22499 Project: Spark

[jira] [Commented] (SPARK-15685) StackOverflowError (VirtualMachineError) or NoClassDefFoundError (LinkageError) should not System.exit() in local mode

2017-11-12 Thread Brett Randall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248929#comment-16248929 ] Brett Randall commented on SPARK-15685: --- SPARK-16304 fixes part of this in commit

[jira] [Resolved] (SPARK-22486) Support synchronous offset commits for Kafka

2017-11-12 Thread Jeremy Beard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Beard resolved SPARK-22486. -- Resolution: Won't Fix [~c...@koeninger.org] Ok yes I see your point. Closing as won't fix. >

[jira] [Assigned] (SPARK-22498) 64KB JVM bytecode limit problem with concat and concat_ws

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22498: Assignee: (was: Apache Spark) > 64KB JVM bytecode limit problem with concat and

[jira] [Commented] (SPARK-22498) 64KB JVM bytecode limit problem with concat and concat_ws

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248917#comment-16248917 ] Apache Spark commented on SPARK-22498: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22498) 64KB JVM bytecode limit problem with concat and concat_ws

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22498: Assignee: Apache Spark > 64KB JVM bytecode limit problem with concat and concat_ws >

[jira] [Created] (SPARK-22498) 64KB JVM bytecode limit problem with concat and concat_ws

2017-11-12 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22498: Summary: 64KB JVM bytecode limit problem with concat and concat_ws Key: SPARK-22498 URL: https://issues.apache.org/jira/browse/SPARK-22498 Project: Spark

[jira] [Updated] (SPARK-22497) Reuse project

2017-11-12 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22497: Description: The below SQL will scan {{table1}} twice. We can reuse the first Project. {code:sql}

[jira] [Commented] (SPARK-22497) Reuse project

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248910#comment-16248910 ] Apache Spark commented on SPARK-22497: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22497) Reuse project

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22497: Assignee: (was: Apache Spark) > Reuse project > - > >

[jira] [Assigned] (SPARK-22497) Reuse project

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22497: Assignee: Apache Spark > Reuse project > - > > Key:

[jira] [Created] (SPARK-22497) Reuse project

2017-11-12 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-22497: --- Summary: Reuse project Key: SPARK-22497 URL: https://issues.apache.org/jira/browse/SPARK-22497 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Commented] (SPARK-22486) Support synchronous offset commits for Kafka

2017-11-12 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248891#comment-16248891 ] Cody Koeninger commented on SPARK-22486: Can you identify a clear use case for this, given that

[jira] [Comment Edited] (SPARK-22481) CatalogImpl.refreshTable is slow

2017-11-12 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248837#comment-16248837 ] Ran Haim edited comment on SPARK-22481 at 11/12/17 12:31 PM: - Hi, I created

[jira] [Commented] (SPARK-22481) CatalogImpl.refreshTable is slow

2017-11-12 Thread Ran Haim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248837#comment-16248837 ] Ran Haim commented on SPARK-22481: -- Hi, I create this simple test that will show how slow refresh table

[jira] [Assigned] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22490: Assignee: (was: Apache Spark) > PySpark doc has misleading string for

[jira] [Commented] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248830#comment-16248830 ] Apache Spark commented on SPARK-22490: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22490: Assignee: Apache Spark > PySpark doc has misleading string for SparkSession.builder >

[jira] [Commented] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

2017-11-12 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248818#comment-16248818 ] Dongjoon Hyun commented on SPARK-22490: --- Oh, this doc seems to come from SPARK-15084. I'll make a