Ruslan Dautkhanov created SPARK-22505:
-
Summary: toDF() / createDataFrame() type inference doesn't work as
expected
Key: SPARK-22505
URL: https://issues.apache.org/jira/browse/SPARK-22505
[
https://issues.apache.org/jira/browse/SPARK-22504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249182#comment-16249182
]
xuchuanyin commented on SPARK-22504:
Does anyone has any suggestion? I'm going to work on this using
xuchuanyin created SPARK-22504:
--
Summary: Optimization in overwrite table in case of failure
Key: SPARK-22504
URL: https://issues.apache.org/jira/browse/SPARK-22504
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangsan updated SPARK-22503:
Affects Version/s: 2.2.0
> Using current processing time to generate windows in streaming processing
>
wangsan created SPARK-22503:
---
Summary: Using current processing time to generate windows in
streaming processing
Key: SPARK-22503
URL: https://issues.apache.org/jira/browse/SPARK-22503
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249150#comment-16249150
]
Apache Spark commented on SPARK-22442:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22442:
-
Target Version/s: 2.2.1, 2.3.0
> Schema generated by Product Encoder doesn't match case class
[
https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249097#comment-16249097
]
lyt commented on SPARK-22427:
-
-Xss512m didn’t work
发自我的iPhone
-- Original
[
https://issues.apache.org/jira/browse/SPARK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-20791.
--
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19459
[
https://issues.apache.org/jira/browse/SPARK-20791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-20791:
Assignee: Bryan Cutler
> Use Apache Arrow to Improve Spark createDataFrame from
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liang-Chi Hsieh updated SPARK-22442:
Fix Version/s: 2.2.1
> Schema generated by Product Encoder doesn't match case class field
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249086#comment-16249086
]
Liang-Chi Hsieh commented on SPARK-22442:
-
cc [~felixcheung] This will be backported to 2.2.
>
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249058#comment-16249058
]
Apache Spark commented on SPARK-22442:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249045#comment-16249045
]
Apache Spark commented on SPARK-22501:
--
User 'kiszk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22501:
Assignee: Apache Spark
> 64KB JVM bytecode limit problem with in
>
[
https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22501:
Assignee: (was: Apache Spark)
> 64KB JVM bytecode limit problem with in
>
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249043#comment-16249043
]
Liang-Chi Hsieh commented on SPARK-22442:
-
I think it is easy. Let me prepare a backport PR for
[
https://issues.apache.org/jira/browse/SPARK-22202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22202:
-
Affects Version/s: (was: 2.2.1)
2.2.0
> Release tgz content
[
https://issues.apache.org/jira/browse/SPARK-22054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22054:
-
Affects Version/s: (was: 2.2.1)
> Allow release managers to inject their keys
>
[
https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-20536:
-
Affects Version/s: (was: 2.3.0)
2.2.0
> Extend ColumnName to create
[
https://issues.apache.org/jira/browse/SPARK-20536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-20536:
-
Affects Version/s: (was: 2.2.1)
2.3.0
> Extend ColumnName to create
[
https://issues.apache.org/jira/browse/SPARK-21427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-21427:
-
Affects Version/s: (was: 2.2.1)
2.2.0
> Describe mapGroupsWithState
[
https://issues.apache.org/jira/browse/SPARK-22402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22402:
-
Affects Version/s: (was: 2.2.1)
2.3.0
2.2.2
>
[
https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-22055:
-
Affects Version/s: (was: 2.2.1)
> Port release scripts
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249029#comment-16249029
]
Kazuaki Ishizaki commented on SPARK-22501:
--
[~mgaido] I am working on this.
> 64KB JVM bytecode
[
https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249017#comment-16249017
]
yuhao yang commented on SPARK-22427:
Hi [~lyt] does increasing stack size resolve your issue? If not
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249012#comment-16249012
]
Wenchen Fan commented on SPARK-22442:
-
I don't have a strong preference. [~viirya] how hard it is to
[
https://issues.apache.org/jira/browse/SPARK-22411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinitha Reddy Gankidi updated SPARK-22411:
--
Description:
The heuristic to calculate the maxSplitSize in DataSourceScanExec
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249005#comment-16249005
]
Felix Cheung commented on SPARK-22042:
--
since this is in 2.1.0 and 2.2.0, technically this isn't a
[
https://issues.apache.org/jira/browse/SPARK-21693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-21693.
--
Resolution: Fixed
Assignee: Hyukjin Kwon
Fix Version/s: 2.3.0
[
https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249002#comment-16249002
]
Apache Spark commented on SPARK-19606:
--
User 'felixcheung' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248999#comment-16248999
]
Mikel San Vicente commented on SPARK-22442:
---
are you planning to make a patch to version 2.2.x
[
https://issues.apache.org/jira/browse/SPARK-22464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22464:
Fix Version/s: 2.2.1
> <=> is not supported by Hive metastore partition predicate pushdown
>
[
https://issues.apache.org/jira/browse/SPARK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-22488:
Fix Version/s: 2.2.1
> The view resolution in the SparkSession internal table() API
>
[
https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-21720:
---
Assignee: Kazuaki Ishizaki
> Filter predicate with many conditions throw stackoverflow
[
https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21720.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull
yuhao yang created SPARK-22502:
--
Summary: OnlineLDAOptimizer variationalTopicInference might be
able to handle empty documents
Key: SPARK-22502
URL: https://issues.apache.org/jira/browse/SPARK-22502
[
https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248983#comment-16248983
]
Marco Gaido commented on SPARK-22501:
-
[~kiszk] are you working on this or can I take it?
> 64KB JVM
Kazuaki Ishizaki created SPARK-22501:
Summary: 64KB JVM bytecode limit problem with in
Key: SPARK-22501
URL: https://issues.apache.org/jira/browse/SPARK-22501
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14220:
Assignee: Apache Spark
> Build and test Spark against Scala 2.12
>
[
https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14220:
Assignee: (was: Apache Spark)
> Build and test Spark against Scala 2.12
>
[
https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248975#comment-16248975
]
Apache Spark commented on SPARK-14220:
--
User 'EmergentOrder' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-19606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-19606.
--
Resolution: Fixed
Assignee: paul mackles
Fix Version/s: 2.3.0
[
https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22500:
Assignee: Apache Spark
> 64KB JVM bytecode limit problem with cast
>
[
https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248961#comment-16248961
]
Apache Spark commented on SPARK-22500:
--
User 'kiszk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22500:
Assignee: (was: Apache Spark)
> 64KB JVM bytecode limit problem with cast
>
[
https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-22499:
-
Description: Both {{least}} and {{greatest}} can throw an exception due to
the 64KB JVM
Kazuaki Ishizaki created SPARK-22500:
Summary: 64KB JVM bytecode limit problem with cast
Key: SPARK-22500
URL: https://issues.apache.org/jira/browse/SPARK-22500
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-22498:
-
Description: Both {{concat}} and {{concat_ws}} can throw an exception due
to the 64KB
[
https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248933#comment-16248933
]
Apache Spark commented on SPARK-22499:
--
User 'kiszk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22499:
Assignee: Apache Spark
> 64KB JVM bytecode limit problem with least and greatest
>
[
https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22499:
Assignee: (was: Apache Spark)
> 64KB JVM bytecode limit problem with least and
[
https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-22499:
-
Description: Both {{least}} and {{greatest}} can thow an exception due to
the 64KB JVM
[
https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kazuaki Ishizaki updated SPARK-22499:
-
Summary: 64KB JVM bytecode limit problem with least and greatest (was:
64KB JVM
Kazuaki Ishizaki created SPARK-22499:
Summary: 64KB JVM bytecode limit problem with leastest and greatest
Key: SPARK-22499
URL: https://issues.apache.org/jira/browse/SPARK-22499
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248929#comment-16248929
]
Brett Randall commented on SPARK-15685:
---
SPARK-16304 fixes part of this in commit
[
https://issues.apache.org/jira/browse/SPARK-22486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeremy Beard resolved SPARK-22486.
--
Resolution: Won't Fix
[~c...@koeninger.org] Ok yes I see your point. Closing as won't fix.
>
[
https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22498:
Assignee: (was: Apache Spark)
> 64KB JVM bytecode limit problem with concat and
[
https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248917#comment-16248917
]
Apache Spark commented on SPARK-22498:
--
User 'kiszk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22498:
Assignee: Apache Spark
> 64KB JVM bytecode limit problem with concat and concat_ws
>
Kazuaki Ishizaki created SPARK-22498:
Summary: 64KB JVM bytecode limit problem with concat and concat_ws
Key: SPARK-22498
URL: https://issues.apache.org/jira/browse/SPARK-22498
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-22497:
Description:
The below SQL will scan {{table1}} twice. We can reuse the first Project.
{code:sql}
[
https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248910#comment-16248910
]
Apache Spark commented on SPARK-22497:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22497:
Assignee: (was: Apache Spark)
> Reuse project
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-22497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22497:
Assignee: Apache Spark
> Reuse project
> -
>
> Key:
Yuming Wang created SPARK-22497:
---
Summary: Reuse project
Key: SPARK-22497
URL: https://issues.apache.org/jira/browse/SPARK-22497
Project: Spark
Issue Type: Sub-task
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-22486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248891#comment-16248891
]
Cody Koeninger commented on SPARK-22486:
Can you identify a clear use case for this, given that
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248837#comment-16248837
]
Ran Haim edited comment on SPARK-22481 at 11/12/17 12:31 PM:
-
Hi,
I created
[
https://issues.apache.org/jira/browse/SPARK-22481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248837#comment-16248837
]
Ran Haim commented on SPARK-22481:
--
Hi,
I create this simple test that will show how slow refresh table
[
https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22490:
Assignee: (was: Apache Spark)
> PySpark doc has misleading string for
[
https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248830#comment-16248830
]
Apache Spark commented on SPARK-22490:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22490:
Assignee: Apache Spark
> PySpark doc has misleading string for SparkSession.builder
>
[
https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248818#comment-16248818
]
Dongjoon Hyun commented on SPARK-22490:
---
Oh, this doc seems to come from SPARK-15084. I'll make a
73 matches
Mail list logo