[
https://issues.apache.org/jira/browse/SPARK-23445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-23445.
-
Resolution: Fixed
Assignee: Juliusz Sompolski
Fix Version/s: 2.4.0
> ColumnStat
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377802#comment-16377802
]
Henry Robinson edited comment on SPARK-23500 at 2/27/18 7:08 AM:
-
There's
[
https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378060#comment-16378060
]
Apache Spark commented on SPARK-23523:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23523:
Assignee: Apache Spark (was: Xiao Li)
> Incorrect result caused by the rule
[
https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23523:
Assignee: Xiao Li (was: Apache Spark)
> Incorrect result caused by the rule
[
https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-23523:
Description:
{code:scala}
val tablePath = new File(s"${path.getCanonicalPath}/cOl3=c/cOl1=a/cOl5=e")
[
https://issues.apache.org/jira/browse/SPARK-23523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-23523:
Description:
{code:scala}
val tablePath = new File(s"${path.getCanonicalPath}/cOl3=c/cOl1=a/cOl5=e")
Xiao Li created SPARK-23523:
---
Summary: Incorrect result caused by the rule
OptimizeMetadataOnlyQuery
Key: SPARK-23523
URL: https://issues.apache.org/jira/browse/SPARK-23523
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378046#comment-16378046
]
Franck Tago commented on SPARK-19809:
-
Just to confirm , your earlier comment referred to spark
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378034#comment-16378034
]
Dongjoon Hyun commented on SPARK-19809:
---
2.3.0 RC5 voting will end tonight. You had better try
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378028#comment-16378028
]
Franck Tago commented on SPARK-19809:
-
1- I am kind of constrained to spark 2.2.1 at the moment .
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378022#comment-16378022
]
Dongjoon Hyun commented on SPARK-19809:
---
[~tafra...@gmail.com]. Please see the fixed version of
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378018#comment-16378018
]
Franck Tago commented on SPARK-19809:
-
Need a pointer on the following.
Env : Spark 2.2.1
1- I
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Franck Tago updated SPARK-19809:
Attachment: spark.sql.hive.convertMetastoreOrc.txt
> NullPointerException on zero-size ORC file
>
[
https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Franck Tago updated SPARK-19809:
Attachment: image-2018-02-26-20-29-49-410.png
> NullPointerException on zero-size ORC file
>
[
https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-8605:
---
Assignee: (was: Apache Spark)
> Exclude files in StreamingContext.
[
https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377999#comment-16377999
]
Apache Spark commented on SPARK-8605:
-
User 'ConcurrencyPractitioner' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-8605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-8605:
---
Assignee: Apache Spark
> Exclude files in StreamingContext. textFileStream(directory)
>
[
https://issues.apache.org/jira/browse/SPARK-23522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benjamin Peterson updated SPARK-23522:
--
Description:
pyspark uses the builtin exit() function a lot. In certain Python
[
https://issues.apache.org/jira/browse/SPARK-23522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23522:
Assignee: Apache Spark
> pyspark should always use sys.exit rather than exit
>
[
https://issues.apache.org/jira/browse/SPARK-23522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377968#comment-16377968
]
Apache Spark commented on SPARK-23522:
--
User 'benjaminp' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23522:
Assignee: (was: Apache Spark)
> pyspark should always use sys.exit rather than exit
>
Benjamin Peterson created SPARK-23522:
-
Summary: pyspark should always use sys.exit rather than exit
Key: SPARK-23522
URL: https://issues.apache.org/jira/browse/SPARK-23522
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377913#comment-16377913
]
Felix Cheung commented on SPARK-23206:
--
[~elu] Hi Edwina, we are interesting in this as well. We
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377897#comment-16377897
]
Jose Torres edited comment on SPARK-23504 at 2/27/18 1:56 AM:
--
I noticed
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377897#comment-16377897
]
Jose Torres commented on SPARK-23504:
-
I've
> Flaky test: RateSourceV2Suite.basic microbatch
[
https://issues.apache.org/jira/browse/SPARK-23521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated SPARK-23521:
--
Description:
Executive Summary: This SPIP is based on [discussion about the DataSourceV2
[
https://issues.apache.org/jira/browse/SPARK-23521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated SPARK-23521:
--
Description:
Executive Summary: This SPIP is based on [discussion about the DataSourceV2
Ryan Blue created SPARK-23521:
-
Summary: SPIP: Standardize SQL logical plans with DataSourceV2
Key: SPARK-23521
URL: https://issues.apache.org/jira/browse/SPARK-23521
Project: Spark
Issue Type:
David Courtinot created SPARK-23520:
---
Summary: Add support for MapType fields in JSON schema inference
Key: SPARK-23520
URL: https://issues.apache.org/jira/browse/SPARK-23520
Project: Spark
Franck Tago created SPARK-23519:
---
Summary: Create View Commands Fails with The view output
(col1,col1) contains duplicate column name
Key: SPARK-23519
URL: https://issues.apache.org/jira/browse/SPARK-23519
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377802#comment-16377802
]
Henry Robinson edited comment on SPARK-23500 at 2/26/18 11:51 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377802#comment-16377802
]
Henry Robinson commented on SPARK-23500:
There's an optimizer rule, {{SimplifyCreateStructOps}},
[
https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377704#comment-16377704
]
Apache Spark commented on SPARK-23518:
--
User 'liufengdb' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23518:
Assignee: Apache Spark
> Avoid metastore access when users only want to read and store
[
https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23518:
Assignee: (was: Apache Spark)
> Avoid metastore access when users only want to read
[
https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Feng Liu updated SPARK-23518:
-
Description: https://issues.apache.org/jira/browse/SPARK-21732 added one
patch, which allows a spark
[
https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Feng Liu updated SPARK-23518:
-
Summary: Avoid metastore access when users only want to read and store data
frames (was: Completely
[
https://issues.apache.org/jira/browse/SPARK-23518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Feng Liu updated SPARK-23518:
-
Description: This is to followup
https://issues.apache.org/jira/browse/SPARK-21732, which allows a spark
Feng Liu created SPARK-23518:
Summary: Completely remove metastore access if the query is not
using tables
Key: SPARK-23518
URL: https://issues.apache.org/jira/browse/SPARK-23518
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377628#comment-16377628
]
Kevin Kim commented on SPARK-23492:
---
[~guoxiaolongzte], thanks, I will reach out to him as well. In the
[
https://issues.apache.org/jira/browse/SPARK-22567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377626#comment-16377626
]
Michael Moss commented on SPARK-22567:
--
Thanks, [~devaraj.k]. Our team here can review the patch
[
https://issues.apache.org/jira/browse/SPARK-23491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-23491.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 20622
[
https://issues.apache.org/jira/browse/SPARK-23491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-23491:
-
Assignee: Jose Torres
> continuous symptom
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-22567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377370#comment-16377370
]
Devaraj K commented on SPARK-22567:
---
Dup of SPARK-17928.
[~michaelmoss], can you check the PR
[
https://issues.apache.org/jira/browse/SPARK-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23449.
Resolution: Fixed
Fix Version/s: 2.3.1
2.4.0
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-23449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-23449:
--
Assignee: Andrew Korzhuev
> Extra java options lose order in Docker context
>
[
https://issues.apache.org/jira/browse/SPARK-23438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23438.
Resolution: Fixed
Assignee: Gabor Somogyi
Fix Version/s: 2.4.0
[
https://issues.apache.org/jira/browse/SPARK-23517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377074#comment-16377074
]
Apache Spark commented on SPARK-23517:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23517:
Assignee: Apache Spark
> Make pyspark.util._exception_message produce the trace from Java
[
https://issues.apache.org/jira/browse/SPARK-23517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23517:
Assignee: (was: Apache Spark)
> Make pyspark.util._exception_message produce the
Hyukjin Kwon created SPARK-23517:
Summary: Make pyspark.util._exception_message produce the trace
from Java side for Py4JJavaError
Key: SPARK-23517
URL: https://issues.apache.org/jira/browse/SPARK-23517
[
https://issues.apache.org/jira/browse/SPARK-23514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23514:
Assignee: (was: Apache Spark)
> Replace spark.sparkContext.hadoopConfiguration by
>
[
https://issues.apache.org/jira/browse/SPARK-23514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377035#comment-16377035
]
Apache Spark commented on SPARK-23514:
--
User 'juliuszsompolski' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23514:
Assignee: Apache Spark
> Replace spark.sparkContext.hadoopConfiguration by
>
[
https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-23380:
-
Description:
Seems we can check the schema ahead and fall back in toPandas.
Please see this
[
https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-23380:
-
Summary: Adds a conf for Arrow fallback in toPandas/createDataFrame with
Pandas DataFrame (was:
[
https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377014#comment-16377014
]
Apache Spark commented on SPARK-23380:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376676#comment-16376676
]
Nicolas Fraison commented on SPARK-18364:
-
Is it possible to reopen this pull request or do we
[
https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376655#comment-16376655
]
assia ydroudj commented on SPARK-23206:
---
Hi. Where can I find the code of this PR to clone it on my
[
https://issues.apache.org/jira/browse/SPARK-23516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23516:
Assignee: (was: Apache Spark)
> I think it is unnecessary to transfer unroll memory
[
https://issues.apache.org/jira/browse/SPARK-23516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376613#comment-16376613
]
Apache Spark commented on SPARK-23516:
--
User '10110346' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23516:
Assignee: Apache Spark
> I think it is unnecessary to transfer unroll memory to storage
liuxian created SPARK-23516:
---
Summary: I think it is unnecessary to transfer unroll memory to
storage memory
Key: SPARK-23516
URL: https://issues.apache.org/jira/browse/SPARK-23516
Project: Spark
64 matches
Mail list logo
