guichaoxian created SPARK-23506:
---
Summary: Add refreshByPath in HiveMetastoreCatalog and
invalidByPath in FileStatusCache
Key: SPARK-23506
URL: https://issues.apache.org/jira/browse/SPARK-23506
Project:
[
https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375386#comment-16375386
]
Apache Spark commented on SPARK-23448:
--
User 'viirya' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375305#comment-16375305
]
Arun Manivannan commented on SPARK-20592:
-
x
> Alter table concatenate is not wo
[
https://issues.apache.org/jira/browse/SPARK-20592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun Manivannan updated SPARK-20592:
Comment: was deleted
(was: x)
> Alter table concatenate is not working as expected.
>
[
https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375254#comment-16375254
]
Marcelo Vanzin commented on SPARK-23475:
https://github.com/apache/spark/pull/206
Marcelo Vanzin created SPARK-23505:
--
Summary: Flaky test: ParquetQuerySuite
Key: SPARK-23505
URL: https://issues.apache.org/jira/browse/SPARK-23505
Project: Spark
Issue Type: Bug
C
Marcelo Vanzin created SPARK-23504:
--
Summary: Flaky test: RateSourceV2Suite.basic microbatch execution
Key: SPARK-23504
URL: https://issues.apache.org/jira/browse/SPARK-23504
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-23459.
-
Resolution: Fixed
Assignee: Kazuaki Ishizaki
Fix Version/s: 2.4.0
> Improve the error mes
[
https://issues.apache.org/jira/browse/SPARK-21740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375134#comment-16375134
]
Dheeren Beborrtha commented on SPARK-21740:
---
What workaround did you use? DId y
[
https://issues.apache.org/jira/browse/SPARK-23502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375119#comment-16375119
]
Sean Owen commented on SPARK-23502:
---
It does introduce some new cases to deal with, lik
[
https://issues.apache.org/jira/browse/SPARK-23502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375051#comment-16375051
]
Sital Kedia commented on SPARK-23502:
-
I realized that we are printing the web url li
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375005#comment-16375005
]
Imran Rashid commented on SPARK-23485:
--
{quote}
I think this is because the general
[
https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-23408:
--
Fix Version/s: 2.4.0
> Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on
[
https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-23408:
-
Assignee: Tathagata Das
> Flaky test: StreamingOuterJoinSuite.left outer early state exc
[
https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-23408.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 20650
[https://g
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374884#comment-16374884
]
Anirudh Ramanathan edited comment on SPARK-23485 at 2/23/18 7:36 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374884#comment-16374884
]
Anirudh Ramanathan commented on SPARK-23485:
Stavros - we [do currently
diff
[
https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374872#comment-16374872
]
Sönke Liebau commented on SPARK-18057:
--
Alright.
I've got a 12h flight to SF ahead o
Jose Torres created SPARK-23503:
---
Summary: continuous execution should sequence committed epochs
Key: SPARK-23503
URL: https://issues.apache.org/jira/browse/SPARK-23503
Project: Spark
Issue Typ
Sital Kedia created SPARK-23502:
---
Summary: Support async init of spark context during spark-shell
startup
Key: SPARK-23502
URL: https://issues.apache.org/jira/browse/SPARK-23502
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374778#comment-16374778
]
Stavros Kontopoulos edited comment on SPARK-23485 at 2/23/18 6:59 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374841#comment-16374841
]
Xuefu Zhang commented on SPARK-5377:
[~shay_elbaz] I think the issue was closed purely
[
https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374830#comment-16374830
]
Keepun commented on SPARK-23471:
Saved to AWS s3://
> RandomForestClassificationModel sa
[
https://issues.apache.org/jira/browse/SPARK-23471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Keepun updated SPARK-23471:
---
Description:
RandomForestClassificationMode.load() does not work after save()
{code:java}
RandomForestClassi
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374778#comment-16374778
]
Stavros Kontopoulos edited comment on SPARK-23485 at 2/23/18 6:36 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374757#comment-16374757
]
Yinan Li edited comment on SPARK-23485 at 2/23/18 6:22 PM:
---
It'
[
https://issues.apache.org/jira/browse/SPARK-23500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Henry Robinson updated SPARK-23500:
---
Description:
Simple filters on dataframes joined with {{joinWith()}} are missing an
opportun
[
https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-20680:
--
Assignee: (was: Marcelo Vanzin)
> Spark-sql do not support for void column datatyp
[
https://issues.apache.org/jira/browse/SPARK-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-20680:
--
Assignee: Marcelo Vanzin
> Spark-sql do not support for void column datatype of view
>
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374778#comment-16374778
]
Stavros Kontopoulos commented on SPARK-23485:
-
How about locality preferences
[
https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23501:
Assignee: Apache Spark
> Refactor AllStagesPage in order to avoid redundant code
> ---
[
https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23501:
Assignee: (was: Apache Spark)
> Refactor AllStagesPage in order to avoid redundant cod
[
https://issues.apache.org/jira/browse/SPARK-23501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374775#comment-16374775
]
Apache Spark commented on SPARK-23501:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23499:
Assignee: (was: Apache Spark)
> Mesos Cluster Dispatcher should support priority queue
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374768#comment-16374768
]
Apache Spark commented on SPARK-23499:
--
User 'pgillet' has created a pull request fo
Marco Gaido created SPARK-23501:
---
Summary: Refactor AllStagesPage in order to avoid redundant code
Key: SPARK-23501
URL: https://issues.apache.org/jira/browse/SPARK-23501
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23499:
Assignee: Apache Spark
> Mesos Cluster Dispatcher should support priority queues to submit
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374757#comment-16374757
]
Yinan Li commented on SPARK-23485:
--
It's not that I'm too confident on the capability of
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374748#comment-16374748
]
Imran Rashid commented on SPARK-23485:
--
ok the missing jar was a bad example on kube
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374745#comment-16374745
]
Anirudh Ramanathan edited comment on SPARK-23485 at 2/23/18 6:00 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374745#comment-16374745
]
Anirudh Ramanathan commented on SPARK-23485:
While mostly I think that K8s wo
Henry Robinson created SPARK-23500:
--
Summary: Filters on named_structs could be pushed into scans
Key: SPARK-23500
URL: https://issues.apache.org/jira/browse/SPARK-23500
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pascal GILLET updated SPARK-23499:
--
Description:
As for Yarn, Mesos users should be able to specify priority queues to define a
wo
Pascal GILLET created SPARK-23499:
-
Summary: Mesos Cluster Dispatcher should support priority queues
to submit drivers
Key: SPARK-23499
URL: https://issues.apache.org/jira/browse/SPARK-23499
Project:
[
https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Zhang updated SPARK-23498:
Description:
While comparing a string column with integer value, spark sql will
automatically cast
Kevin Zhang created SPARK-23498:
---
Summary: Accuracy problem in comparison with string and integer
Key: SPARK-23498
URL: https://issues.apache.org/jira/browse/SPARK-23498
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374708#comment-16374708
]
Yinan Li commented on SPARK-23485:
--
In the Yarn case, yes, it's possible that a node is
[
https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374599#comment-16374599
]
Imran Rashid commented on SPARK-23485:
--
Yeah I don't think its safe to assume that i
bharath kumar created SPARK-23497:
-
Summary: Sparklyr Applications doesn't disconnect spark driver in
client mode
Key: SPARK-23497
URL: https://issues.apache.org/jira/browse/SPARK-23497
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374530#comment-16374530
]
Marco Gaido commented on SPARK-23496:
-
[~ala.luszczak] thanks for your answer. Honest
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374506#comment-16374506
]
Ala Luszczak commented on SPARK-23496:
--
I agree that this solution is merely making
[
https://issues.apache.org/jira/browse/SPARK-23494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Courtinot updated SPARK-23494:
Description:
I'm proposing that InferSchema's internals (infer the schema of each record,
[
https://issues.apache.org/jira/browse/SPARK-23494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Courtinot updated SPARK-23494:
Description:
I'm proposing that InferSchema's internals (infer the schema of each record,
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374490#comment-16374490
]
AIT OUFKIR commented on SPARK-23495:
After several checks, I noticed that the issue c
[
https://issues.apache.org/jira/browse/SPARK-23494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Courtinot updated SPARK-23494:
Description:
I'm proposing that InferSchema's internals (infer the schema of each record,
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374439#comment-16374439
]
Marco Gaido commented on SPARK-23496:
-
I read that the proposed solution is to use ra
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23496:
Assignee: (was: Apache Spark)
> Locality of coalesced partitions can be severely skewe
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374429#comment-16374429
]
Apache Spark commented on SPARK-23496:
--
User 'ala' has created a pull request for th
[
https://issues.apache.org/jira/browse/SPARK-23496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23496:
Assignee: Apache Spark
> Locality of coalesced partitions can be severely skewed by the or
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Description:
Issue happen when trying to create json file using a dataframe (see code below)
from py
Ala Luszczak created SPARK-23496:
Summary: Locality of coalesced partitions can be severely skewed
by the order of input partitions
Key: SPARK-23496
URL: https://issues.apache.org/jira/browse/SPARK-23496
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Flags: Important
Remaining Estimate: 4h
Original Estimate: 4h
This issue can cr
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Description:
Issue happen when trying to create json file using a dataframe (see code below)
from py
AIT OUFKIR created SPARK-23495:
--
Summary: Creating a json file using a dataframe creates an issue
Key: SPARK-23495
URL: https://issues.apache.org/jira/browse/SPARK-23495
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AIT OUFKIR updated SPARK-23495:
---
Summary: Creating a json file using a dataframe Generates an issue (was:
Creating a json file using
David Courtinot created SPARK-23494:
---
Summary: Expose InferSchema's functionalities to the outside
Key: SPARK-23494
URL: https://issues.apache.org/jira/browse/SPARK-23494
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374360#comment-16374360
]
Apache Spark commented on SPARK-23475:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374358#comment-16374358
]
Marco Gaido commented on SPARK-23493:
-
How can it know that you are not setting the p
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374266#comment-16374266
]
Xiaoju Wu commented on SPARK-23493:
---
If that's the case, it should throw an exception t
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374258#comment-16374258
]
Marco Gaido commented on SPARK-23493:
-
I don't think so. Partition columns are always
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yanlin updated SPARK-23350:
Attachment: TaskScheduler_stop.png
> [SS]Exception when stopping continuous processing application
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374236#comment-16374236
]
Wang Yanlin commented on SPARK-23350:
-
add the sequence flow for explainning this err
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yanlin updated SPARK-23350:
Attachment: TaskScheduler_stop.png
> [SS]Exception when stopping continuous processing application
[
https://issues.apache.org/jira/browse/SPARK-23350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yanlin updated SPARK-23350:
Attachment: (was: TaskScheduler_stop.png)
> [SS]Exception when stopping continuous processing a
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374218#comment-16374218
]
Javier edited comment on SPARK-21550 at 2/23/18 10:59 AM:
--
I sti
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374218#comment-16374218
]
Javier edited comment on SPARK-21550 at 2/23/18 10:58 AM:
--
I sti
[
https://issues.apache.org/jira/browse/SPARK-21550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374218#comment-16374218
]
Javier commented on SPARK-21550:
I still observe this behavior in 2.2.0 when approxQuanti
[
https://issues.apache.org/jira/browse/SPARK-23405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374182#comment-16374182
]
KaiXinXIaoLei commented on SPARK-23405:
---
[~q79969786] And if i run 'select ls.cs_or
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374172#comment-16374172
]
Xiaoju Wu commented on SPARK-23493:
---
[~mgaido] "Columns are matched in order while inse
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374146#comment-16374146
]
Marco Gaido commented on SPARK-23493:
-
I don't think this is an issue. I think this i
[
https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374139#comment-16374139
]
Apache Spark commented on SPARK-23475:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374076#comment-16374076
]
Xiaoju Wu commented on SPARK-23493:
---
This issue is similar with the issue described in
[
https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374073#comment-16374073
]
Xiaoju Wu commented on SPARK-9278:
--
Created a new ticket to trace this issue SPARK-23493
[
https://issues.apache.org/jira/browse/SPARK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoju Wu updated SPARK-23493:
--
Description:
insert-into only works when the partitionby key columns are set at last:
val data = Seq(
Xiaoju Wu created SPARK-23493:
-
Summary: insert-into depends on columns order, otherwise incorrect
data inserted
Key: SPARK-23493
URL: https://issues.apache.org/jira/browse/SPARK-23493
Project: Spark
85 matches
Mail list logo
