[
https://issues.apache.org/jira/browse/SPARK-18640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715712#comment-15715712
]
Josh Rosen commented on SPARK-18640:
Actually, this doesn't look necessary because that method isn't
[
https://issues.apache.org/jira/browse/SPARK-18640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715690#comment-15715690
]
Josh Rosen commented on SPARK-18640:
I'm also going to backport this into branch-1.6.
> Fix minor
[
https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-18553.
Resolution: Fixed
Fix Version/s: 1.6.4
> Executor loss may cause TaskSetManager to be
[
https://issues.apache.org/jira/browse/SPARK-18362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18362:
---
Summary: Use TextFileFormat in implementation of CSVFileFormat (was: Use
TextFileFormat in
[
https://issues.apache.org/jira/browse/SPARK-18362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18362:
---
Description: Spark's CSVFileFormat data source uses inefficient methods for
reading files during
Josh Rosen created SPARK-18640:
--
Summary: Fix minor synchronization issue in
TaskSchedulerImpl.runningTasksByExecutors
Key: SPARK-18640
URL: https://issues.apache.org/jira/browse/SPARK-18640
Project:
[
https://issues.apache.org/jira/browse/SPARK-18640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-18640:
--
Assignee: Josh Rosen
> Fix minor synchronization issue in
[
https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18553:
---
Fix Version/s: 2.2.0
2.1.0
> Executor loss may cause TaskSetManager to be leaked
[
https://issues.apache.org/jira/browse/SPARK-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706213#comment-15706213
]
Josh Rosen commented on SPARK-18352:
Yeah, I'll update my patch to roll back my JSON changes so it
[
https://issues.apache.org/jira/browse/SPARK-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18553:
---
Fix Version/s: 2.0.3
> Executor loss may cause TaskSetManager to be leaked
>
Josh Rosen created SPARK-18553:
--
Summary: Executor loss may cause TaskSetManager to be leaked
Key: SPARK-18553
URL: https://issues.apache.org/jira/browse/SPARK-18553
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-18462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18462:
---
Target Version/s: 2.0.3, 2.1.0
> SparkListenerDriverAccumUpdates event does not deserialize properly
[
https://issues.apache.org/jira/browse/SPARK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-1267:
--
Fix Version/s: 2.1.0
> Add a pip installer for PySpark
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-18129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18129:
---
Fix Version/s: 2.1.0
> Sign pip artifacts
> --
>
> Key: SPARK-18129
[
https://issues.apache.org/jira/browse/SPARK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-1267.
---
Resolution: Fixed
Fix Version/s: 2.2.0
Merged into master (2.2) and will consider for 2.1.
>
[
https://issues.apache.org/jira/browse/SPARK-18129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18129:
---
Assignee: holdenk
> Sign pip artifacts
> --
>
> Key: SPARK-18129
>
[
https://issues.apache.org/jira/browse/SPARK-18129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-18129.
Resolution: Fixed
Fix Version/s: 2.2.0
Merged to master (2.2).
> Sign pip artifacts
>
[
https://issues.apache.org/jira/browse/SPARK-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-1267:
--
Assignee: holdenk
> Add a pip installer for PySpark
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-18462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668990#comment-15668990
]
Josh Rosen commented on SPARK-18462:
{code}
[info] - roundtripping SparkListenerDriverAccumUpdates
Josh Rosen created SPARK-18462:
--
Summary: SparkListenerDriverAccumUpdates event does not
deserialize properly in history server
Key: SPARK-18462
URL: https://issues.apache.org/jira/browse/SPARK-18462
[
https://issues.apache.org/jira/browse/SPARK-18418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18418:
---
Fix Version/s: 2.2.0
> Make release script hadoop profiles aren't correctly specified.
>
[
https://issues.apache.org/jira/browse/SPARK-18418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-18418.
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15860
[
https://issues.apache.org/jira/browse/SPARK-18418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18418:
---
Assignee: holdenk
Affects Version/s: 2.1.0
Target Version/s: 2.1.0, 2.2.0
[
https://issues.apache.org/jira/browse/SPARK-18418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15660416#comment-15660416
]
Josh Rosen commented on SPARK-18418:
For reference: this patch fixes a bug which was introduced in
[
https://issues.apache.org/jira/browse/SPARK-18418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18418:
---
Component/s: Project Infra
> Make release script hadoop profiles aren't correctly specified.
>
[
https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18406:
---
Description:
The following log comes from a production streaming job where executors
periodically
Josh Rosen created SPARK-18406:
--
Summary: Race between end-of-task and completion iterator read
lock release
Key: SPARK-18406
URL: https://issues.apache.org/jira/browse/SPARK-18406
Project: Spark
Josh Rosen created SPARK-18362:
--
Summary: Use TextFileFormat in implementation of JsonFileFormat
and CSVFileFormat
Key: SPARK-18362
URL: https://issues.apache.org/jira/browse/SPARK-18362
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-18236.
Resolution: Fixed
Fix Version/s: 2.2.0
Merged into master (2.2.0).
> Reduce memory usage
[
https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634050#comment-15634050
]
Josh Rosen commented on SPARK-14220:
SPARK-14643 is likely to be the hardest task.
> Build and test
Josh Rosen created SPARK-18256:
--
Summary: Improve performance of event log replay in HistoryServer
based on profiler results
Key: SPARK-18256
URL: https://issues.apache.org/jira/browse/SPARK-18256
[
https://issues.apache.org/jira/browse/SPARK-18256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18256:
---
Issue Type: Improvement (was: Bug)
> Improve performance of event log replay in HistoryServer based
[
https://issues.apache.org/jira/browse/SPARK-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18254:
---
Labels: correctness (was: )
> UDFs don't see aliased column names
>
[
https://issues.apache.org/jira/browse/SPARK-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen closed SPARK-14960.
--
Resolution: Won't Fix
> Don't perform treeAggregation in local mode
>
[
https://issues.apache.org/jira/browse/SPARK-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633478#comment-15633478
]
Josh Rosen commented on SPARK-14960:
It turns out that {{treeAggregation}}'s extra costs in local
Josh Rosen created SPARK-18236:
--
Summary: Reduce memory usage of Spark UI and HistoryServer by
reducing duplicate objects
Key: SPARK-18236
URL: https://issues.apache.org/jira/browse/SPARK-18236
Project:
Josh Rosen created SPARK-18182:
--
Summary: Expose ReplayListenerBus.replay() overload which accepts
Iterator
Key: SPARK-18182
URL: https://issues.apache.org/jira/browse/SPARK-18182
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18034:
---
Fix Version/s: 2.0.2
> Upgrade to MiMa 0.1.11
> --
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-18034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18034:
---
Target Version/s: 2.0.2, 2.1.0 (was: 2.1.0)
> Upgrade to MiMa 0.1.11
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-18034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-18034.
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 15571
[
https://issues.apache.org/jira/browse/SPARK-18037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593347#comment-15593347
]
Josh Rosen commented on SPARK-18037:
Ahhh, I remember there being other JIRAs related to a negative
Josh Rosen created SPARK-18034:
--
Summary: Upgrade to MiMa 0.1.11
Key: SPARK-18034
URL: https://issues.apache.org/jira/browse/SPARK-18034
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-18003:
---
Labels: correctness (was: )
> RDD zipWithIndex generate wrong result when one partition contains
[
https://issues.apache.org/jira/browse/SPARK-17981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17981:
---
Labels: correctness (was: )
> Incorrectly Set Nullability to False in FilterExec
>
[
https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583642#comment-15583642
]
Josh Rosen commented on SPARK-7721:
---
IIRC when I looked into this I hit problems with the HTML Publisher
[
https://issues.apache.org/jira/browse/SPARK-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583605#comment-15583605
]
Josh Rosen commented on SPARK-3132:
---
I don't think that this is being actively worked on. I remember
[
https://issues.apache.org/jira/browse/SPARK-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-3132:
--
Assignee: (was: Davies Liu)
> Avoid serialization for Array[Byte] in TorrentBroadcast
>
[
https://issues.apache.org/jira/browse/SPARK-17806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17806:
---
Component/s: SQL
> Incorrect result when work with data from parquet
>
[
https://issues.apache.org/jira/browse/SPARK-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17803:
---
Assignee: Christian Kadner
> Docker integration tests don't run with "Docker for Mac"
>
[
https://issues.apache.org/jira/browse/SPARK-17803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-17803.
Resolution: Fixed
Fix Version/s: 2.1.0
2.0.2
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-17809.
Resolution: Fixed
Fix Version/s: 2.0.1
> scala.MatchError: BooleanType when casting a
[
https://issues.apache.org/jira/browse/SPARK-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552868#comment-15552868
]
Josh Rosen commented on SPARK-17809:
This appears to be fixed in the Spark 2.0.1 release, so I'm
[
https://issues.apache.org/jira/browse/SPARK-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552864#comment-15552864
]
Josh Rosen commented on SPARK-17809:
For context, here's the stacktrace as of Spark 2.0.0:
{code}
[
https://issues.apache.org/jira/browse/SPARK-17806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552842#comment-15552842
]
Josh Rosen commented on SPARK-17806:
I think that broadcast join may be the culprit here since I seem
[
https://issues.apache.org/jira/browse/SPARK-17806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552830#comment-15552830
]
Josh Rosen commented on SPARK-17806:
I was able to confirm that this is still a problem as of 2.0.1.
[
https://issues.apache.org/jira/browse/SPARK-17806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17806:
---
Labels: correctness (was: )
> Incorrect result when work with data from parquet
>
[
https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-13210:
---
Fix Version/s: 1.6.1
> NPE in Sort
> ---
>
> Key: SPARK-13210
>
[
https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-13210:
---
Affects Version/s: 1.6.0
> NPE in Sort
> ---
>
> Key: SPARK-13210
>
[
https://issues.apache.org/jira/browse/SPARK-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543975#comment-15543975
]
Josh Rosen commented on SPARK-13210:
Hmm, weird. It looks like this was cherry-picked in
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534127#comment-15534127
]
Josh Rosen commented on SPARK-17733:
Here's an even simpler test case:
{code}
sql("""CREATE
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534082#comment-15534082
]
Josh Rosen edited comment on SPARK-17733 at 9/29/16 9:30 PM:
-
I managed to
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534082#comment-15534082
]
Josh Rosen edited comment on SPARK-17733 at 9/29/16 9:28 PM:
-
I managed to
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534082#comment-15534082
]
Josh Rosen commented on SPARK-17733:
I managed to shrink to a smaller case which freezes {{explain}}:
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15533996#comment-15533996
]
Josh Rosen commented on SPARK-17733:
Actually, the above log segment wasn't super useful, so let me
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17733:
---
Attachment: constraints.png
> InferFiltersFromConstraints rule never terminates for query
>
[
https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17733:
---
Attachment:
Josh Rosen created SPARK-17733:
--
Summary: InferFiltersFromConstraints rule never terminates for
query
Key: SPARK-17733
URL: https://issues.apache.org/jira/browse/SPARK-17733
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17666:
---
Target Version/s: 2.0.1, 2.1.0 (was: 2.0.2, 2.1.0)
> take() or isEmpty() on dataset leaks s3a
[
https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-17666:
--
Assignee: Josh Rosen
> take() or isEmpty() on dataset leaks s3a connections
>
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17712:
---
Fix Version/s: 2.0.2
> Incorrect result due to invalid pushdown of data-independent filter beneath
[
https://issues.apache.org/jira/browse/SPARK-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-16343:
---
Fix Version/s: 2.0.2
> Improve the PushDownPredicate rule to pushdown predicates currectly in
>
[
https://issues.apache.org/jira/browse/SPARK-17721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17721:
---
Labels: correctness (was: )
> Erroneous computation in multiplication of transposed SparseMatrix
[
https://issues.apache.org/jira/browse/SPARK-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15533632#comment-15533632
]
Josh Rosen commented on SPARK-16343:
This is actually a correctness issue, albeit pretty minor since
[
https://issues.apache.org/jira/browse/SPARK-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-16343:
---
Labels: correctness (was: )
> Improve the PushDownPredicate rule to pushdown predicates currectly
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen reassigned SPARK-17712:
--
Assignee: Josh Rosen
> Incorrect result due to invalid pushdown of data-independent filter
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17712:
---
Priority: Minor (was: Major)
> Incorrect result due to invalid pushdown of data-independent filter
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531105#comment-15531105
]
Josh Rosen commented on SPARK-17712:
Intuitively, the only case where you can push a filter beneath
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17712:
---
Summary: Incorrect result due to invalid pushdown of data-independent
filter beneath aggregate
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17712:
---
Summary: Incorrect result due to invalid pushdown of filter beneath
aggregate (was: Incorrect
[
https://issues.apache.org/jira/browse/SPARK-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531051#comment-15531051
]
Josh Rosen commented on SPARK-17712:
This appears to be an optimizer bug:
{code}
16/09/28 15:18:57
Josh Rosen created SPARK-17712:
--
Summary: Incorrect result when selecting from aggregate subquery
where outer WHERE clause constant-folds to false
Key: SPARK-17712
URL:
Josh Rosen created SPARK-17710:
--
Summary: ReplSuite fails with ClassCircularityError in master
Maven builds
Key: SPARK-17710
URL: https://issues.apache.org/jira/browse/SPARK-17710
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17710:
---
Affects Version/s: (was: 2.0.0)
2.1.0
> ReplSuite fails with
[
https://issues.apache.org/jira/browse/SPARK-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-17056.
Resolution: Fixed
Fix Version/s: 2.1.0
2.0.2
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17056:
---
Assignee: Liang-Chi Hsieh
> Fix a wrong assert in MemoryStore
> -
>
[
https://issues.apache.org/jira/browse/SPARK-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17056:
---
Component/s: (was: Spark Core)
Block Manager
> Fix a wrong assert in
[
https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17618:
---
Fix Version/s: 2.1.0
2.0.2
> Dataframe except returns incorrect results when
[
https://issues.apache.org/jira/browse/SPARK-17681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526929#comment-15526929
]
Josh Rosen commented on SPARK-17681:
I don't think that the current behavior is wrong. If {{drop()}}
[
https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17666:
---
Target Version/s: 2.0.2, 2.1.0
Priority: Critical (was: Major)
> take() or isEmpty() on
[
https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17666:
---
Component/s: (was: Java API)
SQL
> take() or isEmpty() on dataset leaks s3a
[
https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523921#comment-15523921
]
Josh Rosen commented on SPARK-17666:
I think that one problem with that approach is that any
[
https://issues.apache.org/jira/browse/SPARK-17666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523742#comment-15523742
]
Josh Rosen commented on SPARK-17666:
My hunch is that there's cleanup which is performed in a
[
https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517656#comment-15517656
]
Josh Rosen edited comment on SPARK-17647 at 9/23/16 9:52 PM:
-
Another piece
[
https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517656#comment-15517656
]
Josh Rosen commented on SPARK-17647:
Another piece of evidence to help untangle this:
In MySQL,
[
https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517636#comment-15517636
]
Josh Rosen commented on SPARK-17647:
On the other hand, running
{code}
select '' like '%\\%'
[
https://issues.apache.org/jira/browse/SPARK-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517589#comment-15517589
]
Josh Rosen commented on SPARK-17647:
I think that the first case is clearly a bug (and have a fix)
[
https://issues.apache.org/jira/browse/SPARK-17650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-17650:
---
Component/s: Spark Core
> Adding a malformed URL to sc.addJar and/or sc.addFile bricks Executors
>
[
https://issues.apache.org/jira/browse/SPARK-17646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-17646.
Resolution: Not A Problem
Yep, this is the intended behavior. From the Scaladoc:
{code}
/**
[
https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-16240:
---
Fix Version/s: (was: 2.0.1)
2.0.2
> model loading backward compatibility for
[
https://issues.apache.org/jira/browse/SPARK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-14387:
---
Target Version/s: 2.0.2 (was: 2.0.1)
> Enable Hive-1.x ORC compatibility with
501 - 600 of 3551 matches
Mail list logo