Burak Yavuz created SPARK-21977:
---
Summary: SinglePartition optimizations break certain StateStore
requirements
Key: SPARK-21977
URL: https://issues.apache.org/jira/browse/SPARK-21977
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-21977:
---
Assignee: Burak Yavuz
> SinglePartition optimizations break certain StateStore requirements
[
https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21977:
Description: This is a bit hard to explain as there are several issues here
> SinglePartition optim
Burak Yavuz created SPARK-21925:
---
Summary: Update trigger interval documentation in docs with
behavior change in Spark 2.2
Key: SPARK-21925
URL: https://issues.apache.org/jira/browse/SPARK-21925
Project
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21590:
Issue Type: Improvement (was: Bug)
> Structured Streaming window start time should support negativ
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118560#comment-16118560
]
Burak Yavuz commented on SPARK-21590:
-
Ah, I apologize, I thought the other way aroun
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115998#comment-16115998
]
Burak Yavuz commented on SPARK-21590:
-
[~KevinZwx] there's nothing wrong. It works as
[
https://issues.apache.org/jira/browse/SPARK-21588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113519#comment-16113519
]
Burak Yavuz commented on SPARK-21588:
-
that's what I was proposing. `null` seemed mor
[
https://issues.apache.org/jira/browse/SPARK-21588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113422#comment-16113422
]
Burak Yavuz commented on SPARK-21588:
-
[~vinodkc] [~aokolnychyi]
It happens when the
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111460#comment-16111460
]
Burak Yavuz commented on SPARK-21590:
-
There are tests to make sure it supports "nega
[
https://issues.apache.org/jira/browse/SPARK-21590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111458#comment-16111458
]
Burak Yavuz commented on SPARK-21590:
-
Does it output incorrect results if you provid
Burak Yavuz created SPARK-21588:
---
Summary: SQLContext.getConf(key, null) should return null, but it
throws NPE
Key: SPARK-21588
URL: https://issues.apache.org/jira/browse/SPARK-21588
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-21463:
---
Assignee: Burak Yavuz
> Output of StructuredStreaming tables don't respect user specified sc
Burak Yavuz created SPARK-21463:
---
Summary: Output of StructuredStreaming tables don't respect user
specified schema when reading back the table
Key: SPARK-21463
URL: https://issues.apache.org/jira/browse/SPARK-21463
[
https://issues.apache.org/jira/browse/SPARK-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-21445:
---
Assignee: Burak Yavuz
> NotSerializableException thrown by UTF8String.IntWrapper
> -
Burak Yavuz created SPARK-21445:
---
Summary: NotSerializableException thrown by UTF8String.IntWrapper
Key: SPARK-21445
URL: https://issues.apache.org/jira/browse/SPARK-21445
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21370:
Description:
During Streaming Aggregation, we have two StateStores per task, one used as
read-only
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reopened SPARK-21370:
-
> Avoid doing anything on HDFSBackedStateStore.abort() when there are no
> updates to commit
> -
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-21370:
Issue Type: Test (was: Improvement)
> Avoid doing anything on HDFSBackedStateStore.abort() when th
[
https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz closed SPARK-21370.
---
Resolution: Not A Problem
> Avoid doing anything on HDFSBackedStateStore.abort() when there are no
>
Burak Yavuz created SPARK-21370:
---
Summary: Clarify In-Memory State Store purpose (read-only,
read-write) with an additional state
Key: SPARK-21370
URL: https://issues.apache.org/jira/browse/SPARK-21370
Burak Yavuz created SPARK-21216:
---
Summary: Streaming DataFrames fail to join with Hive tables
Key: SPARK-21216
URL: https://issues.apache.org/jira/browse/SPARK-21216
Project: Spark
Issue Type:
Burak Yavuz created SPARK-21153:
---
Summary: Time windowing for tumbling windows can use a project
instead of expand + filter
Key: SPARK-21153
URL: https://issues.apache.org/jira/browse/SPARK-21153
Projec
[
https://issues.apache.org/jira/browse/SPARK-20708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-20708.
-
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 2.3.0
> Make `addExclusi
[
https://issues.apache.org/jira/browse/SPARK-20708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032475#comment-16032475
]
Burak Yavuz commented on SPARK-20708:
-
Resolved by https://github.com/apache/spark/pu
[
https://issues.apache.org/jira/browse/SPARK-20140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-20140.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
> Remove hardcoded kinesis
[
https://issues.apache.org/jira/browse/SPARK-20140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013191#comment-16013191
]
Burak Yavuz commented on SPARK-20140:
-
resolved by https://github.com/apache/spark/pu
[
https://issues.apache.org/jira/browse/SPARK-20140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-20140:
---
Assignee: Yash Sharma
> Remove hardcoded kinesis retry wait and max retries
> --
Burak Yavuz created SPARK-20775:
---
Summary: from_json should also have an API where the schema is
specified with a string
Key: SPARK-20775
URL: https://issues.apache.org/jira/browse/SPARK-20775
Project:
[
https://issues.apache.org/jira/browse/SPARK-20571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998680#comment-15998680
]
Burak Yavuz commented on SPARK-20571:
-
Thanks!
> Flaky SparkR StructuredStreaming te
[
https://issues.apache.org/jira/browse/SPARK-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-20441.
-
Resolution: Fixed
Resolved with https://github.com/apache/spark/pull/17735
> Within the same str
[
https://issues.apache.org/jira/browse/SPARK-20432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz closed SPARK-20432.
---
Resolution: Duplicate
> Unioning two identical Streaming DataFrames fails during attribute resolution
[
https://issues.apache.org/jira/browse/SPARK-20571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994185#comment-15994185
]
Burak Yavuz commented on SPARK-20571:
-
cc [~felixcheung]
> Flaky SparkR StructuredSt
Burak Yavuz created SPARK-20571:
---
Summary: Flaky SparkR StructuredStreaming tests
Key: SPARK-20571
URL: https://issues.apache.org/jira/browse/SPARK-20571
Project: Spark
Issue Type: Test
Burak Yavuz created SPARK-20549:
---
Summary: java.io.CharConversionException: Invalid UTF-32 in
JsonToStructs
Key: SPARK-20549
URL: https://issues.apache.org/jira/browse/SPARK-20549
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-20496.
-
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.2
Resolved with https://gith
[
https://issues.apache.org/jira/browse/SPARK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-20496:
---
Assignee: Bill Chambers
> KafkaWriter Uses Unanalyzed Logical Plan
> ---
Burak Yavuz created SPARK-20432:
---
Summary: Unioning two identical Streaming DataFrames fails during
attribute resolution
Key: SPARK-20432
URL: https://issues.apache.org/jira/browse/SPARK-20432
Project:
Burak Yavuz created SPARK-20301:
---
Summary: Flakiness in StreamingAggregationSuite
Key: SPARK-20301
URL: https://issues.apache.org/jira/browse/SPARK-20301
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-20301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-20301:
Labels: flaky-test (was: )
> Flakiness in StreamingAggregationSuite
>
Burak Yavuz created SPARK-20230:
---
Summary: FetchFailedExceptions should invalidate file caches in
MapOutputTracker even if newer stages are launched
Key: SPARK-20230
URL: https://issues.apache.org/jira/browse/SPARK-
[
https://issues.apache.org/jira/browse/SPARK-19911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-19911.
-
Resolution: Fixed
Assignee: Adam Budde
Fix Version/s: 2.2.0
Target Ve
Burak Yavuz created SPARK-19886:
---
Summary: reportDataLoss cause != null check is wrong for
Structured Streaming KafkaSource
Key: SPARK-19886
URL: https://issues.apache.org/jira/browse/SPARK-19886
Projec
[
https://issues.apache.org/jira/browse/SPARK-19813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-19813.
-
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.1
> maxFilesPerTrigger combo
[
https://issues.apache.org/jira/browse/SPARK-19304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-19304.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Target Version/s: 2.2.0
Resolved by: http
[
https://issues.apache.org/jira/browse/SPARK-19304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-19304:
---
Assignee: Gaurav Shah
> Kinesis checkpoint recovery is 10x slow
> --
[
https://issues.apache.org/jira/browse/SPARK-19595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-19595.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Resolved by https://github.com/apache/spark/pull/16
[
https://issues.apache.org/jira/browse/SPARK-19595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz reassigned SPARK-19595:
---
Assignee: Hyukjin Kwon
> from_json produces only a single row when input is a json array
> -
Burak Yavuz created SPARK-19813:
---
Summary: maxFilesPerTrigger combo latestFirst may miss old files
in combination with maxFileAge in FileStreamSource
Key: SPARK-19813
URL: https://issues.apache.org/jira/browse/SPARK
Burak Yavuz created SPARK-19774:
---
Summary: StreamExecution should call stop() on sources when a
stream fails
Key: SPARK-19774
URL: https://issues.apache.org/jira/browse/SPARK-19774
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-19405.
-
Resolution: Fixed
Assignee: Adam Budde
Fix Version/s: 2.2.0
Resolved with: https:
Burak Yavuz created SPARK-19637:
---
Summary: add to_json APIs to SQL
Key: SPARK-19637
URL: https://issues.apache.org/jira/browse/SPARK-19637
Project: Spark
Issue Type: New Feature
Compo
[
https://issues.apache.org/jira/browse/SPARK-19542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-19542.
-
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.1
> Delete the temp checkpoi
Burak Yavuz created SPARK-19543:
---
Summary: from_json fails when the input row is empty
Key: SPARK-19543
URL: https://issues.apache.org/jira/browse/SPARK-19543
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18218:
Assignee: Weichen Xu
> Optimize BlockMatrix multiplication, which may cause OOM and low parallelism
[
https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-18218.
-
Resolution: Implemented
Fix Version/s: 2.2.0
Resolved by https://github.com/apache/spark/p
[
https://issues.apache.org/jira/browse/SPARK-19378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-19378:
Description:
If you have a StreamingDataFrame with an aggregation, we report a metric called
state
Burak Yavuz created SPARK-19378:
---
Summary: StateOperator metrics should still return the total
number of rows in state even if there was no data for a trigger
Key: SPARK-19378
URL: https://issues.apache.org/jira/bro
[
https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18020:
Assignee: Takeshi Yamamuro
> Kinesis receiver does not snapshot when shard completes
>
[
https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz resolved SPARK-18020.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Resolved by https://github.com/apache/spark/pull/16
[
https://issues.apache.org/jira/browse/SPARK-18952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18952:
Summary: regex strings not properly escaped in codegen for aggregations
(was: regex strings not pr
Burak Yavuz created SPARK-18952:
---
Summary: regex strings not properly escaped in codegen
Key: SPARK-18952
URL: https://issues.apache.org/jira/browse/SPARK-18952
Project: Spark
Issue Type: Bug
Burak Yavuz created SPARK-18927:
---
Summary: MemorySink for StructuredStreaming can't recover from
checkpoint if location is provided in conf
Key: SPARK-18927
URL: https://issues.apache.org/jira/browse/SPARK-18927
Burak Yavuz created SPARK-18900:
---
Summary: Flaky Test: StateStoreSuite.maintenance
Key: SPARK-18900
URL: https://issues.apache.org/jira/browse/SPARK-18900
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-1:
Affects Version/s: (was: 2.1.0)
2.0.2
> partitionBy in DataStreamWriter
Burak Yavuz created SPARK-1:
---
Summary: partitionBy in DataStreamWriter in Python throws _to_seq
not defined
Key: SPARK-1
URL: https://issues.apache.org/jira/browse/SPARK-1
Project: Spark
Burak Yavuz created SPARK-18868:
---
Summary: Flaky Test: StreamingQueryListenerSuite
Key: SPARK-18868
URL: https://issues.apache.org/jira/browse/SPARK-18868
Project: Spark
Issue Type: Test
Burak Yavuz created SPARK-18811:
---
Summary: Stream Source resolution should happen in StreamExecution
thread, not main thread
Key: SPARK-18811
URL: https://issues.apache.org/jira/browse/SPARK-18811
Proje
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15706788#comment-15706788
]
Burak Yavuz commented on SPARK-18475:
-
I'd be happy to share performance results. You
[
https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18634:
Description:
There are some weird issues with exploding Python UDFs in SparkSQL.
There are 2 cases
[
https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18634:
Description:
There are some weird issues with exploding Python UDFs in SparkSQL.
There are 2 cases
[
https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18634:
Summary: Corruption and Correctness issues with exploding Python UDFs
(was: Issues with exploding
[
https://issues.apache.org/jira/browse/SPARK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18634:
Description:
There are some weird issues with exploding Python UDFs in SparkSQL.
There are 2 cases
Burak Yavuz created SPARK-18634:
---
Summary: Issues with exploding Python UDFs
Key: SPARK-18634
URL: https://issues.apache.org/jira/browse/SPARK-18634
Project: Spark
Issue Type: Bug
Com
[
https://issues.apache.org/jira/browse/SPARK-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15696337#comment-15696337
]
Burak Yavuz commented on SPARK-18407:
-
This is also resolved as part of
https://issu
[
https://issues.apache.org/jira/browse/SPARK-18510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15681677#comment-15681677
]
Burak Yavuz commented on SPARK-18510:
-
No. Working on a separate fix
> Partition sch
[
https://issues.apache.org/jira/browse/SPARK-18510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15680328#comment-15680328
]
Burak Yavuz commented on SPARK-18510:
-
cc [~r...@databricks.com] I marked this as a b
[
https://issues.apache.org/jira/browse/SPARK-18510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18510:
Description:
Not sure if this is a regression from 2.0 to 2.1. I was investigating this for
Struct
Burak Yavuz created SPARK-18510:
---
Summary: Partition schema inference corrupts data
Key: SPARK-18510
URL: https://issues.apache.org/jira/browse/SPARK-18510
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-18218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15677367#comment-15677367
]
Burak Yavuz commented on SPARK-18218:
-
[~WeichenXu123] You are correct, this would be
[
https://issues.apache.org/jira/browse/SPARK-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18493:
Component/s: PySpark
> Add withWatermark and checkpoint to python dataframe
> -
Burak Yavuz created SPARK-18493:
---
Summary: Add withWatermark and checkpoint to python dataframe
Key: SPARK-18493
URL: https://issues.apache.org/jira/browse/SPARK-18493
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674535#comment-15674535
]
Burak Yavuz commented on SPARK-18475:
-
[~c...@koeninger.org] I don't see where you ma
[
https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15674254#comment-15674254
]
Burak Yavuz commented on SPARK-18475:
-
[~ofirm] Thanks for your comment. I've seen si
Burak Yavuz created SPARK-18475:
---
Summary: Be able to provide higher parallelization for
StructuredStreaming Kafka Source
Key: SPARK-18475
URL: https://issues.apache.org/jira/browse/SPARK-18475
Project:
Burak Yavuz created SPARK-18465:
---
Summary: Uncache Table shouldn't throw an exception when table
doesn't exist
Key: SPARK-18465
URL: https://issues.apache.org/jira/browse/SPARK-18465
Project: Spark
Burak Yavuz created SPARK-18342:
---
Summary: HDFSBackedStateStore can fail to rename files causing
snapshotting and recovery to fail
Key: SPARK-18342
URL: https://issues.apache.org/jira/browse/SPARK-18342
Burak Yavuz created SPARK-18339:
---
Summary: Don't push down current_timestamp for filters in
StructuredStreaming
Key: SPARK-18339
URL: https://issues.apache.org/jira/browse/SPARK-18339
Project: Spark
Burak Yavuz created SPARK-18337:
---
Summary: Memory Sink should be able to recover from checkpoints in
Complete OutputMode
Key: SPARK-18337
URL: https://issues.apache.org/jira/browse/SPARK-18337
Project:
[
https://issues.apache.org/jira/browse/SPARK-18261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15635014#comment-15635014
]
Burak Yavuz commented on SPARK-18261:
-
Go for it!
> Add statistics to MemorySink
Burak Yavuz created SPARK-18261:
---
Summary: Add statistics to MemorySink for joining
Key: SPARK-18261
URL: https://issues.apache.org/jira/browse/SPARK-18261
Project: Spark
Issue Type: New Featu
Burak Yavuz created SPARK-18260:
---
Summary: from_json can throw a better exception when it can't find
the column or be nullSafe
Key: SPARK-18260
URL: https://issues.apache.org/jira/browse/SPARK-18260
Pro
[
https://issues.apache.org/jira/browse/SPARK-17879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15627421#comment-15627421
]
Burak Yavuz commented on SPARK-17879:
-
We should be doing the second. What you said m
Burak Yavuz created SPARK-18142:
---
Summary: Spark Master tries to launch workers 145 times within 1
minute
Key: SPARK-18142
URL: https://issues.apache.org/jira/browse/SPARK-18142
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-18142:
Component/s: Spark Core
> Spark Master tries to launch workers 145 times within 1 minute
>
Burak Yavuz created SPARK-17921:
---
Summary: checkpointLocation being set in memory streams fail after
restart. Should fail fast
Key: SPARK-17921
URL: https://issues.apache.org/jira/browse/SPARK-17921
Pro
Burak Yavuz created SPARK-17879:
---
Summary: Don't compact metadata logs constantly into a single
compacted file
Key: SPARK-17879
URL: https://issues.apache.org/jira/browse/SPARK-17879
Project: Spark
Burak Yavuz created SPARK-17876:
---
Summary: Write StructuredStreaming WAL to a stream instead of
materializing all at once
Key: SPARK-17876
URL: https://issues.apache.org/jira/browse/SPARK-17876
Project:
[
https://issues.apache.org/jira/browse/SPARK-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Burak Yavuz updated SPARK-17754:
Component/s: Web UI
SQL
> DataFrame reader and writer don't show Input/Output metr
Burak Yavuz created SPARK-17754:
---
Summary: DataFrame reader and writer don't show Input/Output
metrics in Spark UI
Key: SPARK-17754
URL: https://issues.apache.org/jira/browse/SPARK-17754
Project: Spark
101 - 200 of 349 matches
Mail list logo