Jose Torres created SPARK-42750:
---
Summary: Support INSERT INTO by name
Key: SPARK-42750
URL: https://issues.apache.org/jira/browse/SPARK-42750
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-35246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres updated SPARK-35246:
Summary: Streaming-batch intersects are incorrectly allowed through
UnsupportedOperationsChecker
Jose Torres created SPARK-35246:
---
Summary: Disable intersects for all streaming queries
Key: SPARK-35246
URL: https://issues.apache.org/jira/browse/SPARK-35246
Project: Spark
Issue Type: Bug
Jose Torres created SPARK-29468:
---
Summary: Floating point literals produce incorrect SQL
Key: SPARK-29468
URL: https://issues.apache.org/jira/browse/SPARK-29468
Project: Spark
Issue Type: Bug
Jose Torres created SPARK-29103:
---
Summary: CheckAnalysis for data source V2 ALTER TABLE ignores case
sensitivity
Key: SPARK-29103
URL: https://issues.apache.org/jira/browse/SPARK-29103
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-26046.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25518
[
https://issues.apache.org/jira/browse/SPARK-28190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911678#comment-16911678
]
Jose Torres commented on SPARK-28190:
-
Yeah, I think an SPIP is needed here. It sounds like we're
[
https://issues.apache.org/jira/browse/SPARK-28223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-28223.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 25023
Jose Torres created SPARK-28223:
---
Summary: stream-stream joins should fail unsupported checker in
update mode
Key: SPARK-28223
URL: https://issues.apache.org/jira/browse/SPARK-28223
Project: Spark
Jose Torres created SPARK-27711:
---
Summary: InputFileBlockHolder should be unset at the end of tasks
Key: SPARK-27711
URL: https://issues.apache.org/jira/browse/SPARK-27711
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-27391.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24301
Jose Torres created SPARK-27391:
---
Summary: deadlock in ContinuousExecution unit tests
Key: SPARK-27391
URL: https://issues.apache.org/jira/browse/SPARK-27391
Project: Spark
Issue Type: Bug
Jose Torres created SPARK-27253:
---
Summary: SparkSession clone discards SQLConf overrides in favor of
SparkConf defaults
Key: SPARK-27253
URL: https://issues.apache.org/jira/browse/SPARK-27253
Project:
[
https://issues.apache.org/jira/browse/SPARK-24541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758488#comment-16758488
]
Jose Torres commented on SPARK-24541:
-
I'm not gonna lie, I didn't put a tremendous amount of
[
https://issues.apache.org/jira/browse/SPARK-26170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-26170.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23142
[
https://issues.apache.org/jira/browse/SPARK-23098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606758#comment-16606758
]
Jose Torres commented on SPARK-23098:
-
SPARK-23362 migrated the (microbatch) streaming source. This
Jose Torres created SPARK-25204:
---
Summary: rate source test is flaky
Key: SPARK-25204
URL: https://issues.apache.org/jira/browse/SPARK-25204
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-23556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-23556.
-
Resolution: Fixed
> design doc for write side
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-23557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-23557.
-
Resolution: Done
> design doc for read side
>
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-23557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525308#comment-16525308
]
Jose Torres commented on SPARK-23557:
-
[
https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525307#comment-16525307
]
Jose Torres commented on SPARK-23102:
-
Yeah, KafkaStreamWriter already took care of this issue. I
[
https://issues.apache.org/jira/browse/SPARK-23102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-23102.
-
Resolution: Duplicate
> Migrate kafka sink
> --
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-23014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525305#comment-16525305
]
Jose Torres commented on SPARK-23014:
-
I'm not currently. I ran into a problem trying to make
Jose Torres created SPARK-24541:
---
Summary: TCP based shuffle
Key: SPARK-24541
URL: https://issues.apache.org/jira/browse/SPARK-24541
Project: Spark
Issue Type: Sub-task
Components:
Jose Torres created SPARK-24460:
---
Summary: exactly-once mode
Key: SPARK-24460
URL: https://issues.apache.org/jira/browse/SPARK-24460
Project: Spark
Issue Type: Sub-task
Components:
Jose Torres created SPARK-24459:
---
Summary: watermarks
Key: SPARK-24459
URL: https://issues.apache.org/jira/browse/SPARK-24459
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16498772#comment-16498772
]
Jose Torres commented on SPARK-24374:
-
Yeah, continuous processing (SPARK-20928) is another good use
Jose Torres created SPARK-24386:
---
Summary: implement continuous processing coalesce(1)
Key: SPARK-24386
URL: https://issues.apache.org/jira/browse/SPARK-24386
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489648#comment-16489648
]
Jose Torres edited comment on SPARK-24036 at 5/24/18 8:23 PM:
--
I've been
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489648#comment-16489648
]
Jose Torres edited comment on SPARK-24036 at 5/24/18 8:22 PM:
--
I've been
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489727#comment-16489727
]
Jose Torres commented on SPARK-24036:
-
That's out of scope - the shuffle reader and writer work in
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489661#comment-16489661
]
Jose Torres commented on SPARK-23416:
-
Do you know how to drive that? I'm not sure what the process
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489648#comment-16489648
]
Jose Torres commented on SPARK-24036:
-
I've been notified of
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481740#comment-16481740
]
Jose Torres commented on SPARK-23416:
-
No problem. I've been working on this since last week.
>
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481739#comment-16481739
]
Jose Torres commented on SPARK-23504:
-
The test run posted appears to be very old - the most recent
[
https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474993#comment-16474993
]
Jose Torres commented on SPARK-24234:
-
I'll work on this.
> create the bottom-of-task RDD with row
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470552#comment-16470552
]
Jose Torres commented on SPARK-24036:
-
My concern isn't that we'll have to write more code, but that
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469863#comment-16469863
]
Jose Torres commented on SPARK-24036:
-
The way I was envisioning it, there would be four kinds of
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469801#comment-16469801
]
Jose Torres commented on SPARK-24036:
-
~[~XuanYuan]
Since it seems we've reached broad consensus on
[
https://issues.apache.org/jira/browse/SPARK-24041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres resolved SPARK-24041.
-
Resolution: Not A Problem
> add flag to remove whitelist of continuous processing operators
>
[
https://issues.apache.org/jira/browse/SPARK-24041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469800#comment-16469800
]
Jose Torres commented on SPARK-24041:
-
This isn't needed, we can just disable
Jose Torres created SPARK-24237:
---
Summary: continuous shuffle dependency
Key: SPARK-24237
URL: https://issues.apache.org/jira/browse/SPARK-24237
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-24236:
---
Summary: continuous replacement for ShuffleExchangeExec
Key: SPARK-24236
URL: https://issues.apache.org/jira/browse/SPARK-24236
Project: Spark
Issue Type:
Jose Torres created SPARK-24235:
---
Summary: create the top-of-task RDD sending rows to the remote
buffer
Key: SPARK-24235
URL: https://issues.apache.org/jira/browse/SPARK-24235
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres updated SPARK-24234:
Summary: create the bottom-of-task RDD with row buffer (was: Write RDD
with row buffer)
> create
Jose Torres created SPARK-24234:
---
Summary: Write RDD with row buffer
Key: SPARK-24234
URL: https://issues.apache.org/jira/browse/SPARK-24234
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-23703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464853#comment-16464853
]
Jose Torres commented on SPARK-23703:
-
Up to you. It might be worth asking if there are use cases for
Jose Torres created SPARK-24183:
---
Summary: add unit tests for ContinuousDataReader hook
Key: SPARK-24183
URL: https://issues.apache.org/jira/browse/SPARK-24183
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463190#comment-16463190
]
Jose Torres commented on SPARK-23703:
-
No, I don't know of any actual use cases for this. I think
[
https://issues.apache.org/jira/browse/SPARK-23703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462584#comment-16462584
]
Jose Torres commented on SPARK-23703:
-
I'm no longer entirely convinced that this (and the parent
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454788#comment-16454788
]
Jose Torres commented on SPARK-24036:
-
[
https://issues.apache.org/jira/browse/SPARK-24036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16452576#comment-16452576
]
Jose Torres commented on SPARK-24036:
-
The broader Spark community is of course always welcome to
Jose Torres created SPARK-24041:
---
Summary: add flag to remove whitelist of continuous processing
operators
Key: SPARK-24041
URL: https://issues.apache.org/jira/browse/SPARK-24041
Project: Spark
Jose Torres created SPARK-24039:
---
Summary: remove restarting iterators hack
Key: SPARK-24039
URL: https://issues.apache.org/jira/browse/SPARK-24039
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-24040:
---
Summary: support single partition aggregates
Key: SPARK-24040
URL: https://issues.apache.org/jira/browse/SPARK-24040
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-24038:
---
Summary: refactor continuous write exec to its own class
Key: SPARK-24038
URL: https://issues.apache.org/jira/browse/SPARK-24038
Project: Spark
Issue Type:
Jose Torres created SPARK-24037:
---
Summary: stateful operators
Key: SPARK-24037
URL: https://issues.apache.org/jira/browse/SPARK-24037
Project: Spark
Issue Type: Sub-task
Components:
Jose Torres created SPARK-24036:
---
Summary: Stateful operators in continuous processing
Key: SPARK-24036
URL: https://issues.apache.org/jira/browse/SPARK-24036
Project: Spark
Issue Type:
Jose Torres created SPARK-23887:
---
Summary: update query progress
Key: SPARK-23887
URL: https://issues.apache.org/jira/browse/SPARK-23887
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23886:
---
Summary: update query.status
Key: SPARK-23886
URL: https://issues.apache.org/jira/browse/SPARK-23886
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423137#comment-16423137
]
Jose Torres commented on SPARK-23504:
-
We've replaced the hacky RateSourceV2 implementation with a
[
https://issues.apache.org/jira/browse/SPARK-23747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422613#comment-16422613
]
Jose Torres edited comment on SPARK-23747 at 4/2/18 3:26 PM:
-
I mean testing
[
https://issues.apache.org/jira/browse/SPARK-23747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422613#comment-16422613
]
Jose Torres commented on SPARK-23747:
-
I mean testing the internal logic. We'd want to pull in
Jose Torres created SPARK-23826:
---
Summary: TestHiveSparkSession should set default session
Key: SPARK-23826
URL: https://issues.apache.org/jira/browse/SPARK-23826
Project: Spark
Issue Type:
Jose Torres created SPARK-23808:
---
Summary: Test spark sessions should set default session
Key: SPARK-23808
URL: https://issues.apache.org/jira/browse/SPARK-23808
Project: Spark
Issue Type: Bug
Jose Torres created SPARK-23788:
---
Summary: Race condition in StreamingQuerySuite
Key: SPARK-23788
URL: https://issues.apache.org/jira/browse/SPARK-23788
Project: Spark
Issue Type: Bug
Jose Torres created SPARK-23748:
---
Summary: Support select from temp tables
Key: SPARK-23748
URL: https://issues.apache.org/jira/browse/SPARK-23748
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23747:
---
Summary: Add EpochCoordinator unit tests
Key: SPARK-23747
URL: https://issues.apache.org/jira/browse/SPARK-23747
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23703:
---
Summary: Collapse sequential watermarks
Key: SPARK-23703
URL: https://issues.apache.org/jira/browse/SPARK-23703
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23702:
---
Summary: Forbid watermarks on both sides of a streaming aggregate
Key: SPARK-23702
URL: https://issues.apache.org/jira/browse/SPARK-23702
Project: Spark
Issue
Jose Torres created SPARK-23701:
---
Summary: Multiple sequential watermarks are not supported
Key: SPARK-23701
URL: https://issues.apache.org/jira/browse/SPARK-23701
Project: Spark
Issue Type:
Jose Torres created SPARK-23688:
---
Summary: Refactor tests away from rate source
Key: SPARK-23688
URL: https://issues.apache.org/jira/browse/SPARK-23688
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23687:
---
Summary: Add MemoryStream
Key: SPARK-23687
URL: https://issues.apache.org/jira/browse/SPARK-23687
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-23556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393300#comment-16393300
]
Jose Torres commented on SPARK-23556:
-
Doc:
[
https://issues.apache.org/jira/browse/SPARK-23325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388399#comment-16388399
]
Jose Torres commented on SPARK-23325:
-
How hard would it be to just declare that InternalRow is
[
https://issues.apache.org/jira/browse/SPARK-23574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres updated SPARK-23574:
Component/s: (was: Structured Streaming)
Spark Core
> SinglePartition in data
Jose Torres created SPARK-23574:
---
Summary: SinglePartition in data source V2 scan
Key: SPARK-23574
URL: https://issues.apache.org/jira/browse/SPARK-23574
Project: Spark
Issue Type: Bug
Jose Torres created SPARK-23561:
---
Summary: make StreamWriter not a DataSourceWriter subclass
Key: SPARK-23561
URL: https://issues.apache.org/jira/browse/SPARK-23561
Project: Spark
Issue Type:
Jose Torres created SPARK-23559:
---
Summary: add epoch ID to data writer factory
Key: SPARK-23559
URL: https://issues.apache.org/jira/browse/SPARK-23559
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23558:
---
Summary: clean up StreamWriter factory lifecycle
Key: SPARK-23558
URL: https://issues.apache.org/jira/browse/SPARK-23558
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23557:
---
Summary: design doc for read side
Key: SPARK-23557
URL: https://issues.apache.org/jira/browse/SPARK-23557
Project: Spark
Issue Type: Sub-task
Jose Torres created SPARK-23556:
---
Summary: design doc for write side
Key: SPARK-23556
URL: https://issues.apache.org/jira/browse/SPARK-23556
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377897#comment-16377897
]
Jose Torres edited comment on SPARK-23504 at 2/27/18 1:56 AM:
--
I noticed
[
https://issues.apache.org/jira/browse/SPARK-23504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377897#comment-16377897
]
Jose Torres commented on SPARK-23504:
-
I've
> Flaky test: RateSourceV2Suite.basic microbatch
Jose Torres created SPARK-23503:
---
Summary: continuous execution should sequence committed epochs
Key: SPARK-23503
URL: https://issues.apache.org/jira/browse/SPARK-23503
Project: Spark
Issue
Jose Torres created SPARK-23491:
---
Summary: continuous symptom
Key: SPARK-23491
URL: https://issues.apache.org/jira/browse/SPARK-23491
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-23369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370832#comment-16370832
]
Jose Torres commented on SPARK-23369:
-
Still seeing this in e.g.
Jose Torres created SPARK-23444:
---
Summary: would like to be able to cancel jobs cleanly
Key: SPARK-23444
URL: https://issues.apache.org/jira/browse/SPARK-23444
Project: Spark
Issue Type: Wish
Jose Torres created SPARK-23441:
---
Summary: Remove interrupts from ContinuousExecution
Key: SPARK-23441
URL: https://issues.apache.org/jira/browse/SPARK-23441
Project: Spark
Issue Type:
Jose Torres created SPARK-23440:
---
Summary: Clean up StreamExecution interrupts
Key: SPARK-23440
URL: https://issues.apache.org/jira/browse/SPARK-23440
Project: Spark
Issue Type: Improvement
Jose Torres created SPARK-23417:
---
Summary: pyspark tests give wrong sbt instructions
Key: SPARK-23417
URL: https://issues.apache.org/jira/browse/SPARK-23417
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362941#comment-16362941
]
Jose Torres edited comment on SPARK-23416 at 2/13/18 7:48 PM:
--
I think I see
[
https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362941#comment-16362941
]
Jose Torres commented on SPARK-23416:
-
I think I see the problem.
* StreamExecution.stop() works by
Jose Torres created SPARK-23416:
---
Summary: flaky test:
org.apache.spark.sql.kafka010.KafkaSourceStressForDontFailOnDataLossSuite.stress
test for failOnDataLoss=false
Key: SPARK-23416
URL:
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358143#comment-16358143
]
Jose Torres commented on SPARK-23096:
-
Sure! Happy to have help.
The "ratev2" source is just
[
https://issues.apache.org/jira/browse/SPARK-23221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jose Torres updated SPARK-23221:
Description: Currently,
`KafkaContinuousSourceStressForDontFailOnDataLossSuite` runs on only 2
Jose Torres created SPARK-23221:
---
Summary: Fix KafkaContinuousSourceStressForDontFailOnDataLossSuite
to run with enough cores
Key: SPARK-23221
URL: https://issues.apache.org/jira/browse/SPARK-23221
Jose Torres created SPARK-23196:
---
Summary: Unify continuous and microbatch V2 sinks
Key: SPARK-23196
URL: https://issues.apache.org/jira/browse/SPARK-23196
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-23097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331726#comment-16331726
]
Jose Torres commented on SPARK-23097:
-
Certainly! There's no specific plan right now. I'm working on
Jose Torres created SPARK-23102:
---
Summary: Migrate kafka sink
Key: SPARK-23102
URL: https://issues.apache.org/jira/browse/SPARK-23102
Project: Spark
Issue Type: Sub-task
Components:
1 - 100 of 139 matches
Mail list logo
