Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22473
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/22473#discussion_r221026721
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -609,13 +609,13 @@ class SparkConf(loadDefaults: Boolean) extends
Cloneable with
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22473
Pushed updates. @zsxwing , I can add refactor Executor.scala so testing is
easier, but I had hoped that doing it this way would allow more testing for
reportHeartbeat in the future. We have
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22473
@zsxwing for review
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
GitHub user mukulmurthy opened a pull request:
https://github.com/apache/spark/pull/22473
[SPARK-25449][CORE] Heartbeat shouldn't include accumulators for zero
metrics
## What changes were proposed in this pull request?
Heartbeat shouldn't include accumulator
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/22386#discussion_r216750746
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStoreRDD.scala
---
@@ -74,9 +74,14 @@ class StateStoreRDD[T
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22386
> ```
> If a continuous processing job runs and the same thread gets reused for a
microbatch execution job in the same environment
> ```
> Little confuse about this sce
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22386
@tdas and @jose-torres for review
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands
GitHub user mukulmurthy opened a pull request:
https://github.com/apache/spark/pull/22386
[SPARK-25399] Continuous processing state should not affect microbatch
execution jobs
## What changes were proposed in this pull request?
The leftover state from running a continuous
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22176
@zsxwing , @JoshRosen , @marmbrus for review and merge.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22176
Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22176
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/22176
@JoshRosen @zsxwing @marmbrus to merge.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user mukulmurthy opened a pull request:
https://github.com/apache/spark/pull/22176
[SPARK-25181][CORE] Limit Thread Pool size in BlockManager Master and Slave
endpoints
## What changes were proposed in this pull request?
Limit Thread Pool size in BlockManager Master
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/21662
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/21662
Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21662#discussion_r199606669
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingLimitExec.scala
---
@@ -0,0 +1,96 @@
+/*
+ * Licensed to
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21662#discussion_r199582352
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingLimitExec.scala
---
@@ -0,0 +1,96 @@
+/*
+ * Licensed to
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21662#discussion_r199300670
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/MemorySinkSuite.scala
---
@@ -70,35 +68,9 @@ class MemorySinkSuite extends
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/21662
@tdas @marmbrus @jose-torres for review
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21662#discussion_r199006704
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala ---
@@ -72,6 +72,8 @@ abstract class SparkStrategies extends
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21662#discussion_r199006582
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/UnsupportedOperationChecker.scala
---
@@ -315,8 +315,10 @@ object
GitHub user mukulmurthy opened a pull request:
https://github.com/apache/spark/pull/21662
[SPARK-24662][SQL][SS] Support limit in structured streaming
## What changes were proposed in this pull request?
Support the LIMIT operator in structured streaming.
For
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21559#discussion_r195809395
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala
---
@@ -221,26 +222,72 @@ class MemoryStreamInputPartition
Github user mukulmurthy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21559#discussion_r195268130
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/memory.scala
---
@@ -294,6 +333,16 @@ class MemorySink(val schema
Github user mukulmurthy commented on the issue:
https://github.com/apache/spark/pull/21559
@jose-torres @brkyvz for review
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands
GitHub user mukulmurthy opened a pull request:
https://github.com/apache/spark/pull/21559
[SPARK-24525][SS] Provide an option to limit number of rows in a MemorySink
## What changes were proposed in this pull request?
Provide an option to limit number of rows in a
27 matches
Mail list logo
