[jira] [Assigned] (SPARK-13696) Remove BlockStore interface to more cleanly reflect different memory and disk store responsibilities

[ https://issues.apache.org/jira/browse/SPARK-13696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13696: Assignee: Josh Rosen (was: Apache Spark) > Remove BlockStore interface to more cleanly re

[jira] [Assigned] (SPARK-13696) Remove BlockStore interface to more cleanly reflect different memory and disk store responsibilities

[ https://issues.apache.org/jira/browse/SPARK-13696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13696: Assignee: Apache Spark (was: Josh Rosen) > Remove BlockStore interface to more cleanly re

[jira] [Commented] (SPARK-13696) Remove BlockStore interface to more cleanly reflect different memory and disk store responsibilities

[ https://issues.apache.org/jira/browse/SPARK-13696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181527#comment-15181527 ] Apache Spark commented on SPARK-13696: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-13696) Remove BlockStore interface to more cleanly reflect different memory and disk store responsibilities

Josh Rosen created SPARK-13696: -- Summary: Remove BlockStore interface to more cleanly reflect different memory and disk store responsibilities Key: SPARK-13696 URL: https://issues.apache.org/jira/browse/SPARK-13696

[jira] [Assigned] (SPARK-13695) Don't cache MEMORY_AND_DISK blocks as bytes in memory store when reading spills

[ https://issues.apache.org/jira/browse/SPARK-13695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13695: Assignee: Apache Spark (was: Josh Rosen) > Don't cache MEMORY_AND_DISK blocks as bytes in

[jira] [Commented] (SPARK-13695) Don't cache MEMORY_AND_DISK blocks as bytes in memory store when reading spills

[ https://issues.apache.org/jira/browse/SPARK-13695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181518#comment-15181518 ] Apache Spark commented on SPARK-13695: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-13695) Don't cache MEMORY_AND_DISK blocks as bytes in memory store when reading spills

[ https://issues.apache.org/jira/browse/SPARK-13695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13695: Assignee: Josh Rosen (was: Apache Spark) > Don't cache MEMORY_AND_DISK blocks as bytes in

[jira] [Updated] (SPARK-13695) Don't cache MEMORY_AND_DISK blocks as bytes in memory store when reading spills

[ https://issues.apache.org/jira/browse/SPARK-13695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13695: --- Summary: Don't cache MEMORY_AND_DISK blocks as bytes in memory store when reading spills (was: Don't

[jira] [Created] (SPARK-13695) Don't cache blocks at different serialization level when reading back from disk

Josh Rosen created SPARK-13695: -- Summary: Don't cache blocks at different serialization level when reading back from disk Key: SPARK-13695 URL: https://issues.apache.org/jira/browse/SPARK-13695 Project:

[jira] [Issue Comment Deleted] (SPARK-13073) creating R like summary for logistic Regression in Spark - Scala

[ https://issues.apache.org/jira/browse/SPARK-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gayathri Murali updated SPARK-13073: Comment: was deleted (was: I can work on this, can you please assign it to me?) > creating

[jira] [Commented] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181418#comment-15181418 ] Neelesh Srinivas Salian commented on SPARK-7505: Does this still apply ? [

[jira] [Commented] (SPARK-6043) Error when trying to rename table with alter table after using INSERT OVERWITE to populate the table

[ https://issues.apache.org/jira/browse/SPARK-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181416#comment-15181416 ] Neelesh Srinivas Salian commented on SPARK-6043: [~tleftwich] is this stil

[jira] [Commented] (SPARK-4549) Support BigInt -> Decimal in convertToCatalyst in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181398#comment-15181398 ] Neelesh Srinivas Salian commented on SPARK-4549: [~huangjs] could you plea

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181369#comment-15181369 ] Gayathri Murali commented on SPARK-13641: - Yes, it looks intentional to carry met

[jira] [Assigned] (SPARK-13694) QueryPlan.expressions should always include all expressions

[ https://issues.apache.org/jira/browse/SPARK-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13694: Assignee: (was: Apache Spark) > QueryPlan.expressions should always include all expres

[jira] [Commented] (SPARK-13694) QueryPlan.expressions should always include all expressions

[ https://issues.apache.org/jira/browse/SPARK-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181367#comment-15181367 ] Apache Spark commented on SPARK-13694: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-13694) QueryPlan.expressions should always include all expressions

[ https://issues.apache.org/jira/browse/SPARK-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13694: Assignee: Apache Spark > QueryPlan.expressions should always include all expressions > ---

[jira] [Commented] (SPARK-13690) UnsafeShuffleWriterSuite fails on arm64 (SnappyError, no native library is found)

[ https://issues.apache.org/jira/browse/SPARK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181362#comment-15181362 ] Santiago M. Mola commented on SPARK-13690: -- snappy-java does not have any fallba

[jira] [Created] (SPARK-13694) QueryPlan.expressions should always include all expressions

Wenchen Fan created SPARK-13694: --- Summary: QueryPlan.expressions should always include all expressions Key: SPARK-13694 URL: https://issues.apache.org/jira/browse/SPARK-13694 Project: Spark Is

[jira] [Resolved] (SPARK-12073) Backpressure causes individual Kafka partitions to lag

[ https://issues.apache.org/jira/browse/SPARK-12073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12073. -- Resolution: Fixed Assignee: Jason White Fix Version/s: 2.0.0 > Backpressure cau

[jira] [Updated] (SPARK-12073) Backpressure causes individual Kafka partitions to lag

[ https://issues.apache.org/jira/browse/SPARK-12073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12073: - Affects Version/s: 1.6.1 1.6.0 > Backpressure causes individual Kafka part

[jira] [Assigned] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13693: Assignee: Apache Spark (was: Shixiong Zhu) > Flaky test: o.a.s.streaming.MapWithStateSuit

[jira] [Assigned] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13693: Assignee: Shixiong Zhu (was: Apache Spark) > Flaky test: o.a.s.streaming.MapWithStateSuit

[jira] [Commented] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181303#comment-15181303 ] Apache Spark commented on SPARK-13693: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

[ https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13692: Assignee: Apache Spark > Fix trivial Coverity/Checkstyle defects > ---

[jira] [Assigned] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

[ https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13692: Assignee: (was: Apache Spark) > Fix trivial Coverity/Checkstyle defects >

[jira] [Commented] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

[ https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181298#comment-15181298 ] Apache Spark commented on SPARK-13692: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181294#comment-15181294 ] Xusen Yin commented on SPARK-13641: --- Or maybe we try to find another way to extract the

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15181130#comment-15181130 ] Xusen Yin commented on SPARK-13641: --- I am not quite familiar with it but I think it's i

[jira] [Updated] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

[ https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13692: -- Description: This issue fixes the following potential bugs and Java coding style detected by C

[jira] [Created] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

Shixiong Zhu created SPARK-13693: Summary: Flaky test: o.a.s.streaming.MapWithStateSuite Key: SPARK-13693 URL: https://issues.apache.org/jira/browse/SPARK-13693 Project: Spark Issue Type: Tes

[jira] [Created] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

Dongjoon Hyun created SPARK-13692: - Summary: Fix trivial Coverity/Checkstyle defects Key: SPARK-13692 URL: https://issues.apache.org/jira/browse/SPARK-13692 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13605) Bean encoder cannot handle nonbean properties - no way to Encode nonbean Java objects with columns

[ https://issues.apache.org/jira/browse/SPARK-13605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13605: - Fix Version/s: (was: 1.6.0) > Bean encoder cannot handle nonbean properties - no way

[jira] [Updated] (SPARK-13605) Bean encoder cannot handle nonbean properties - no way to Encode nonbean Java objects with columns

[ https://issues.apache.org/jira/browse/SPARK-13605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13605: - Target Version/s: 2.0.0 (was: 1.6.0) > Bean encoder cannot handle nonbean properties - n

[jira] [Updated] (SPARK-13605) Bean encoder cannot handle nonbean properties - no way to Encode nonbean Java objects with columns

[ https://issues.apache.org/jira/browse/SPARK-13605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13605: - Component/s: SQL > Bean encoder cannot handle nonbean properties - no way to Encode nonbe

[jira] [Updated] (SPARK-13605) Bean encoder cannot handle nonbean properties - no way to Encode nonbean Java objects with columns

[ https://issues.apache.org/jira/browse/SPARK-13605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13605: - Description: in the current environment the only way to turn a List or JavaRDD into a Da

[jira] [Updated] (SPARK-13691) Scala and Python generate inconsistent results

[ https://issues.apache.org/jira/browse/SPARK-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13691: - Affects Version/s: 1.4.1 1.5.2 1.6.0 > Scala and Py

[jira] [Resolved] (SPARK-13255) Integrate vectorized parquet scan with whole stage codegen.

[ https://issues.apache.org/jira/browse/SPARK-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13255. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11435 [https://github.

[jira] [Commented] (SPARK-13691) Scala and Python generate inconsistent results

[ https://issues.apache.org/jira/browse/SPARK-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180724#comment-15180724 ] Shixiong Zhu commented on SPARK-13691: -- Ideally, PySpark should always capture all v

[jira] [Commented] (SPARK-10086) Flaky StreamingKMeans test in PySpark

[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180723#comment-15180723 ] Shixiong Zhu commented on SPARK-10086: -- I opened SPARK-13691 to describe the root is

[jira] [Created] (SPARK-13691) Scala and Python generate inconsistent results

Shixiong Zhu created SPARK-13691: Summary: Scala and Python generate inconsistent results Key: SPARK-13691 URL: https://issues.apache.org/jira/browse/SPARK-13691 Project: Spark Issue Type: Bu

[jira] [Resolved] (SPARK-13459) Separate Alive and Dead Executors in Executor Totals Table

[ https://issues.apache.org/jira/browse/SPARK-13459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-13459. --- Resolution: Fixed Fix Version/s: 2.0.0 > Separate Alive and Dead Executors in Executor

[jira] [Commented] (SPARK-13690) UnsafeShuffleWriterSuite fails on arm64 (SnappyError, no native library is found)

[ https://issues.apache.org/jira/browse/SPARK-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180713#comment-15180713 ] Sean Owen commented on SPARK-13690: --- Hm, I doubt Spark would be considered supported on

[jira] [Updated] (SPARK-13459) Separate Alive and Dead Executors in Executor Totals Table

[ https://issues.apache.org/jira/browse/SPARK-13459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13459: -- Assignee: Alex Bozarth > Separate Alive and Dead Executors in Executor Totals Table > -

[jira] [Resolved] (SPARK-13523) Reuse the exchanges in a query

[ https://issues.apache.org/jira/browse/SPARK-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamstra resolved SPARK-13523. -- Resolution: Duplicate > Reuse the exchanges in a query > -- > >

[jira] [Created] (SPARK-13690) UnsafeShuffleWriterSuite fails on arm64 (SnappyError, no native library is found)

Santiago M. Mola created SPARK-13690: Summary: UnsafeShuffleWriterSuite fails on arm64 (SnappyError, no native library is found) Key: SPARK-13690 URL: https://issues.apache.org/jira/browse/SPARK-13690

[jira] [Assigned] (SPARK-13689) Move some methods in CatalystQl to a util object

[ https://issues.apache.org/jira/browse/SPARK-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13689: Assignee: Andrew Or (was: Apache Spark) > Move some methods in CatalystQl to a util objec

[jira] [Commented] (SPARK-13689) Move some methods in CatalystQl to a util object

[ https://issues.apache.org/jira/browse/SPARK-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180673#comment-15180673 ] Apache Spark commented on SPARK-13689: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-13689) Move some methods in CatalystQl to a util object

[ https://issues.apache.org/jira/browse/SPARK-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13689: Assignee: Apache Spark (was: Andrew Or) > Move some methods in CatalystQl to a util objec

[jira] [Created] (SPARK-13689) Move some methods in CatalystQl to a util object

Andrew Or created SPARK-13689: - Summary: Move some methods in CatalystQl to a util object Key: SPARK-13689 URL: https://issues.apache.org/jira/browse/SPARK-13689 Project: Spark Issue Type: Sub-ta

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180663#comment-15180663 ] Mark Grover commented on SPARK-13670: - I have a mac, I can do some more testing. > s

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180643#comment-15180643 ] Marcelo Vanzin commented on SPARK-13670: Here's one that works regardless of the

[jira] [Commented] (SPARK-13688) Add option to use dynamic allocation even if spark.executor.instances is set.

[ https://issues.apache.org/jira/browse/SPARK-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180636#comment-15180636 ] Apache Spark commented on SPARK-13688: -- User 'rdblue' has created a pull request for

[jira] [Assigned] (SPARK-13688) Add option to use dynamic allocation even if spark.executor.instances is set.

[ https://issues.apache.org/jira/browse/SPARK-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13688: Assignee: (was: Apache Spark) > Add option to use dynamic allocation even if spark.exe

[jira] [Assigned] (SPARK-13688) Add option to use dynamic allocation even if spark.executor.instances is set.

[ https://issues.apache.org/jira/browse/SPARK-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13688: Assignee: Apache Spark > Add option to use dynamic allocation even if spark.executor.insta

[jira] [Updated] (SPARK-13688) Add option to use dynamic allocation even if spark.executor.instances is set.

[ https://issues.apache.org/jira/browse/SPARK-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated SPARK-13688: -- Affects Version/s: 1.6.0 > Add option to use dynamic allocation even if spark.executor.instances is set

[jira] [Created] (SPARK-13687) Cleanup pyspark temporary files

Damir created SPARK-13687: - Summary: Cleanup pyspark temporary files Key: SPARK-13687 URL: https://issues.apache.org/jira/browse/SPARK-13687 Project: Spark Issue Type: Improvement Component

[jira] [Updated] (SPARK-13688) Add option to use dynamic allocation even if spark.executor.instances is set.

[ https://issues.apache.org/jira/browse/SPARK-13688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated SPARK-13688: -- Component/s: YARN > Add option to use dynamic allocation even if spark.executor.instances is set. > ---

[jira] [Created] (SPARK-13688) Add option to use dynamic allocation even if spark.executor.instances is set.

Ryan Blue created SPARK-13688: - Summary: Add option to use dynamic allocation even if spark.executor.instances is set. Key: SPARK-13688 URL: https://issues.apache.org/jira/browse/SPARK-13688 Project: Spar

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180575#comment-15180575 ] holdenk commented on SPARK-13684: - It should (coverity doesn't trigger on any of the plac

[jira] [Assigned] (SPARK-13686) Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13686: Assignee: Apache Spark > Add a constructor parameter `reqParam` to (Streaming)LinearRegres

[jira] [Assigned] (SPARK-13686) Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13686: Assignee: (was: Apache Spark) > Add a constructor parameter `reqParam` to (Streaming)L

[jira] [Commented] (SPARK-13686) Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180567#comment-15180567 ] Apache Spark commented on SPARK-13686: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Updated] (SPARK-7179) Add pattern after "show tables" to filter desire tablename

[ https://issues.apache.org/jira/browse/SPARK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7179: Target Version/s: 2.0.0 > Add pattern after "show tables" to filter desire tablename > -

[jira] [Updated] (SPARK-13686) Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13686: -- Component/s: MLlib > Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithS

[jira] [Updated] (SPARK-13686) Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-13686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13686: -- Component/s: Streaming > Add a constructor parameter `reqParam` to (Streaming)LinearRegressionW

[jira] [Created] (SPARK-13686) Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD

Dongjoon Hyun created SPARK-13686: - Summary: Add a constructor parameter `reqParam` to (Streaming)LinearRegressionWithSGD Key: SPARK-13686 URL: https://issues.apache.org/jira/browse/SPARK-13686 Projec

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180554#comment-15180554 ] Marcelo Vanzin commented on SPARK-13684: If switching to AtomicLong gets rid of t

[jira] [Assigned] (SPARK-13685) Rename catalog.Catalog to ExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-13685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13685: Assignee: Apache Spark (was: Andrew Or) > Rename catalog.Catalog to ExternalCatalog > ---

[jira] [Commented] (SPARK-13685) Rename catalog.Catalog to ExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-13685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180551#comment-15180551 ] Apache Spark commented on SPARK-13685: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-13685) Rename catalog.Catalog to ExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-13685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13685: Assignee: Andrew Or (was: Apache Spark) > Rename catalog.Catalog to ExternalCatalog > ---

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180550#comment-15180550 ] holdenk commented on SPARK-13684: - We can use AtomicLong (so no need for using Doubles).

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180549#comment-15180549 ] Marcelo Vanzin commented on SPARK-13684: I don't think it could break unless nett

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180544#comment-15180544 ] Sean Owen commented on SPARK-13684: --- The alternative is AtomicDouble I suppose. If that

[jira] [Updated] (SPARK-13572) HiveContext reads avro Hive tables incorrectly

[ https://issues.apache.org/jira/browse/SPARK-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Fedor updated SPARK-13572: - Affects Version/s: 1.6.0 > HiveContext reads avro Hive tables incorrectly >

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180535#comment-15180535 ] Marcelo Vanzin commented on SPARK-13670: bq. And, it's guaranteed that Main would

[jira] [Created] (SPARK-13685) Rename catalog.Catalog to ExternalCatalog

Andrew Or created SPARK-13685: - Summary: Rename catalog.Catalog to ExternalCatalog Key: SPARK-13685 URL: https://issues.apache.org/jira/browse/SPARK-13685 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180516#comment-15180516 ] Mark Grover commented on SPARK-13670: - And, it's guaranteed that Main would never ret

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180515#comment-15180515 ] Marcelo Vanzin commented on SPARK-13684: It's not a real bug; netty guarantees th

[jira] [Created] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

holdenk created SPARK-13684: --- Summary: Possible unsafe bytesRead increment in StreamInterceptor Key: SPARK-13684 URL: https://issues.apache.org/jira/browse/SPARK-13684 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180489#comment-15180489 ] Marcelo Vanzin commented on SPARK-13670: Here's something a little ugly that work

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180479#comment-15180479 ] Marcelo Vanzin commented on SPARK-13670: Not a fan... you have to write the file

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180463#comment-15180463 ] Mark Grover commented on SPARK-13670: - Thanks for looking at this. What do you think

[jira] [Created] (SPARK-13683) Finalize the public interface for OutputWriter[Factory]

Michael Armbrust created SPARK-13683: Summary: Finalize the public interface for OutputWriter[Factory] Key: SPARK-13683 URL: https://issues.apache.org/jira/browse/SPARK-13683 Project: Spark

[jira] [Commented] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180456#comment-15180456 ] Anthony Brew commented on SPARK-12675: -- I'm hitting a bug similar to this also (same

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180455#comment-15180455 ] Marcelo Vanzin commented on SPARK-13670: Actually scrap that, it breaks things wh

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180444#comment-15180444 ] Marcelo Vanzin commented on SPARK-13670: Note that will probably leave a bash pro

[jira] [Commented] (SPARK-13670) spark-class doesn't bubble up error from launcher command

[ https://issues.apache.org/jira/browse/SPARK-13670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180427#comment-15180427 ] Marcelo Vanzin commented on SPARK-13670: After some fun playing with arcane bash

[jira] [Created] (SPARK-13682) Finalize the public API for FileFormat

Michael Armbrust created SPARK-13682: Summary: Finalize the public API for FileFormat Key: SPARK-13682 URL: https://issues.apache.org/jira/browse/SPARK-13682 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-13681) Reimplement CommitFailureTestRelationSuite

[ https://issues.apache.org/jira/browse/SPARK-13681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13681: - Description: This test case got broken by [#11509|https://github.com/apache/spark/pull/11

[jira] [Created] (SPARK-13681) Reimplement CommitFailureTestRelationSuite

Michael Armbrust created SPARK-13681: Summary: Reimplement CommitFailureTestRelationSuite Key: SPARK-13681 URL: https://issues.apache.org/jira/browse/SPARK-13681 Project: Spark Issue Type

[jira] [Resolved] (SPARK-13633) Move parser classes to o.a.s.sql.catalyst.parser package

[ https://issues.apache.org/jira/browse/SPARK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13633. --- Resolution: Fixed Fix Version/s: 2.0.0 > Move parser classes to o.a.s.sql.catalyst.parser pack

[jira] [Commented] (SPARK-13494) Cannot sort on a column which is of type "array"

[ https://issues.apache.org/jira/browse/SPARK-13494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180289#comment-15180289 ] Xiao Li commented on SPARK-13494: - Can you try the other newer versions? You know, a lot

[jira] [Updated] (SPARK-13680) Java UDAF with more than one intermediate argument returns wrong results

[ https://issues.apache.org/jira/browse/SPARK-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yael Aharon updated SPARK-13680: Attachment: setup.hql > Java UDAF with more than one intermediate argument returns wrong results >

[jira] [Commented] (SPARK-13434) Reduce Spark RandomForest memory footprint

[ https://issues.apache.org/jira/browse/SPARK-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180243#comment-15180243 ] Joseph K. Bradley commented on SPARK-13434: --- There are a few options here: * Te

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180241#comment-15180241 ] Joseph K. Bradley commented on SPARK-13048: --- I'd say the best fix would be to a

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180234#comment-15180234 ] Sean Owen commented on SPARK-13230: --- Thanks, that's a great analysis. It sounds like we

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:36 PM:

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:35 PM:

[jira] [Comment Edited] (SPARK-13230) HashMap.merged not working properly with Spark

[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180216#comment-15180216 ] Łukasz Gieroń edited comment on SPARK-13230 at 3/4/16 5:34 PM:

  1   2   >