[jira] [Comment Edited] (SPARK-12414) Remove closure serializer

[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075814#comment-15075814 ] Andrew Or edited comment on SPARK-12414 at 12/31/15 7:51 AM: -

[jira] [Commented] (SPARK-12414) Remove closure serializer

[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075814#comment-15075814 ] Andrew Or commented on SPARK-12414: --- It's also for code cleanup. Right now SparkEnv has

[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Motivation* Nowadays, customers have both SSDs(SATA SSD/PCIe SSD) and HDDs. SSDs have great perf

[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Motivation* Nowadays, customers have both SSDs(SATA SSD/PCIe SSD) and HDDs. SSDs have great perf

[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs(SATA SSD/PCIe SSD) and HDDs. SSDs have great performance

[jira] [Commented] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075783#comment-15075783 ] yucai commented on SPARK-12196: --- Hi Wei, We have updated the PR. I feel your RDD API chang

[jira] [Resolved] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12585. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10528 [https://github.

[jira] [Assigned] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-6166: --- Assignee: Shixiong Zhu > Add config to limit number of concurrent outbound connections for sh

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075757#comment-15075757 ] Shixiong Zhu commented on SPARK-6166: - Sure > Add config to limit number of concurren

[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is s

[jira] [Created] (SPARK-12590) Inconsistent behavior of randomSplit in YARN mode

Gaurav Kumar created SPARK-12590: Summary: Inconsistent behavior of randomSplit in YARN mode Key: SPARK-12590 URL: https://issues.apache.org/jira/browse/SPARK-12590 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Summary: Store/retrieve blocks in different speed storage devices by hierarchy way (was: Store blocks in diffe

[jira] [Updated] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is s

[jira] [Comment Edited] (SPARK-12533) hiveContext.table() throws the wrong exception

[ https://issues.apache.org/jira/browse/SPARK-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075451#comment-15075451 ] Thomas Sebastian edited comment on SPARK-12533 at 12/31/15 5:52 AM: ---

[jira] [Assigned] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7689: --- Assignee: Apache Spark (was: Josh Rosen) > Remove TTL-based metadata cleaning (spark.cleaner

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: (was: Apache Spark) > Have a single file that controls the environmental variables

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: Apache Spark > Have a single file that controls the environmental variables and spark

[jira] [Updated] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-529: - Assignee: (was: Josh Rosen) > Have a single file that controls the environmental variables and spark co

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-529: Assignee: Josh Rosen > Have a single file that controls the environmental variables and spark config

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: Apache Spark > Have a single file that controls the environmental variables and spark

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: (was: Apache Spark) > Have a single file that controls the environmental variables

[jira] [Commented] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075696#comment-15075696 ] Apache Spark commented on SPARK-529: User 'vanzin' has created a pull request for this

[jira] [Commented] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075693#comment-15075693 ] Saisai Shao commented on SPARK-12516: - Hi [~vanzin], what is your suggestion of this

[jira] [Commented] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075690#comment-15075690 ] Russell Alexander Spitzer commented on SPARK-11661: --- This seems to have

[jira] [Comment Edited] (SPARK-11661) We should still pushdown filters returned by a data source's unhandledFilters

[ https://issues.apache.org/jira/browse/SPARK-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075690#comment-15075690 ] Russell Alexander Spitzer edited comment on SPARK-11661 at 12/31/15 3:44 AM: --

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075678#comment-15075678 ] Reynold Xin commented on SPARK-6166: [~zsxwing] can you pick this one up? > Add conf

[jira] [Assigned] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-12427: -- Assignee: Josh Rosen > spark builds filling up jenkins' disk > ---

[jira] [Resolved] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12427. Resolution: Fixed > spark builds filling up jenkins' disk > - >

[jira] [Commented] (SPARK-12414) Remove closure serializer

[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075638#comment-15075638 ] Reynold Xin commented on SPARK-12414: - Is it possible to use Kryo 3.0 to do this? I'm

[jira] [Resolved] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12561. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove JobLogger > > >

[jira] [Commented] (SPARK-12039) HiveSparkSubmitSuite's SPARK-9757 Persist Parquet relation with decimal column is very flaky

[ https://issues.apache.org/jira/browse/SPARK-12039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075637#comment-15075637 ] Apache Spark commented on SPARK-12039: -- User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7689: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Remove TTL-based metadata clean

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075631#comment-15075631 ] Apache Spark commented on SPARK-3873: - User 'vanzin' has created a pull request for th

[jira] [Resolved] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12588. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove HTTPBroadcast > > >

[jira] [Commented] (SPARK-12554) Standalone mode may hang if max cores is not a multiple of executor cores

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075629#comment-15075629 ] Lijie Xu commented on SPARK-12554: -- Well, my proposal is defining the *nearest multiple*

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075602#comment-15075602 ] Apache Spark commented on SPARK-3873: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12532: Assignee: Xiao Li (was: Apache Spark) > Join-key Pushdown via Predicate Transitivity > --

[jira] [Assigned] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12532: Assignee: Apache Spark (was: Xiao Li) > Join-key Pushdown via Predicate Transitivity > --

[jira] [Created] (SPARK-12589) result row size is wrong in UnsafeRowParquetRecordReader

Wenchen Fan created SPARK-12589: --- Summary: result row size is wrong in UnsafeRowParquetRecordReader Key: SPARK-12589 URL: https://issues.apache.org/jira/browse/SPARK-12589 Project: Spark Issue

[jira] [Commented] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075579#comment-15075579 ] Apache Spark commented on SPARK-7689: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-9757) Can't create persistent data source tables with decimal

[ https://issues.apache.org/jira/browse/SPARK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075575#comment-15075575 ] Apache Spark commented on SPARK-9757: - User 'yhuai' has created a pull request for thi

[jira] [Updated] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7689: -- Description: With the introduction of ContextCleaner, I think there's no longer any reason for most use

[jira] [Commented] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075573#comment-15075573 ] Josh Rosen commented on SPARK-7689: --- Note that the periodic GC was implemented for Spark

[jira] [Updated] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7689: -- Target Version/s: 2.0.0 (was: 1.5.0) > Deprecate spark.cleaner.ttl > --- > >

[jira] [Assigned] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-7689: - Assignee: Josh Rosen > Deprecate spark.cleaner.ttl > --- > >

[jira] [Reopened] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-7689: --- > Deprecate spark.cleaner.ttl > --- > > Key: SPARK-7689 >

[jira] [Updated] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7689: -- Summary: Remove TTL-based metadata cleaning (spark.cleaner.ttl) (was: Deprecate spark.cleaner.ttl) > R

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Reynold Xin (was: Apache Spark) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Reynold Xin) > Remove JobLogger > > >

[jira] [Commented] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075527#comment-15075527 ] Josh Rosen commented on SPARK-7689: --- See also: https://issues.apache.org/jira/browse/SP

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Reynold Xin (was: Apache Spark) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Reynold Xin) > Remove JobLogger > > >

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075511#comment-15075511 ] Marcelo Vanzin commented on SPARK-3873: --- The style checker is in but only generates

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12588: Assignee: Apache Spark (was: Reynold Xin) > Remove HTTPBroadcast > >

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12588: Assignee: Reynold Xin (was: Apache Spark) > Remove HTTPBroadcast > >

[jira] [Commented] (SPARK-12206) Streaming WebUI shows incorrect batch statistics when using Window operations

[ https://issues.apache.org/jira/browse/SPARK-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075508#comment-15075508 ] Shixiong Zhu commented on SPARK-12206: -- Because only batches that are multiple times

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-12561: --- Assignee: Reynold Xin (was: Apache Spark) > Remove JobLogger > > >

[jira] [Commented] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075507#comment-15075507 ] Apache Spark commented on SPARK-12588: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Andrew Or) > Remove JobLogger > > >

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12148: Issue Type: Sub-task (was: Improvement) Parent: SPARK-12169 > SparkR: rename DataFrame to

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-12588: --- Assignee: Reynold Xin (was: Apache Spark) > Remove HTTPBroadcast > > >

[jira] [Updated] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12588: Description: We switched to TorrentBroadcast in Spark 1.1, and HttpBroadcast has been undocumented

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12588: Assignee: Apache Spark (was: Josh Rosen) > Remove HTTPBroadcast > >

[jira] [Updated] (SPARK-11806) Spark 2.0 deprecations and removals

[ https://issues.apache.org/jira/browse/SPARK-11806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11806: Labels: releasenotes (was: ) > Spark 2.0 deprecations and removals > -

[jira] [Updated] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12588: Labels: releasenotes (was: ) > Remove HTTPBroadcast > > > Key

[jira] [Commented] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075499#comment-15075499 ] Apache Spark commented on SPARK-12561: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Andrew Or (was: Apache Spark) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Andrew Or) > Remove JobLogger > > >

[jira] [Reopened] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-529: -- I'm reopening this since I believe it's a worthy addition; in fact, Spark SQL already has something

[jira] [Created] (SPARK-12588) Remove HTTPBroadcast

Josh Rosen created SPARK-12588: -- Summary: Remove HTTPBroadcast Key: SPARK-12588 URL: https://issues.apache.org/jira/browse/SPARK-12588 Project: Spark Issue Type: Sub-task Components: S

[jira] [Updated] (SPARK-12481) Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

[ https://issues.apache.org/jira/browse/SPARK-12481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12481: Assignee: Sean Owen (was: Apache Spark) > Remove usage of Hadoop deprecated APIs and reflection th

[jira] [Resolved] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6873. --- Resolution: Cannot Reproduce Speculatively resolving as "Cannot Reproduce." Please comment or re-open

[jira] [Commented] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075481#comment-15075481 ] Josh Rosen commented on SPARK-2208: --- Status update: this issue is still relevant as of 2

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075482#comment-15075482 ] Reynold Xin commented on SPARK-12537: - Sorry I am not sure whether your point is vali

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075479#comment-15075479 ] Josh Rosen commented on SPARK-11138: Update: this is still an issue: https://spark-t

[jira] [Resolved] (SPARK-6701) Flaky test: o.a.s.deploy.yarn.YarnClusterSuite Python application

[ https://issues.apache.org/jira/browse/SPARK-6701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6701. --- Resolution: Fixed > Flaky test: o.a.s.deploy.yarn.YarnClusterSuite Python application > --

[jira] [Commented] (SPARK-6701) Flaky test: o.a.s.deploy.yarn.YarnClusterSuite Python application

[ https://issues.apache.org/jira/browse/SPARK-6701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075477#comment-15075477 ] Josh Rosen commented on SPARK-6701: --- I'm going to resolve this as fixed since the releva

[jira] [Commented] (SPARK-10680) Flaky test: network.RequestTimeoutIntegrationSuite.timeoutInactiveRequests

[ https://issues.apache.org/jira/browse/SPARK-10680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075473#comment-15075473 ] Josh Rosen commented on SPARK-10680: This is still flaky: https://spark-tests.appspo

[jira] [Updated] (SPARK-10680) Flaky test: network.RequestTimeoutIntegrationSuite.timeoutInactiveRequests

[ https://issues.apache.org/jira/browse/SPARK-10680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10680: --- Affects Version/s: 2.0.0 1.6.1 > Flaky test: network.RequestTimeoutIntegration

[jira] [Commented] (SPARK-7354) Flaky test: o.a.s.deploy.SparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075467#comment-15075467 ] Josh Rosen commented on SPARK-7354: --- This is still flaky. > Flaky test: o.a.s.deploy.Sp

[jira] [Updated] (SPARK-7354) Flaky test: o.a.s.deploy.SparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7354: -- Affects Version/s: 2.0.0 1.6.0 > Flaky test: o.a.s.deploy.SparkSubmitSuite --jars

[jira] [Resolved] (SPARK-11224) Flaky test: o.a.s.ExternalShuffleServiceSuite

[ https://issues.apache.org/jira/browse/SPARK-11224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11224. Resolution: Fixed Resolving as "Fixed" since this hasn't been observed to fail recently: https://s

[jira] [Resolved] (SPARK-6021) Flaky test: o.a.s.FutureActionSuite - complex sync action

[ https://issues.apache.org/jira/browse/SPARK-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6021. --- Resolution: Fixed Resolving as fixed since this test has not been observed recently in master or 1.6:

[jira] [Resolved] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite "Do not clear received block data too soon"

[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7420. --- Resolution: Fixed Resolving as fixed since this test has not been observed to fail in master / 1.6:

[jira] [Commented] (SPARK-12533) hiveContext.table() throws the wrong exception

[ https://issues.apache.org/jira/browse/SPARK-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075451#comment-15075451 ] Thomas Sebastian commented on SPARK-12533: -- Submitted the pull request > hiveCo

[jira] [Closed] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-5659. - Resolution: Fixed Resolving as fixed, since this hasn't ever been observed to fail in master/1.6: https:/

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075448#comment-15075448 ] Josh Rosen commented on SPARK-5581: --- Update: although the code in question has moved and

[jira] [Resolved] (SPARK-8430) ExternalShuffleBlockResolver should support UnsafeShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8430. --- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 > ExternalShuffleBlockResolver

[jira] [Resolved] (SPARK-12399) Display correct error message when accessing REST API with an unknown app Id

[ https://issues.apache.org/jira/browse/SPARK-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12399. Resolution: Fixed Assignee: Carson Wang Fix Version/s: 2.0.0

[jira] [Resolved] (SPARK-5763) Sort-based Groupby and Join to resolve skewed data

[ https://issues.apache.org/jira/browse/SPARK-5763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5763. --- Resolution: Won't Fix Resolving as "Won't fix" for now, given discussion on the PR RE: this functiona

[jira] [Resolved] (SPARK-2520) the executor is thrown java.io.StreamCorruptedException

[ https://issues.apache.org/jira/browse/SPARK-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2520. --- Resolution: Cannot Reproduce Resolving as "Cannot reproduce" since this issue is very old. Please re-o

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075435#comment-15075435 ] shane knapp commented on SPARK-12427: - yeah, i think we're good. thanks for doing th

[jira] [Resolved] (SPARK-12387) JDBC IN operator push down

[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12387. - Resolution: Fixed Assignee: Takeshi Yamamuro (was: Apache Spark) Fix Version/s: 2

[jira] [Resolved] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12409. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 > JDBC AND oper

[jira] [Resolved] (SPARK-12391) JDBC OR operator push down

[ https://issues.apache.org/jira/browse/SPARK-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12391. - Resolution: Fixed Assignee: Takeshi Yamamuro (was: Apache Spark) Fix Version/s: 2

[jira] [Commented] (SPARK-6155) Support latest Scala (2.11.6+)

[ https://issues.apache.org/jira/browse/SPARK-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075418#comment-15075418 ] Josh Rosen commented on SPARK-6155: --- Closing as "Cannot Reproduce" since this seems to o

[jira] [Closed] (SPARK-6155) Support latest Scala (2.11.6+)

[ https://issues.apache.org/jira/browse/SPARK-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-6155. - Resolution: Cannot Reproduce > Support latest Scala (2.11.6+) > -- > >

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075413#comment-15075413 ] Josh Rosen commented on SPARK-12427: I did a significant amount of cleanup last week

[jira] [Updated] (SPARK-12524) Group by key in a pairrdd without any shuffle

[ https://issues.apache.org/jira/browse/SPARK-12524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12524: --- Component/s: (was: Build) > Group by key in a pairrdd without any shuffle > -

[jira] [Commented] (SPARK-2629) Improved state management for Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075412#comment-15075412 ] Reynold Xin commented on SPARK-2629: [~tdas] this ticket is done, isn't it? Should we

  1   2   >