[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Summary: Store/retrieve blocks in different speed storage devices by hierarchy way (was: Store blocks in

[jira] [Commented] (SPARK-12039) HiveSparkSubmitSuite's SPARK-9757 Persist Parquet relation with decimal column is very flaky

[ https://issues.apache.org/jira/browse/SPARK-12039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075637#comment-15075637 ] Apache Spark commented on SPARK-12039: -- User 'yhuai' has created a pull request for this issue:

[jira] [Created] (SPARK-12590) Inconsistent behavior of randomSplit in YARN mode

Gaurav Kumar created SPARK-12590: Summary: Inconsistent behavior of randomSplit in YARN mode Key: SPARK-12590 URL: https://issues.apache.org/jira/browse/SPARK-12590 Project: Spark Issue

[jira] [Updated] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7689: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Remove TTL-based metadata

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075678#comment-15075678 ] Reynold Xin commented on SPARK-6166: [~zsxwing] can you pick this one up? > Add config to limit

[jira] [Commented] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075696#comment-15075696 ] Apache Spark commented on SPARK-529: User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: Apache Spark > Have a single file that controls the environmental variables and spark

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: (was: Apache Spark) > Have a single file that controls the environmental

[jira] [Comment Edited] (SPARK-12533) hiveContext.table() throws the wrong exception

[ https://issues.apache.org/jira/browse/SPARK-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075451#comment-15075451 ] Thomas Sebastian edited comment on SPARK-12533 at 12/31/15 5:52 AM:

[jira] [Updated] (SPARK-12196) Store blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Resolved] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12585. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10528

[jira] [Comment Edited] (SPARK-12414) Remove closure serializer

[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075814#comment-15075814 ] Andrew Or edited comment on SPARK-12414 at 12/31/15 7:51 AM: - It's also for

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: (was: Apache Spark) > Have a single file that controls the environmental

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-529: -- Assignee: Apache Spark > Have a single file that controls the environmental variables and spark

[jira] [Updated] (SPARK-12196) Store/retrieve blocks in different speed storage devices by hierarchy way

[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: *Problem* Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capacity is

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075757#comment-15075757 ] Shixiong Zhu commented on SPARK-6166: - Sure > Add config to limit number of concurrent outbound

[jira] [Assigned] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-6166: --- Assignee: Shixiong Zhu > Add config to limit number of concurrent outbound connections for

[jira] [Commented] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn

[ https://issues.apache.org/jira/browse/SPARK-12516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075693#comment-15075693 ] Saisai Shao commented on SPARK-12516: - Hi [~vanzin], what is your suggestion of this issue? I'm

[jira] [Updated] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-529: - Assignee: (was: Josh Rosen) > Have a single file that controls the environmental variables and spark

[jira] [Assigned] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-529: Assignee: Josh Rosen > Have a single file that controls the environmental variables and spark

[jira] [Resolved] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12427. Resolution: Fixed > spark builds filling up jenkins' disk > -

[jira] [Commented] (SPARK-12414) Remove closure serializer

[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075814#comment-15075814 ] Andrew Or commented on SPARK-12414: --- It's also for code cleanup. Right now SparkEnv has a "closure

[jira] [Updated] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10524: -- Target Version/s: 2.0.0 (was: ) > Decision tree binary classification with ordered

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075271#comment-15075271 ] Reynold Xin commented on SPARK-12537: - The point is to be able to support non-standard JSON.

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075230#comment-15075230 ] Mario Briggs commented on SPARK-12177: -- you could also get just a few of the records you want i.e.

[jira] [Commented] (SPARK-12407) ClassCast Exception when restarting spark streaming from checkpoint

[ https://issues.apache.org/jira/browse/SPARK-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075260#comment-15075260 ] Shixiong Zhu commented on SPARK-12407: -- They have the same problem. Here is a workaround to use them

[jira] [Commented] (SPARK-12533) hiveContext.table() throws the wrong exception

[ https://issues.apache.org/jira/browse/SPARK-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075278#comment-15075278 ] Thomas Sebastian commented on SPARK-12533: -- Hi Michael, I was able to replicate the issue. I am

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075282#comment-15075282 ] Sean Owen commented on SPARK-12537: --- Of course I appreciate that. Supporting non-standard input sounds

[jira] [Created] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

Davies Liu created SPARK-12585: -- Summary: The numFields of UnsafeRow should not changed by pointTo() Key: SPARK-12585 URL: https://issues.apache.org/jira/browse/SPARK-12585 Project: Spark Issue

[jira] [Commented] (SPARK-12584) How to do the merging of 2 JavaScemaRDD data in spark 1.2.0 version. The similar features we can achieved in spark 1.4.1 using "UNIONALL", but i am unable to find any

[ https://issues.apache.org/jira/browse/SPARK-12584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075277#comment-15075277 ] Rijash Patel commented on SPARK-12584: -- Dear Sean, Sorry to ask this, actually i am new to this

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075172#comment-15075172 ] Mario Briggs commented on SPARK-12177: -- Nikita, thank you. A-C : Looks good to me. (BTW i didn't

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075205#comment-15075205 ] Mario Briggs commented on SPARK-12177: -- Very good point about creation of KafkaConsumer frequently.

[jira] [Comment Edited] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075230#comment-15075230 ] Mario Briggs edited comment on SPARK-12177 at 12/30/15 5:24 PM: you could

[jira] [Updated] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12585: --- Description: Right now, numFields will be passed in by pointTo(), then bitSetWidthInBytes is

[jira] [Assigned] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12585: -- Assignee: Davies Liu > The numFields of UnsafeRow should not changed by pointTo() >

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075307#comment-15075307 ] Reynold Xin commented on SPARK-12537: - Note that there is really no "standard" to deal with

[jira] [Updated] (SPARK-12300) Fix schema inferance on local collections

[ https://issues.apache.org/jira/browse/SPARK-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12300: --- Fix Version/s: (was: 1.6.0) 1.6.1 > Fix schema inferance on local collections

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-12582: - Assignee: Andrew Or > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Updated] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12582: -- Component/s: (was: Shuffle) Windows Tests >

[jira] [Updated] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12582: -- Assignee: (was: Apache Spark) Target Version/s: 1.6.1, 2.0.0 >

[jira] [Updated] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12582: -- Assignee: yucai (was: Andrew Or) > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12582: Assignee: Apache Spark > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Assigned] (SPARK-12567) Add aes_{encrypt,decrypt} UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12567: Assignee: (was: Apache Spark) > Add aes_{encrypt,decrypt} UDFs >

[jira] [Assigned] (SPARK-12567) Add aes_{encrypt,decrypt} UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12567: Assignee: Apache Spark > Add aes_{encrypt,decrypt} UDFs > --

[jira] [Created] (SPARK-12587) Make parts of the Spark SQL testing API public

holdenk created SPARK-12587: --- Summary: Make parts of the Spark SQL testing API public Key: SPARK-12587 URL: https://issues.apache.org/jira/browse/SPARK-12587 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-12495) use true as default value for propagateNull in NewInstance

[ https://issues.apache.org/jira/browse/SPARK-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12495. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10443

[jira] [Commented] (SPARK-12537) Add option to accept quoting of all character backslash quoting mechanism

[ https://issues.apache.org/jira/browse/SPARK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075318#comment-15075318 ] Sean Owen commented on SPARK-12537: --- Yeah, by definition, but you've already observed that Python,

[jira] [Resolved] (SPARK-12300) Fix schema inferance on local collections

[ https://issues.apache.org/jira/browse/SPARK-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12300. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075334#comment-15075334 ] Apache Spark commented on SPARK-12585: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12585) The numFields of UnsafeRow should not changed by pointTo()

[ https://issues.apache.org/jira/browse/SPARK-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12585: Assignee: Apache Spark (was: Davies Liu) > The numFields of UnsafeRow should not changed

[jira] [Created] (SPARK-12586) Wrong answer with registerTempTable and union sql query

shao lo created SPARK-12586: --- Summary: Wrong answer with registerTempTable and union sql query Key: SPARK-12586 URL: https://issues.apache.org/jira/browse/SPARK-12586 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12554) Standalone mode may hang if max cores is not a multiple of executor cores

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12554: -- Priority: Minor (was: Major) > Standalone mode may hang if max cores is not a multiple of executor

[jira] [Updated] (SPARK-12554) Standalone mode may hang if max cores is not a multiple of executor cores

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12554: -- Summary: Standalone mode may hang if max cores is not a multiple of executor cores (was: Standalone

[jira] [Updated] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10359: --- Component/s: Project Infra > Enumerate Spark's dependencies in a file and diff against it for new

[jira] [Resolved] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10359. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10461

[jira] [Updated] (SPARK-12586) Wrong answer with registerTempTable and union sql query

[ https://issues.apache.org/jira/browse/SPARK-12586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shao lo updated SPARK-12586: Attachment: sql_bug.py Attaching example code > Wrong answer with registerTempTable and union sql query >

[jira] [Commented] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075353#comment-15075353 ] Andrew Or commented on SPARK-12554: --- [~jerrylead] The change you are proposing changes the semantics

[jira] [Updated] (SPARK-12586) Wrong answer with registerTempTable and union sql query

[ https://issues.apache.org/jira/browse/SPARK-12586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shao lo updated SPARK-12586: Description: The following sequence of sql(), registerTempTable() calls gets the wrong answer. The

[jira] [Commented] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075527#comment-15075527 ] Josh Rosen commented on SPARK-7689: --- See also:

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Reynold Xin) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Reynold Xin (was: Apache Spark) > Remove JobLogger > > >

[jira] [Updated] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7689: -- Target Version/s: 2.0.0 (was: 1.5.0) > Deprecate spark.cleaner.ttl > --- > >

[jira] [Assigned] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-7689: - Assignee: Josh Rosen > Deprecate spark.cleaner.ttl > --- > >

[jira] [Reopened] (SPARK-7689) Deprecate spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-7689: --- > Deprecate spark.cleaner.ttl > --- > > Key: SPARK-7689 >

[jira] [Updated] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7689: -- Summary: Remove TTL-based metadata cleaning (spark.cleaner.ttl) (was: Deprecate spark.cleaner.ttl) >

[jira] [Updated] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7689: -- Description: With the introduction of ContextCleaner, I think there's no longer any reason for most

[jira] [Commented] (SPARK-7689) Remove TTL-based metadata cleaning (spark.cleaner.ttl)

[ https://issues.apache.org/jira/browse/SPARK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075573#comment-15075573 ] Josh Rosen commented on SPARK-7689: --- Note that the periodic GC was implemented for Spark 1.6. > Remove

[jira] [Commented] (SPARK-9757) Can't create persistent data source tables with decimal

[ https://issues.apache.org/jira/browse/SPARK-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075575#comment-15075575 ] Apache Spark commented on SPARK-9757: - User 'yhuai' has created a pull request for this issue:

[jira] [Updated] (SPARK-12481) Remove usage of Hadoop deprecated APIs and reflection that supported 1.x

[ https://issues.apache.org/jira/browse/SPARK-12481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12481: Assignee: Sean Owen (was: Apache Spark) > Remove usage of Hadoop deprecated APIs and reflection

[jira] [Created] (SPARK-12588) Remove HTTPBroadcast

Josh Rosen created SPARK-12588: -- Summary: Remove HTTPBroadcast Key: SPARK-12588 URL: https://issues.apache.org/jira/browse/SPARK-12588 Project: Spark Issue Type: Sub-task Components:

[jira] [Reopened] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-529: -- I'm reopening this since I believe it's a worthy addition; in fact, Spark SQL already has something

[jira] [Commented] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075499#comment-15075499 ] Apache Spark commented on SPARK-12561: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Andrew Or (was: Apache Spark) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Andrew Or) > Remove JobLogger > > >

[jira] [Updated] (SPARK-11806) Spark 2.0 deprecations and removals

[ https://issues.apache.org/jira/browse/SPARK-11806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11806: Labels: releasenotes (was: ) > Spark 2.0 deprecations and removals >

[jira] [Updated] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12588: Labels: releasenotes (was: ) > Remove HTTPBroadcast > > >

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12148: Issue Type: Sub-task (was: Improvement) Parent: SPARK-12169 > SparkR: rename DataFrame to

[jira] [Updated] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12588: Description: We switched to TorrentBroadcast in Spark 1.1, and HttpBroadcast has been undocumented

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Andrew Or) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12588: Assignee: Apache Spark (was: Josh Rosen) > Remove HTTPBroadcast > >

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-12588: --- Assignee: Reynold Xin (was: Apache Spark) > Remove HTTPBroadcast > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-12561: --- Assignee: Reynold Xin (was: Apache Spark) > Remove JobLogger > > >

[jira] [Commented] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075507#comment-15075507 ] Apache Spark commented on SPARK-12588: -- User 'rxin' has created a pull request for this issue:

[jira] [Commented] (SPARK-12206) Streaming WebUI shows incorrect batch statistics when using Window operations

[ https://issues.apache.org/jira/browse/SPARK-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075508#comment-15075508 ] Shixiong Zhu commented on SPARK-12206: -- Because only batches that are multiple times of slide

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12588: Assignee: Apache Spark (was: Reynold Xin) > Remove HTTPBroadcast >

[jira] [Assigned] (SPARK-12588) Remove HTTPBroadcast

[ https://issues.apache.org/jira/browse/SPARK-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12588: Assignee: Reynold Xin (was: Apache Spark) > Remove HTTPBroadcast >

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075511#comment-15075511 ] Marcelo Vanzin commented on SPARK-3873: --- The style checker is in but only generates warnings now;

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Apache Spark (was: Reynold Xin) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12561) Remove JobLogger

[ https://issues.apache.org/jira/browse/SPARK-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12561: Assignee: Reynold Xin (was: Apache Spark) > Remove JobLogger > > >

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12582: Assignee: (was: Apache Spark) > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Assigned] (SPARK-12582) IndexShuffleBlockResolverSuite fails in windows

[ https://issues.apache.org/jira/browse/SPARK-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12582: Assignee: Apache Spark > IndexShuffleBlockResolverSuite fails in windows >

[jira] [Commented] (SPARK-12427) spark builds filling up jenkins' disk

[ https://issues.apache.org/jira/browse/SPARK-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075413#comment-15075413 ] Josh Rosen commented on SPARK-12427: I did a significant amount of cleanup last week and it looks

[jira] [Commented] (SPARK-6155) Support latest Scala (2.11.6+)

[ https://issues.apache.org/jira/browse/SPARK-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075418#comment-15075418 ] Josh Rosen commented on SPARK-6155: --- Closing as "Cannot Reproduce" since this seems to only affect old

[jira] [Closed] (SPARK-6155) Support latest Scala (2.11.6+)

[ https://issues.apache.org/jira/browse/SPARK-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-6155. - Resolution: Cannot Reproduce > Support latest Scala (2.11.6+) > -- > >

[jira] [Resolved] (SPARK-12391) JDBC OR operator push down

[ https://issues.apache.org/jira/browse/SPARK-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12391. - Resolution: Fixed Assignee: Takeshi Yamamuro (was: Apache Spark) Fix Version/s:

[jira] [Resolved] (SPARK-12409) JDBC AND operator push down

[ https://issues.apache.org/jira/browse/SPARK-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12409. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 > JDBC AND

[jira] [Resolved] (SPARK-12387) JDBC IN operator push down

[ https://issues.apache.org/jira/browse/SPARK-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12387. - Resolution: Fixed Assignee: Takeshi Yamamuro (was: Apache Spark) Fix Version/s:

[jira] [Resolved] (SPARK-5763) Sort-based Groupby and Join to resolve skewed data

[ https://issues.apache.org/jira/browse/SPARK-5763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5763. --- Resolution: Won't Fix Resolving as "Won't fix" for now, given discussion on the PR RE: this

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075448#comment-15075448 ] Josh Rosen commented on SPARK-5581: --- Update: although the code in question has moved and the comment has

[jira] [Closed] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-5659. - Resolution: Fixed Resolving as fixed, since this hasn't ever been observed to fail in master/1.6:

  1   2   >