[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056969#comment-15056969 ] Shivaram Venkataraman commented on SPARK-12327: --- cc [~felixcheung] This is related to

[jira] [Closed] (SPARK-12275) No plan for BroadcastHint in some condition

[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai closed SPARK-12275. - I verified the PR has fixed this issue. > No plan for BroadcastHint in some condition >

[jira] [Updated] (SPARK-12331) R^2 for regression through the origin

[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Younus updated SPARK-12331: - Description: The value of R^2 (coefficient of determination) obtained from

[jira] [Created] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

Ashwin Shankar created SPARK-12329: -- Summary: spark-sql prints out SET commands to stdout instead of stderr Key: SPARK-12329 URL: https://issues.apache.org/jira/browse/SPARK-12329 Project: Spark

[jira] [Commented] (SPARK-12307) ParquetFormat options should be exposed through the DataFrameReader/Writer options API

[ https://issues.apache.org/jira/browse/SPARK-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057141#comment-15057141 ] holdenk commented on SPARK-12307: - I hear you, I agree we probably don't want to wholesale expose all of

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead

[jira] [Created] (SPARK-12331) R^2 for regression through the origin

Imran Younus created SPARK-12331: Summary: R^2 for regression through the origin Key: SPARK-12331 URL: https://issues.apache.org/jira/browse/SPARK-12331 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056995#comment-15056995 ] Felix Cheung edited comment on SPARK-12327 at 12/14/15 11:51 PM: - "# void

[jira] [Assigned] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12327: Assignee: Apache Spark > lint-r checks fail with commented code >

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056995#comment-15056995 ] Felix Cheung commented on SPARK-12327: -- "# void -> NULL" is another example - they are not code >

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057033#comment-15057033 ] Shivaram Venkataraman commented on SPARK-12327: --- Yeah [~felixcheung] I think we could tag

[jira] [Created] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

Shixiong Zhu created SPARK-12328: Summary: Add connectionEstablished callback to RpcHandler to monitor the new connections Key: SPARK-12328 URL: https://issues.apache.org/jira/browse/SPARK-12328

[jira] [Commented] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

[ https://issues.apache.org/jira/browse/SPARK-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057080#comment-15057080 ] Shixiong Zhu commented on SPARK-12328: -- Oh. Right. Forgot it. > Add connectionEstablished callback

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057133#comment-15057133 ] Rodrigo Boavida commented on SPARK-12219: - [~srowen] Just built and ran successfully off the

[jira] [Commented] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057203#comment-15057203 ] Kay Ousterhout commented on SPARK-11460: For the specific issue mentioned in the description, can

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr >

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057049#comment-15057049 ] Apache Spark commented on SPARK-12231: -- User 'kevinyu98' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-12307) ParquetFormat options should be exposed through the DataFrameReader/Writer options API

[ https://issues.apache.org/jira/browse/SPARK-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057067#comment-15057067 ] Hyukjin Kwon edited comment on SPARK-12307 at 12/15/15 12:40 AM: - Just my

[jira] [Commented] (SPARK-12307) ParquetFormat options should be exposed through the DataFrameReader/Writer options API

[ https://issues.apache.org/jira/browse/SPARK-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057067#comment-15057067 ] Hyukjin Kwon commented on SPARK-12307: -- Just my personal though. I felt in the same way with this

[jira] [Created] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

Charles Allen created SPARK-12330: - Summary: Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk Key: SPARK-12330 URL:

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056994#comment-15056994 ] Felix Cheung commented on SPARK-12327: -- yea, I think these are overactive checks in lint-r that I

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057030#comment-15057030 ] Shivaram Venkataraman commented on SPARK-12327: --- This test is currently disabled by

[jira] [Assigned] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11097: Assignee: (was: Apache Spark) > Add connection established callback to lower level

[jira] [Assigned] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11097: Assignee: Apache Spark > Add connection established callback to lower level RPC layer so

[jira] [Resolved] (SPARK-12274) WrapOption should not have type constraint for child

[ https://issues.apache.org/jira/browse/SPARK-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12274. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10263

[jira] [Resolved] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

[ https://issues.apache.org/jira/browse/SPARK-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12328. -- Resolution: Duplicate > Add connectionEstablished callback to RpcHandler to monitor the new >

[jira] [Assigned] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11097: Assignee: Apache Spark > Add connection established callback to lower level RPC layer so

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr >

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr >

[jira] [Assigned] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-12327: - Assignee: (was: Apache Spark) > lint-r checks fail with commented

[jira] [Commented] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

[ https://issues.apache.org/jira/browse/SPARK-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057072#comment-15057072 ] Marcelo Vanzin commented on SPARK-12328: SPARK-11097? > Add connectionEstablished callback to

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead

[jira] [Commented] (SPARK-10312) Enhance SerDe to handle atomic vector

[ https://issues.apache.org/jira/browse/SPARK-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055681#comment-15055681 ] Sun Rui commented on SPARK-10312: - The gap between R and Scala/Java is that R has no scalar types. if we

[jira] [Comment Edited] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055633#comment-15055633 ] Michael Han edited comment on SPARK-2356 at 12/14/15 10:03 AM: --- Hello

[jira] [Resolved] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12176. --- Resolution: Not A Problem > SparkLauncher's setConf() does not support configs containing spaces >

[jira] [Commented] (SPARK-12275) No plan for BroadcastHint in some condition

[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055760#comment-15055760 ] Apache Spark commented on SPARK-12275: -- User 'yucai' has created a pull request for this issue:

[jira] [Commented] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055887#comment-15055887 ] Sean Owen commented on SPARK-12317: --- That makes some sense, and is easy to support since our utility

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055908#comment-15055908 ] Apache Spark commented on SPARK-12177: -- User 'nikit-os' has created a pull request for this issue:

[jira] [Commented] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055916#comment-15055916 ] Da Fox commented on SPARK-1529: --- Hi, are there any updates for this improvement? We are running Spark on

[jira] [Comment Edited] (SPARK-1529) Support DFS based shuffle in addition to Netty shuffle

[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055916#comment-15055916 ] Da Fox edited comment on SPARK-1529 at 12/14/15 12:34 PM: -- Hi, are there any

[jira] [Created] (SPARK-12320) throw exception if the number of fields does not line up for Tuple encoder

Wenchen Fan created SPARK-12320: --- Summary: throw exception if the number of fields does not line up for Tuple encoder Key: SPARK-12320 URL: https://issues.apache.org/jira/browse/SPARK-12320 Project:

[jira] [Updated] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12317: -- Priority: Minor (was: Major) > Support configurate value with unit(e.g. kb/mb/gb) in SQL >

[jira] [Commented] (SPARK-12318) Save mode in SparkR should be error by default

[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055745#comment-15055745 ] Apache Spark commented on SPARK-12318: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12318) Save mode in SparkR should be error by default

[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12318: Assignee: Apache Spark > Save mode in SparkR should be error by default >

[jira] [Created] (SPARK-12319) Address endian specific problems surfaced in 1.6

Adam Roberts created SPARK-12319: Summary: Address endian specific problems surfaced in 1.6 Key: SPARK-12319 URL: https://issues.apache.org/jira/browse/SPARK-12319 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12318) Save mode in SparkR should be error by default

[ https://issues.apache.org/jira/browse/SPARK-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12318: Assignee: (was: Apache Spark) > Save mode in SparkR should be error by default >

[jira] [Commented] (SPARK-4497) HiveThriftServer2 does not exit properly on failure

[ https://issues.apache.org/jira/browse/SPARK-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055924#comment-15055924 ] Jeff Zhang commented on SPARK-4497: --- Can not reproduce it. [~yanakad] Is this still an issue for you ?

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055937#comment-15055937 ] Nikita Tarasenko commented on SPARK-12177: -- Do we need DirectKafkaInputDStream yet? We shouldn't

[jira] [Commented] (SPARK-12303) Configuration parameter by which can choose if we want the REPL generated class directory name to be random or fixed name.

[ https://issues.apache.org/jira/browse/SPARK-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055862#comment-15055862 ] Prashant Sharma commented on SPARK-12303: - Given one can already set root directory

[jira] [Comment Edited] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055633#comment-15055633 ] Michael Han edited comment on SPARK-2356 at 12/14/15 9:09 AM: -- Hello

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Description: JIRA to cover endian specific problems - since testing 1.6 I've noticed problems

[jira] [Resolved] (SPARK-12303) Configuration parameter by which can choose if we want the REPL generated class directory name to be random or fixed name.

[ https://issues.apache.org/jira/browse/SPARK-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12303. --- Resolution: Won't Fix > Configuration parameter by which can choose if we want the REPL generated

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055911#comment-15055911 ] Nikita Tarasenko commented on SPARK-12177: -- I moved all changes for Kafka 0.9 to separate

[jira] [Updated] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-12332: Component/s: Tests > Typo in ResetSystemProperties.scala's comments >

[jira] [Assigned] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12332: Assignee: (was: Apache Spark) > Typo in ResetSystemProperties.scala's comments >

[jira] [Closed] (SPARK-9687) System.exit() still disrupt applications embedding Spark

[ https://issues.apache.org/jira/browse/SPARK-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alberto closed SPARK-9687. -- > System.exit() still disrupt applications embedding Spark >

[jira] [Comment Edited] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056115#comment-15056115 ] RJ Nowling edited comment on SPARK-4816 at 12/14/15 3:42 PM: - I tested it

[jira] [Closed] (SPARK-12322) recompute an cached RDD partition when getting its block is failed

[ https://issues.apache.org/jira/browse/SPARK-12322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang closed SPARK-12322. Resolution: Invalid > recompute an cached RDD partition when getting its block is failed >

[jira] [Commented] (SPARK-11948) Permanent UDF not work

[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056155#comment-15056155 ] Ewan Leith commented on SPARK-11948: I think this is a duplicate of SPARK-11609 ? > Permanent UDF

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056168#comment-15056168 ] RJ Nowling commented on SPARK-4816: --- I think issue [SPARK-9507] fixed the issue. I checked out git

[jira] [Comment Edited] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056168#comment-15056168 ] RJ Nowling edited comment on SPARK-4816 at 12/14/15 4:16 PM: - I think

[jira] [Comment Edited] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056168#comment-15056168 ] RJ Nowling edited comment on SPARK-4816 at 12/14/15 4:19 PM: - I think

[jira] [Comment Edited] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055633#comment-15055633 ] Michael Han edited comment on SPARK-2356 at 12/14/15 9:05 AM: -- Hello

[jira] [Created] (SPARK-12322) recompute an cached RDD partition when getting its block is failed

Lianhui Wang created SPARK-12322: Summary: recompute an cached RDD partition when getting its block is failed Key: SPARK-12322 URL: https://issues.apache.org/jira/browse/SPARK-12322 Project: Spark

[jira] [Resolved] (SPARK-11948) Permanent UDF not work

[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11948. --- Resolution: Duplicate Target Version/s: (was: 1.6.0) > Permanent UDF not work >

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056172#comment-15056172 ] Sean Owen commented on SPARK-12219: --- [~RodBoavida] I'm not able to reproduce these compilation

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056180#comment-15056180 ] Rodrigo Boavida commented on SPARK-12219: - Sean - that's great news. Unfortunately I haven't had

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056122#comment-15056122 ] Sean Owen commented on SPARK-4816: -- I did the same pretty much down to the letter and found the

[jira] [Reopened] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RJ Nowling reopened SPARK-4816: --- > Maven profile netlib-lgpl does not work > --- > >

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056115#comment-15056115 ] RJ Nowling commented on SPARK-4816: --- I tested it again to make sure and ran into the same issue: {code}

[jira] [Comment Edited] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056168#comment-15056168 ] RJ Nowling edited comment on SPARK-4816 at 12/14/15 3:57 PM: - I think issue

[jira] [Comment Edited] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056168#comment-15056168 ] RJ Nowling edited comment on SPARK-4816 at 12/14/15 3:58 PM: - I think

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057368#comment-15057368 ] Felix Cheung commented on SPARK-11255: -- Is this test error caused by this?

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057364#comment-15057364 ] Felix Cheung commented on SPARK-12327: -- In fact [~yu_ishikawa] did open a PR for a subset of these

[jira] [Comment Edited] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057374#comment-15057374 ] Sun Rui edited comment on SPARK-11255 at 12/15/15 5:31 AM: --- seems 'plyr'

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057374#comment-15057374 ] Sun Rui commented on SPARK-11255: - seems 'plyr' package has to be rebuilt under R 3.1.1 > R Test build

[jira] [Assigned] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12332: Assignee: Apache Spark > Typo in ResetSystemProperties.scala's comments >

[jira] [Commented] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%

[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057400#comment-15057400 ] jeffonia Tung commented on SPARK-4049: -- I got the same phase, the fraction cached goes up to 200%,

[jira] [Commented] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%

[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15057500#comment-15057500 ] Warren Wang commented on SPARK-4049: Actually the fraction cached will not expand when the

[jira] [Created] (SPARK-12333) Support shuffle spill encryption in Spark

Ferdinand Xu created SPARK-12333: Summary: Support shuffle spill encryption in Spark Key: SPARK-12333 URL: https://issues.apache.org/jira/browse/SPARK-12333 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-8402) Add DP means clustering to MLlib

[ https://issues.apache.org/jira/browse/SPARK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meethu Mathew updated SPARK-8402: - Summary: Add DP means clustering to MLlib (was: DP means clustering ) > Add DP means clustering

[jira] [Created] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

holdenk created SPARK-12332: --- Summary: Typo in ResetSystemProperties.scala's comments Key: SPARK-12332 URL: https://issues.apache.org/jira/browse/SPARK-12332 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

[ https://issues.apache.org/jira/browse/SPARK-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12288. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10285

[jira] [Updated] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

[ https://issues.apache.org/jira/browse/SPARK-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen updated SPARK-12330: -- Description: A simple line count example can be launched as similar to {code}

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055985#comment-15055985 ] Sean Owen commented on SPARK-12319: --- Do you have any more detail here -- what specifically is the test

[jira] [Created] (SPARK-12321) JSON format for logical/physical execution plans

Wenchen Fan created SPARK-12321: --- Summary: JSON format for logical/physical execution plans Key: SPARK-12321 URL: https://issues.apache.org/jira/browse/SPARK-12321 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056040#comment-15056040 ] Adam Roberts commented on SPARK-12319: -- Hi Sean, here are the failures ExchangeCoordinatorSuite: -

[jira] [Resolved] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4816. -- Resolution: Fixed I'm re-resolving this since I've tested this exact branch and master recently and

[jira] [Comment Edited] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055073#comment-15055073 ] Sean Owen edited comment on SPARK-12311 at 12/14/15 1:45 PM: - LGTM, feel free

[jira] [Commented] (SPARK-9578) Stemmer feature transformer

[ https://issues.apache.org/jira/browse/SPARK-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055979#comment-15055979 ] Apache Spark commented on SPARK-9578: - User 'hhbyyh' has created a pull request for this issue:

[jira] [Updated] (SPARK-12275) No plan for BroadcastHint in some condition

[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12275: -- Labels: backport-needed (was: ) > No plan for BroadcastHint in some condition >

[jira] [Assigned] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12321: Assignee: Apache Spark > JSON format for logical/physical execution plans >

[jira] [Commented] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056048#comment-15056048 ] Apache Spark commented on SPARK-12321: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12321: Assignee: (was: Apache Spark) > JSON format for logical/physical execution plans >

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056348#comment-15056348 ] Sean Owen commented on SPARK-4816: -- I tried your exact build above and I get lots of hits for

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056339#comment-15056339 ] Sean Owen commented on SPARK-12219: --- I tried building branch 1.5 and I do see some of the same

[jira] [Created] (SPARK-12323) Don't assign default value for non-nullable columns of a Dataset

Cheng Lian created SPARK-12323: -- Summary: Don't assign default value for non-nullable columns of a Dataset Key: SPARK-12323 URL: https://issues.apache.org/jira/browse/SPARK-12323 Project: Spark

[jira] [Commented] (SPARK-12311) [CORE] Restore previous value of "os.arch" property in test suites after forcing to set specific value to "os.arch" property

[ https://issues.apache.org/jira/browse/SPARK-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056317#comment-15056317 ] Kazuaki Ishizaki commented on SPARK-12311: -- Yes. Even when I run core test on a ppc64le machine,

  1   2   >