[jira] [Created] (SPARK-4166) Display the executor ID in the Web UI when ExecutorLostFailure happens

2014-10-30 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-4166: --- Summary: Display the executor ID in the Web UI when ExecutorLostFailure happens Key: SPARK-4166 URL: https://issues.apache.org/jira/browse/SPARK-4166 Project: Spark

[jira] [Created] (SPARK-4165) Actor with Companion throws ambiguous reference error in REPL

2014-10-30 Thread Shiti Saxena (JIRA)
Shiti Saxena created SPARK-4165: --- Summary: Actor with Companion throws ambiguous reference error in REPL Key: SPARK-4165 URL: https://issues.apache.org/jira/browse/SPARK-4165 Project: Spark Is

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191502#comment-14191502 ] Debasish Das commented on SPARK-3987: - Nope...standard ALS...same as netflix params...

[jira] [Commented] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

2014-10-30 Thread Jarred Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191475#comment-14191475 ] Jarred Li commented on SPARK-4164: -- I can work on this issue. Could somebody assign this

[jira] [Updated] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

2014-10-30 Thread Jarred Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarred Li updated SPARK-4164: - Remaining Estimate: 2h Original Estimate: 2h > spark.kryo.registrator shall use comma separated value

[jira] [Created] (SPARK-4164) spark.kryo.registrator shall use comma separated value to support multiple registrator

2014-10-30 Thread Jarred Li (JIRA)
Jarred Li created SPARK-4164: Summary: spark.kryo.registrator shall use comma separated value to support multiple registrator Key: SPARK-4164 URL: https://issues.apache.org/jira/browse/SPARK-4164 Project:

[jira] [Commented] (SPARK-4092) Input metrics don't work for coalesce()'d RDD's

2014-10-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191463#comment-14191463 ] Patrick Wendell commented on SPARK-4092: I'd be fine, as a first step, just doing

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191459#comment-14191459 ] Xiangrui Meng commented on SPARK-3987: -- Please check the condition number of the matr

[jira] [Commented] (SPARK-4079) Snappy bundled with Spark does not work on older Linux distributions

2014-10-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191457#comment-14191457 ] Patrick Wendell commented on SPARK-4079: Yeah that sounds like a good call. Did yo

[jira] [Resolved] (SPARK-4108) Fix uses of @deprecated in catalyst dataTypes

2014-10-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4108. - Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2970 [https:/

[jira] [Resolved] (SPARK-3250) More Efficient Sampling

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3250. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2455 [https://githu

[jira] [Updated] (SPARK-3250) More Efficient Sampling

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3250: - Assignee: Erik Erlandson > More Efficient Sampling > --- > > K

[jira] [Commented] (SPARK-4163) When fetching blocks unsuccessfully, Web UI only displays "Fetch failure"

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191386#comment-14191386 ] Apache Spark commented on SPARK-4163: - User 'zsxwing' has created a pull request for t

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191387#comment-14191387 ] Debasish Das commented on SPARK-3987: - [~mengxr] this came out of an internal dataset

[jira] [Resolved] (SPARK-4124) Simplify serialization and call API in MLlib Python

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4124. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2995 [https://githu

[jira] [Created] (SPARK-4163) When fetching blocks unsuccessfully, Web UI only displays "Fetch failure"

2014-10-30 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-4163: --- Summary: When fetching blocks unsuccessfully, Web UI only displays "Fetch failure" Key: SPARK-4163 URL: https://issues.apache.org/jira/browse/SPARK-4163 Project: Spark

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191354#comment-14191354 ] Xiangrui Meng commented on SPARK-3987: -- [~debasish83] For the sample data, did you ch

[jira] [Commented] (SPARK-4080) "IOException: unexpected exception type" while deserializing tasks

2014-10-30 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191349#comment-14191349 ] Kuldeep commented on SPARK-4080: Hello Josh, I did some testing with 1.1.1-SNAPSHOT branch

[jira] [Commented] (SPARK-4077) A broken string timestamp value can Spark SQL return wrong values for valid string timestamp values

2014-10-30 Thread Venkata Ramana G (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191299#comment-14191299 ] Venkata Ramana G commented on SPARK-4077: - I could not find this behaviour for non

[jira] [Commented] (SPARK-4141) Hide Accumulators column on stage page when no accumulators exist

2014-10-30 Thread Mark Mims (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191293#comment-14191293 ] Mark Mims commented on SPARK-4141: -- I'd like to submit: https://github.com/apache/sp

[jira] [Commented] (SPARK-4141) Hide Accumulators column on stage page when no accumulators exist

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191289#comment-14191289 ] Apache Spark commented on SPARK-4141: - User 'mmm' has created a pull request for this

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191277#comment-14191277 ] Debasish Das commented on SPARK-3987: - Was there more changes that step size in your c

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191269#comment-14191269 ] Shuo Xiang commented on SPARK-3987: --- [~debasish83] Thanks for the follow up. Wondering c

[jira] [Comment Edited] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191245#comment-14191245 ] Debasish Das edited comment on SPARK-3987 at 10/31/14 3:10 AM: -

[jira] [Commented] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191245#comment-14191245 ] Debasish Das commented on SPARK-3987: - NNLS iters 36 result 0.13010360222362655,0.126

[jira] [Reopened] (SPARK-3987) NNLS generates incorrect result

2014-10-30 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das reopened SPARK-3987: - I can send you a further list of failures...this is one more example...I strongly suggest moving to a

[jira] [Commented] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191232#comment-14191232 ] Apache Spark commented on SPARK-2703: - User 'RongGu' has created a pull request for th

[jira] [Created] (SPARK-4162) Make scripts symlinkable

2014-10-30 Thread Shay Seng (JIRA)
Shay Seng created SPARK-4162: Summary: Make scripts symlinkable Key: SPARK-4162 URL: https://issues.apache.org/jira/browse/SPARK-4162 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-4161) Spark shell class path is not correctly set if "spark.driver.extraClassPath" is set in defaults.conf

2014-10-30 Thread Shay Seng (JIRA)
Shay Seng created SPARK-4161: Summary: Spark shell class path is not correctly set if "spark.driver.extraClassPath" is set in defaults.conf Key: SPARK-4161 URL: https://issues.apache.org/jira/browse/SPARK-4161

[jira] [Commented] (SPARK-4147) Remove log4j dependency

2014-10-30 Thread Tobias Pfeiffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191149#comment-14191149 ] Tobias Pfeiffer commented on SPARK-4147: Just to be clear: I didn't necessarily me

[jira] [Commented] (SPARK-4017) Progress bar in console

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191146#comment-14191146 ] Apache Spark commented on SPARK-4017: - User 'davies' has created a pull request for th

[jira] [Closed] (SPARK-4146) [GraphX] Modify option name according to example doc in SynthBenchmark

2014-10-30 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jie Huang closed SPARK-4146. > [GraphX] Modify option name according to example doc in SynthBenchmark >

[jira] [Resolved] (SPARK-4146) [GraphX] Modify option name according to example doc in SynthBenchmark

2014-10-30 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jie Huang resolved SPARK-4146. -- Resolution: Fixed > [GraphX] Modify option name according to example doc in SynthBenchmark > --

[jira] [Reopened] (SPARK-4146) [GraphX] Modify option name according to example doc in SynthBenchmark

2014-10-30 Thread Jie Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jie Huang reopened SPARK-4146: -- > [GraphX] Modify option name according to example doc in SynthBenchmark >

[jira] [Resolved] (SPARK-3968) Use parquet-mr filter2 api in spark sql

2014-10-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3968. - Resolution: Fixed Fix Version/s: (was: 1.1.1) 1.2.0 Issue re

[jira] [Resolved] (SPARK-4120) Join of multiple tables with syntax like SELECT .. FROM T1,T2,T3.. does not work in SparkSQL

2014-10-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4120. - Resolution: Fixed Issue resolved by pull request 2987 [https://github.com/apache/spark/pul

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191060#comment-14191060 ] Marcelo Vanzin commented on SPARK-1537: --- I think it's pretty critical when you can't

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191052#comment-14191052 ] Zhan Zhang commented on SPARK-1537: --- Yarn-2521 can make client easier to use, but not cr

[jira] [Commented] (SPARK-2312) Spark Actors do not handle unknown messages in their receive methods

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191020#comment-14191020 ] Apache Spark commented on SPARK-2312: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-4079) Snappy bundled with Spark does not work on older Linux distributions

2014-10-30 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191013#comment-14191013 ] Kostas Sakellis commented on SPARK-4079: [~pwendell] I'm in favor of checking if S

[jira] [Reopened] (SPARK-3661) spark.*.memory is ignored in cluster mode

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3661: -- > spark.*.memory is ignored in cluster mode > - > >

[jira] [Closed] (SPARK-3661) spark.*.memory is ignored in cluster mode

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3661. Resolution: Fixed Target Version/s: 1.2.0 (was: 1.1.1, 1.2.0) > spark.*.memory is ignored in clus

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191007#comment-14191007 ] Marcelo Vanzin commented on SPARK-1537: --- BTW, if you want a list of things I think a

[jira] [Commented] (SPARK-4029) Update streaming driver to reliably save and recover received block metadata on driver failures

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190999#comment-14190999 ] Apache Spark commented on SPARK-4029: - User 'tdas' has created a pull request for this

[jira] [Created] (SPARK-4160) Standalone cluster mode does not upload all needed jars to driver node

2014-10-30 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-4160: - Summary: Standalone cluster mode does not upload all needed jars to driver node Key: SPARK-4160 URL: https://issues.apache.org/jira/browse/SPARK-4160 Project: Spark

[jira] [Closed] (SPARK-1209) SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1209. Resolution: Fixed > SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop > ---

[jira] [Closed] (SPARK-1209) SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-1209. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Sean Owen (was: Mark Grover) T

[jira] [Updated] (SPARK-1209) SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1209: - Component/s: Spark Core > SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop > ---

[jira] [Reopened] (SPARK-1209) SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-1209: -- > SparkHadoop{MapRed,MapReduce}Util should not use package org.apache.hadoop > -

[jira] [Closed] (SPARK-4078) New FsPermission instance w/o FsPermission.createImmutable in eventlog

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4078. Resolution: Fixed > New FsPermission instance w/o FsPermission.createImmutable in eventlog > ---

[jira] [Updated] (SPARK-4078) New FsPermission instance w/o FsPermission.createImmutable in eventlog

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4078: - Assignee: Jie Huang > New FsPermission instance w/o FsPermission.createImmutable in eventlog > ---

[jira] [Reopened] (SPARK-4078) New FsPermission instance w/o FsPermission.createImmutable in eventlog

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-4078: -- Assignee: (was: Jason Dai) > New FsPermission instance w/o FsPermission.createImmutable in eventlo

[jira] [Updated] (SPARK-4159) Maven build doesn't run JUnit test suites

2014-10-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4159: --- Description: It turns out our Maven build isn't running any Java test suites, and likely hasn

[jira] [Commented] (SPARK-4092) Input metrics don't work for coalesce()'d RDD's

2014-10-30 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190974#comment-14190974 ] Kostas Sakellis commented on SPARK-4092: The current patch I'm working on does the

[jira] [Closed] (SPARK-3661) spark.*.memory is ignored in cluster mode

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3661. Resolution: Fixed Fix Version/s: 1.2.0 > spark.*.memory is ignored in cluster mode >

[jira] [Created] (SPARK-4159) Maven build doesn't run JUnit test suites

2014-10-30 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-4159: -- Summary: Maven build doesn't run JUnit test suites Key: SPARK-4159 URL: https://issues.apache.org/jira/browse/SPARK-4159 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-4153) All columns of the application table in the history page are sorted in alphabetical order

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4153. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 > All columns of the applica

[jira] [Updated] (SPARK-4153) All columns of the application table in the history page are sorted in alphabetical order

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4153: - Assignee: Shixiong Zhu > All columns of the application table in the history page are sorted in > alphabe

[jira] [Closed] (SPARK-4155) Consolidate usages of

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4155. Resolution: Fixed Fix Version/s: 1.2.0 > Consolidate usages of > -- > >

[jira] [Closed] (SPARK-4138) Guard against incompatible settings on the number of executors

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4138. Resolution: Fixed Fix Version/s: 1.2.0 > Guard against incompatible settings on the number of executo

[jira] [Closed] (SPARK-4139) Start the number of executors at the max if dynamic allocation is enabled

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4139. Resolution: Fixed Fix Version/s: 1.2.0 > Start the number of executors at the max if dynamic allocati

[jira] [Closed] (SPARK-3338) Respect user setting of spark.submit.pyFiles

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3338. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 (was: 1.1.1) > Respect user

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190956#comment-14190956 ] Marcelo Vanzin commented on SPARK-1537: --- bq. Please elaborate the changes in case I'

[jira] [Closed] (SPARK-3319) Resolve spark.jars, spark.files, and spark.submit.pyFiles etc.

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3319. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 (was: 1.1.1) > Resolve spar

[jira] [Closed] (SPARK-4078) New FsPermission instance w/o FsPermission.createImmutable in eventlog

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4078. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 > New FsPermission instance

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190946#comment-14190946 ] Zhijie Shen commented on SPARK-1537: bq. That's exactly my point about the ATS not bei

[jira] [Updated] (SPARK-4027) Write Ahead Log backed Block RDD

2014-10-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4027: - Assignee: Hari Shreedharan (was: Tathagata Das) > Write Ahead Log backed Block RDD >

[jira] [Resolved] (SPARK-4027) Write Ahead Log backed Block RDD

2014-10-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4027. -- Resolution: Fixed Fix Version/s: 1.2.0 > Write Ahead Log backed Block RDD > -

[jira] [Updated] (SPARK-4027) Write Ahead Log backed Block RDD

2014-10-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4027: - Summary: Write Ahead Log backed Block RDD (was: HDFS backed Block RDD) > Write Ahead Log backed B

[jira] [Assigned] (SPARK-4027) HDFS backed Block RDD

2014-10-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-4027: Assignee: Tathagata Das (was: Hari Shreedharan) > HDFS backed Block RDD >

[jira] [Resolved] (SPARK-4028) ReceivedBlockHandler interface to abstract the functionality of storage of received data

2014-10-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4028. -- Resolution: Fixed Fix Version/s: 1.2.0 > ReceivedBlockHandler interface to abstract the f

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190863#comment-14190863 ] Marcelo Vanzin commented on SPARK-1537: --- bq. ...security (coming 2.6), high availabi

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190849#comment-14190849 ] Zhijie Shen commented on SPARK-1537: [~vanzin], thanks for introducing YARN timeline s

[jira] [Updated] (SPARK-4158) Spark throws exception when Mesos resources are missing

2014-10-30 Thread Brenden Matthews (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brenden Matthews updated SPARK-4158: Description: Spark throws an exception when trying to check resources which haven't been of

[jira] [Updated] (SPARK-4158) Spark throws exception when Mesos resources are missing

2014-10-30 Thread Brenden Matthews (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brenden Matthews updated SPARK-4158: Description: Spark throws an exception when trying to check resources which haven't been of

[jira] [Updated] (SPARK-4158) Spark throws exception when Mesos resources are missing

2014-10-30 Thread Brenden Matthews (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brenden Matthews updated SPARK-4158: Description: Spark throws an exception when trying to check resources which haven't been of

[jira] [Created] (SPARK-4158) Spark throws exception when Mesos resources are missing

2014-10-30 Thread Brenden Matthews (JIRA)
Brenden Matthews created SPARK-4158: --- Summary: Spark throws exception when Mesos resources are missing Key: SPARK-4158 URL: https://issues.apache.org/jira/browse/SPARK-4158 Project: Spark I

[jira] [Commented] (SPARK-1153) Generalize VertexId in GraphX so that UUIDs can be used as vertex IDs.

2014-10-30 Thread Dan Osipov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190766#comment-14190766 ] Dan Osipov commented on SPARK-1153: --- FWIW, UUID.getMostSignificantBits() or getLeastSign

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190754#comment-14190754 ] Xiangrui Meng commented on SPARK-4121: -- No, we are not using fancy methods. v3.1.1 is

[jira] [Updated] (SPARK-4121) Master build failures after shading commons-math3

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4121: - Assignee: Xiangrui Meng > Master build failures after shading commons-math3 >

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190708#comment-14190708 ] Sean Owen commented on SPARK-4121: -- Sorry I have been traveling without internet. When I

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190699#comment-14190699 ] Apache Spark commented on SPARK-4121: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-1849) sc.textFile does not support non UTF-8 encodings

2014-10-30 Thread Harry Brundage (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190642#comment-14190642 ] Harry Brundage commented on SPARK-1849: --- What do you guys think about making an `sc.

[jira] [Commented] (SPARK-4156) Add expectation maximization for Gaussian mixture models to MLLib clustering

2014-10-30 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190624#comment-14190624 ] Travis Galoppo commented on SPARK-4156: --- Pull request #3022 issued with changes impl

[jira] [Created] (SPARK-4157) Task input statistics incomplete when a task reads from multiple locations

2014-10-30 Thread Charles Reiss (JIRA)
Charles Reiss created SPARK-4157: Summary: Task input statistics incomplete when a task reads from multiple locations Key: SPARK-4157 URL: https://issues.apache.org/jira/browse/SPARK-4157 Project: Spa

[jira] [Commented] (SPARK-4156) Add expectation maximization for Gaussian mixture models to MLLib clustering

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190616#comment-14190616 ] Apache Spark commented on SPARK-4156: - User 'tgaloppo' has created a pull request for

[jira] [Resolved] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4111. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2978 [https://githu

[jira] [Updated] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4111: - Assignee: Yanbo Liang > [MLlib] Implement regression model evaluation metrics > --

[jira] [Commented] (SPARK-4155) Consolidate usages of

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190598#comment-14190598 ] Apache Spark commented on SPARK-4155: - User 'andrewor14' has created a pull request fo

[jira] [Created] (SPARK-4156) Add expectation maximization for Gaussian mixture models to MLLib clustering

2014-10-30 Thread Travis Galoppo (JIRA)
Travis Galoppo created SPARK-4156: - Summary: Add expectation maximization for Gaussian mixture models to MLLib clustering Key: SPARK-4156 URL: https://issues.apache.org/jira/browse/SPARK-4156 Project:

[jira] [Created] (SPARK-4155) Consolidate usages of

2014-10-30 Thread Andrew Or (JIRA)
Andrew Or created SPARK-4155: Summary: Consolidate usages of Key: SPARK-4155 URL: https://issues.apache.org/jira/browse/SPARK-4155 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Updated] (SPARK-3958) Possible stream-corruption issues in TorrentBroadcast

2014-10-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3958: -- Priority: Blocker (was: Major) > Possible stream-corruption issues in TorrentBroadcast > --

[jira] [Commented] (SPARK-4077) A broken string timestamp value can Spark SQL return wrong values for valid string timestamp values

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190533#comment-14190533 ] Apache Spark commented on SPARK-4077: - User 'gvramana' has created a pull request for

[jira] [Commented] (SPARK-4077) A broken string timestamp value can Spark SQL return wrong values for valid string timestamp values

2014-10-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190531#comment-14190531 ] Yin Huai commented on SPARK-4077: - [~gvramana] Thank you for looking at it. Seems for text

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190500#comment-14190500 ] Xiangrui Meng commented on SPARK-4121: -- [~srowen] Are you working on this? I played w

[jira] [Assigned] (SPARK-1000) Crash when running SparkPi example with local-cluster

2014-10-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-1000: Assignee: Andrew Or > Crash when running SparkPi example with local-cluster > -

[jira] [Commented] (SPARK-4154) Query does not work if it has "not between " in Spark SQL and HQL

2014-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190462#comment-14190462 ] Apache Spark commented on SPARK-4154: - User 'ravipesala' has created a pull request fo

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-10-30 Thread Vishal Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190443#comment-14190443 ] Vishal Patel commented on SPARK-1867: - I take that back, it works now! The only thin

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-10-30 Thread Vishal Patel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190391#comment-14190391 ] Vishal Patel commented on SPARK-1867: - I am getting the exact same error with Spark 1.

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190396#comment-14190396 ] Marcelo Vanzin commented on SPARK-1537: --- Hi Zhan, As I mentioned, I'm waiting for i

  1   2   >