[jira] [Created] (SPARK-5141) CaseInsensitiveMap throws "java.io.NotSerializableException"

2015-01-07 Thread Gankun Luo (JIRA)
Gankun Luo created SPARK-5141: - Summary: CaseInsensitiveMap throws "java.io.NotSerializableException" Key: SPARK-5141 URL: https://issues.apache.org/jira/browse/SPARK-5141 Project: Spark Issue T

[jira] [Updated] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5116: - Assignee: Shuo Xiang > Add extractor for SparseVector and DenseVector in MLlib >

[jira] [Resolved] (SPARK-5116) Add extractor for SparseVector and DenseVector in MLlib

2015-01-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5116. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3919 [https://githu

[jira] [Resolved] (SPARK-5126) No error log for a typo master url

2015-01-07 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5126. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Shixiong Zhu > No error log for a t

[jira] [Comment Edited] (SPARK-4960) Interceptor pattern in receivers

2015-01-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268886#comment-14268886 ] Saisai Shao edited comment on SPARK-4960 at 1/8/15 6:45 AM: Hi

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-07 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268894#comment-14268894 ] Cheng Lian commented on SPARK-4908: --- It was considered as a "quick fix" because we hadn'

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-07 Thread David Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268892#comment-14268892 ] David Ross commented on SPARK-4908: --- I've verified that this is fixed on trunk. Since hi

[jira] [Commented] (SPARK-4960) Interceptor pattern in receivers

2015-01-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268886#comment-14268886 ] Saisai Shao commented on SPARK-4960: Hi all, I just update the doc according to TD's

[jira] [Commented] (SPARK-1825) Windows Spark fails to work with Linux YARN

2015-01-07 Thread Masayoshi TSUZUKI (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268863#comment-14268863 ] Masayoshi TSUZUKI commented on SPARK-1825: -- It is necessary to use $$() to solve

[jira] [Commented] (SPARK-5117) Hive Generic UDFs don't cast correctly

2015-01-07 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268861#comment-14268861 ] Cheng Hao commented on SPARK-5117: -- Definitely we can do that then. > Hive Generic UDFs

[jira] [Commented] (SPARK-1825) Windows Spark fails to work with Linux YARN

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268858#comment-14268858 ] Apache Spark commented on SPARK-1825: - User 'tsudukim' has created a pull request for

[jira] [Commented] (SPARK-5042) Updated Receiver API to make it easier to write reliable receivers that ack source

2015-01-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268846#comment-14268846 ] Saisai Shao commented on SPARK-5042: Hey TD, what is your schedule on this? > Updated

[jira] [Comment Edited] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268826#comment-14268826 ] Jongyoul Lee edited comment on SPARK-4922 at 1/8/15 5:35 AM: -

[jira] [Commented] (SPARK-4943) Parsing error for query with table name having dot

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268830#comment-14268830 ] Apache Spark commented on SPARK-4943: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268826#comment-14268826 ] Jongyoul Lee commented on SPARK-4922: - [~andrewor14] Hi, I have a basic question about

[jira] [Commented] (SPARK-5080) Expose more cluster resource information to user

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268786#comment-14268786 ] Xuefu Zhang commented on SPARK-5080: cc: [~sandyr] > Expose more cluster resource inf

[jira] [Commented] (SPARK-4689) Unioning 2 SchemaRDDs should return a SchemaRDD in Python, Scala, and Java

2015-01-07 Thread Bibudh Lahiri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268720#comment-14268720 ] Bibudh Lahiri commented on SPARK-4689: -- I'd like to work on this issue, but would nee

[jira] [Updated] (SPARK-5140) Two RDDs which are scheduled concurrently should be able to wait on parent in all cases

2015-01-07 Thread Corey J. Nolet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corey J. Nolet updated SPARK-5140: -- Description: Not sure if this would change too much of the internals to be included in the 1.2.

[jira] [Updated] (SPARK-5140) Two RDDs which are scheduled concurrently should be able to wait on parent in all cases

2015-01-07 Thread Corey J. Nolet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corey J. Nolet updated SPARK-5140: -- Description: Not sure if this would change too much of the internals to be included in the 1.2.

[jira] [Updated] (SPARK-5140) Two RDDs which are scheduled concurrently should be able to wait on parent in all cases

2015-01-07 Thread Corey J. Nolet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corey J. Nolet updated SPARK-5140: -- Description: Not sure if this would change too much of the internals to be included in the 1.2.

[jira] [Updated] (SPARK-5140) Two RDDs which are scheduled concurrently should be able to wait on parent in all cases

2015-01-07 Thread Corey J. Nolet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corey J. Nolet updated SPARK-5140: -- Description: Not sure if this would change too much of the internals to be included in the 1.2.

[jira] [Created] (SPARK-5140) Two RDDs which are scheduled concurrently should be able to wait on parent in all cases

2015-01-07 Thread Corey J. Nolet (JIRA)
Corey J. Nolet created SPARK-5140: - Summary: Two RDDs which are scheduled concurrently should be able to wait on parent in all cases Key: SPARK-5140 URL: https://issues.apache.org/jira/browse/SPARK-5140

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Kushal Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268679#comment-14268679 ] Kushal Datta commented on SPARK-3789: - Okay, I'll push for it. Will keep you guys upda

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268675#comment-14268675 ] Davies Liu commented on SPARK-3789: --- It's expected to cut at the beginning of Feb 2015.

[jira] [Commented] (SPARK-4159) Maven build doesn't run JUnit test suites

2015-01-07 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268673#comment-14268673 ] Sandy Ryza commented on SPARK-4159: --- [~pwendell] [~srowen] After this change it looks li

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Kushal Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268667#comment-14268667 ] Kushal Datta commented on SPARK-3789: - When is 1.3 due? > Python bindings for GraphX

[jira] [Updated] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory)

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4777: - Priority: Major (was: Minor) > Some block memory after unrollSafely not count into used > memory(memoryS

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Ameet Talwalkar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268658#comment-14268658 ] Ameet Talwalkar commented on SPARK-3789: Agreed, thanks for the update! Also, 1.

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268653#comment-14268653 ] Davies Liu commented on SPARK-3789: --- [~kdatta1978] Cool! Is there any chance to publish

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Kushal Datta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268649#comment-14268649 ] Kushal Datta commented on SPARK-3789: - Hi Davies, Here are the list of things which I

[jira] [Commented] (SPARK-3789) Python bindings for GraphX

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268640#comment-14268640 ] Davies Liu commented on SPARK-3789: --- Any updates? > Python bindings for GraphX > --

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268559#comment-14268559 ] Davies Liu commented on SPARK-3910: --- It does not have random.py in branch-1.0, so 1.1 is

[jira] [Created] (SPARK-5139) select table_alias.* with joins and selecting column names from inner queries not supported

2015-01-07 Thread Sunita Koppar (JIRA)
Sunita Koppar created SPARK-5139: Summary: select table_alias.* with joins and selecting column names from inner queries not supported Key: SPARK-5139 URL: https://issues.apache.org/jira/browse/SPARK-5139

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268543#comment-14268543 ] Josh Rosen commented on SPARK-3910: --- [~davies], what about branch-1.0? We might want to

[jira] [Updated] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-01-07 Thread Zach Fry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zach Fry updated SPARK-4879: Attachment: speculation2.txt speculation.txt Hey Josh, I have been playing around with you

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268529#comment-14268529 ] Davies Liu commented on SPARK-3910: --- [~joshrosen] I think we should backport SPARK-4348

[jira] [Commented] (SPARK-5053) Test maintenance branches on Jenkins using SBT

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268526#comment-14268526 ] Sean Owen commented on SPARK-5053: -- I think a number of these are just due to running man

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268498#comment-14268498 ] Josh Rosen commented on SPARK-3910: --- Oh, I noticed this in 1.1 (while setting up SBT tes

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268496#comment-14268496 ] Davies Liu commented on SPARK-3910: --- The 1.2 branch should not fail in a clean environme

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268480#comment-14268480 ] Thomas Graves commented on SPARK-2541: -- Yeah kind of. I guess 3438 is to officially

[jira] [Commented] (SPARK-2541) Standalone mode can't access secure HDFS anymore

2015-01-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268475#comment-14268475 ] Nicholas Chammas commented on SPARK-2541: - By the way, should this issue be linked

[jira] [Updated] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4951: - Assignee: Shixiong Zhu > A busy executor may be killed when dynamicAllocation is enabled > ---

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268458#comment-14268458 ] Sean Owen commented on SPARK-5136: -- [~pwendell] Before I suggest a change to the IntelliJ

[jira] [Comment Edited] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268440#comment-14268440 ] Gerard Maas edited comment on SPARK-4940 at 1/7/15 10:54 PM: -

[jira] [Comment Edited] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268440#comment-14268440 ] Gerard Maas edited comment on SPARK-4940 at 1/7/15 10:53 PM: -

[jira] [Comment Edited] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268440#comment-14268440 ] Gerard Maas edited comment on SPARK-4940 at 1/7/15 10:52 PM: -

[jira] [Commented] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-01-07 Thread Gerard Maas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268440#comment-14268440 ] Gerard Maas commented on SPARK-4940: Hi Tim, We are indeed using Coarse Grain mode. I

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268411#comment-14268411 ] Apache Spark commented on SPARK-3910: - User 'JoshRosen' has created a pull request for

[jira] [Updated] (SPARK-4983) Tag EC2 instances in the same call that launches them

2015-01-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4983: Labels: starter (was: ) > Tag EC2 instances in the same call that launches them > -

[jira] [Commented] (SPARK-5122) Remove Shark from spark-ec2

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268390#comment-14268390 ] Apache Spark commented on SPARK-5122: - User 'nchammas' has created a pull request for

[jira] [Commented] (SPARK-4406) SVD should check for k < 1

2015-01-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268368#comment-14268368 ] Joseph K. Bradley commented on SPARK-4406: -- Also, to get JIRAs assigned to you, y

[jira] [Commented] (SPARK-4406) SVD should check for k < 1

2015-01-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268358#comment-14268358 ] Joseph K. Bradley commented on SPARK-4406: -- It's good to get it assigned if it wi

[jira] [Updated] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4951: - Affects Version/s: 1.2.0 > A busy executor may be killed when dynamicAllocation is enabled > -

[jira] [Commented] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268336#comment-14268336 ] Apache Spark commented on SPARK-5108: - User 'zhzhan' has created a pull request for th

[jira] [Commented] (SPARK-3910) ./python/pyspark/mllib/classification.py doctests fails with module name pollution

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268332#comment-14268332 ] Josh Rosen commented on SPARK-3910: --- It looks like this was fixed in SPARK-4348, but it

[jira] [Commented] (SPARK-5053) Test maintenance branches on Jenkins using SBT

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268321#comment-14268321 ] Josh Rosen commented on SPARK-5053: --- Hmm, it looks like the Python issue is an occurrenc

[jira] [Commented] (SPARK-5053) Test maintenance branches on Jenkins using SBT

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268313#comment-14268313 ] Josh Rosen commented on SPARK-5053: --- It looks like nearly all of these new builds are fa

[jira] [Commented] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268241#comment-14268241 ] Apache Spark commented on SPARK-5108: - User 'zhzhan' has created a pull request for th

[jira] [Comment Edited] (SPARK-4406) SVD should check for k < 1

2015-01-07 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268180#comment-14268180 ] Manoj Kumar edited comment on SPARK-4406 at 1/7/15 8:40 PM: Hi

[jira] [Commented] (SPARK-4406) SVD should check for k < 1

2015-01-07 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268180#comment-14268180 ] Manoj Kumar commented on SPARK-4406: Hi Joseph, I believe this issue would be simple e

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268146#comment-14268146 ] Ryan Williams commented on SPARK-5136: -- I've not started on it so feel free to grab t

[jira] [Updated] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5132: -- Assignee: SuYan > The name for get stage info atempt ID from Json was wrong > --

[jira] [Updated] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5132: -- Component/s: Web UI > The name for get stage info atempt ID from Json was wrong > --

[jira] [Resolved] (SPARK-5132) The name for get stage info atempt ID from Json was wrong

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5132. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) 1.2.1 1.

[jira] [Updated] (SPARK-2298) Show stage attempt in UI

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2298: -- Fix Version/s: 1.1.0 > Show stage attempt in UI > > > Key: SPAR

[jira] [Resolved] (SPARK-5039) Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to "javax.servlet.FilterRegistration's signer information" errors

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5039. --- Resolution: Fixed Fix Version/s: 1.0.3 Issue resolved by pull request 3864 [https://github.com/

[jira] [Updated] (SPARK-5039) Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to "javax.servlet.FilterRegistration's signer information" errors

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5039: -- Assignee: Sean Owen > Spark 1.0 2.0.0-mr1-cdh4.1.2 Maven build fails due to > "javax.servlet.FilterRegi

[jira] [Commented] (SPARK-4906) Spark master OOMs with exception stack trace stored in JobProgressListener

2015-01-07 Thread Zach Fry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268113#comment-14268113 ] Zach Fry commented on SPARK-4906: - [~pwendell], Looks like you wanted to ping [~mkim]. H

[jira] [Updated] (SPARK-4389) Set akka.remote.netty.tcp.bind-hostname="0.0.0.0" so driver can be located behind NAT

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4389: - Affects Version/s: 1.2.0 > Set akka.remote.netty.tcp.bind-hostname="0.0.0.0" so driver can be located > b

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268106#comment-14268106 ] Sean Owen commented on SPARK-5136: -- [~rdub] Are you taking a crack at this or should I? I

[jira] [Updated] (SPARK-4286) Support External Shuffle Service with Mesos integration

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4286: - Affects Version/s: 1.2.0 > Support External Shuffle Service with Mesos integration > -

[jira] [Commented] (SPARK-5053) Test maintenance branches on Jenkins using SBT

2015-01-07 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268081#comment-14268081 ] Josh Rosen commented on SPARK-5053: --- I've created Jenkins builds for this: https://ampl

[jira] [Commented] (SPARK-3885) Provide mechanism to remove accumulators once they are no longer used

2015-01-07 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268079#comment-14268079 ] Ilya Ganelin commented on SPARK-3885: - Hi [~joshrosen], I can knock this one out - cou

[jira] [Updated] (SPARK-5138) pyspark unable to infer schema of namedtuple

2015-01-07 Thread Gabe Mulley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabe Mulley updated SPARK-5138: --- Description: When attempting to infer the schema of an RDD that contains namedtuples, pyspark fails t

[jira] [Created] (SPARK-5138) pyspark unable to infer schema of namedtuple

2015-01-07 Thread Gabe Mulley (JIRA)
Gabe Mulley created SPARK-5138: -- Summary: pyspark unable to infer schema of namedtuple Key: SPARK-5138 URL: https://issues.apache.org/jira/browse/SPARK-5138 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5137) subtract does not take the spark.default.parallelism into account

2015-01-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268061#comment-14268061 ] Sean Owen commented on SPARK-5137: -- (You mean {{subtractByKey}}? that's the one in {{Pair

[jira] [Commented] (SPARK-5117) Hive Generic UDFs don't cast correctly

2015-01-07 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268049#comment-14268049 ] Michael Armbrust commented on SPARK-5117: - Oh, okay. Thanks for investigating! I

[jira] [Resolved] (SPARK-5125) Time major blocks of code in spark-ec2/setup.sh

2015-01-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-5125. - Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 Resolved b

[jira] [Updated] (SPARK-4284) BinaryClassificationMetrics precision-recall method names should correspond to return types

2015-01-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4284: - Assignee: Kai Sasaki > BinaryClassificationMetrics precision-recall method names should co

[jira] [Resolved] (SPARK-5128) Add stable log1pExp impl

2015-01-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5128. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3915 [https://githu

[jira] [Commented] (SPARK-4768) Add Support For Impala Encoded Timestamp (INT96)

2015-01-07 Thread Taiji Okada (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267894#comment-14267894 ] Taiji Okada commented on SPARK-4768: Note that the attached parquet file, is stored in

[jira] [Updated] (SPARK-4768) Add Support For Impala Encoded Timestamp (INT96)

2015-01-07 Thread Taiji Okada (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taiji Okada updated SPARK-4768: --- Attachment: 5e4481a02f951e29-651ee94ed14560bf_922627129_data.0.parq Attached parquet file, created usi

[jira] [Commented] (SPARK-5135) Add support for describe [extended] table to DDL in SQLContext

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267874#comment-14267874 ] Apache Spark commented on SPARK-5135: - User 'OopsOutOfMemory' has created a pull reque

[jira] [Commented] (SPARK-5134) Bump default Hadoop version to 2+

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267867#comment-14267867 ] Apache Spark commented on SPARK-5134: - User 'ryan-williams' has created a pull request

[jira] [Created] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

2015-01-07 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-5136: Summary: Improve documentation around setting up Spark IntelliJ project Key: SPARK-5136 URL: https://issues.apache.org/jira/browse/SPARK-5136 Project: Spark

[jira] [Created] (SPARK-5137) subtract does not take the spark.default.parallelism into account

2015-01-07 Thread Al M (JIRA)
Al M created SPARK-5137: --- Summary: subtract does not take the spark.default.parallelism into account Key: SPARK-5137 URL: https://issues.apache.org/jira/browse/SPARK-5137 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-5135) Add support for describe [extended] table to DDL in SQLContext

2015-01-07 Thread shengli (JIRA)
shengli created SPARK-5135: -- Summary: Add support for describe [extended] table to DDL in SQLContext Key: SPARK-5135 URL: https://issues.apache.org/jira/browse/SPARK-5135 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-4768) Add Support For Impala Encoded Timestamp (INT96)

2015-01-07 Thread Taiji Okada (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taiji Okada updated SPARK-4768: --- Comment: was deleted (was: I am currently out of the office with limited access to email or voicemail

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-07 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267831#comment-14267831 ] Ryan Williams commented on SPARK-5115: -- filed [SPARK-5134|https://issues.apache.org/j

[jira] [Created] (SPARK-5134) Bump default Hadoop version to 2+

2015-01-07 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-5134: Summary: Bump default Hadoop version to 2+ Key: SPARK-5134 URL: https://issues.apache.org/jira/browse/SPARK-5134 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5115) Intellij fails to find hadoop classes in Spark "yarn" modules

2015-01-07 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267824#comment-14267824 ] Ryan Williams commented on SPARK-5115: -- cool, thanks [~srowen]. Let me close this JIR

[jira] [Closed] (SPARK-2458) Make failed application log visible on History Server

2015-01-07 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2458. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Masayoshi TSUZUKI Target Versio

[jira] [Comment Edited] (SPARK-3619) Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267701#comment-14267701 ] Jongyoul Lee edited comment on SPARK-3619 at 1/7/15 3:01 PM: -

[jira] [Commented] (SPARK-3619) Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-07 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267701#comment-14267701 ] Jongyoul Lee commented on SPARK-3619: - [~tnachen] fixing the version from 0.18.1 to 0.

[jira] [Commented] (SPARK-3619) Upgrade to Mesos 0.21 to work around MESOS-1688

2015-01-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267697#comment-14267697 ] Apache Spark commented on SPARK-3619: - User 'jongyoul' has created a pull request for

[jira] [Updated] (SPARK-2165) spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-2165: - Assignee: WangTaoTheTonic (was: Thomas Graves) > spark on yarn: add support for setting maxAppAtt

[jira] [Assigned] (SPARK-2165) spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-2165: Assignee: Thomas Graves > spark on yarn: add support for setting maxAppAttempts in the > A

[jira] [Resolved] (SPARK-2165) spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-2165. -- Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: 1.3.0 > spark on yarn:

[jira] [Resolved] (SPARK-4929) Yarn Client mode can not support the HA after the exitcode change

2015-01-07 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4929. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 > Yarn Client mode can no

[jira] [Commented] (SPARK-4240) Refine Tree Predictions in Gradient Boosting to Improve Prediction Accuracy.

2015-01-07 Thread Peter Prettenhofer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267645#comment-14267645 ] Peter Prettenhofer commented on SPARK-4240: --- [~codedeft] I'm not sure if I under

  1   2   >