[jira] [Resolved] (SPARK-8147) Add ability to decorate RDD iterators

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8147. -- Resolution: Won't Fix > Add ability to decorate RDD iterators > - >

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584481#comment-14584481 ] Sean Owen commented on SPARK-8335: -- Yeah, the signature is actually a JavaRDD of scala.Do

[jira] [Updated] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

2015-06-12 Thread nevi_me (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nevi_me updated SPARK-8340: --- Description: I tried executing the following code: {code:title="extract from dataframe.R in examples"} libr

[jira] [Created] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

2015-06-12 Thread Neville Dipale (JIRA)
Neville Dipale created SPARK-8340: - Summary: Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2 Key: SPARK-8340 URL: https://issues.apache.org/jira/browse/SPARK-8340 Proj

[jira] [Resolved] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8329. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > DataSource options parser n

[jira] [Resolved] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7186. Resolution: Fixed Fix Version/s: 1.5.0 > Decouple internal Row from external Row > --

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-12 Thread Holman Lan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584448#comment-14584448 ] Holman Lan commented on SPARK-5680: --- Thanks. A closer look at the statement in the descr

[jira] [Assigned] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8339: --- Assignee: Apache Spark > Itertools islice requires an integer for the stop argument. > --

[jira] [Commented] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584397#comment-14584397 ] Apache Spark commented on SPARK-8339: - User 'kconor' has created a pull request for th

[jira] [Assigned] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8339: --- Assignee: (was: Apache Spark) > Itertools islice requires an integer for the stop argumen

[jira] [Commented] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584379#comment-14584379 ] Vladimir Vladimirov commented on SPARK-8338: Here are PRs for branches 1.3 and

[jira] [Updated] (SPARK-8338) Ganglia fails to run because of httpd.conf configuration mismatch

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8338: --- Summary: Ganglia fails to run because of httpd.conf configuration mismatch (was: Gang

[jira] [Created] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-12 Thread Kevin Conor (JIRA)
Kevin Conor created SPARK-8339: -- Summary: Itertools islice requires an integer for the stop argument. Key: SPARK-8339 URL: https://issues.apache.org/jira/browse/SPARK-8339 Project: Spark Issue

[jira] [Resolved] (SPARK-8314) improvement in performance of MLUtils.appendBias

2015-06-12 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-8314. Resolution: Fixed Merged into master https://github.com/apache/spark/commit/6e9c3ff1ecaf12a0126d83f27f5a4153

[jira] [Updated] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8338: --- Priority: Minor (was: Major) > Ganglia fails to run because of broken httpd.conf conf

[jira] [Comment Edited] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584344#comment-14584344 ] Vladimir Vladimirov edited comment on SPARK-8338 at 6/13/15 12:59 AM: --

[jira] [Commented] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584344#comment-14584344 ] Vladimir Vladimirov commented on SPARK-8338: There are several possible soluti

[jira] [Commented] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584341#comment-14584341 ] Vladimir Vladimirov commented on SPARK-8338: Same exception happens for both b

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584338#comment-14584338 ] Michael Armbrust commented on SPARK-5680: - As stated in the comment, the motivatio

[jira] [Created] (SPARK-8338) Ganglia fails to run because of broken httpd.conf configuration

2015-06-12 Thread Vladimir Vladimirov (JIRA)
Vladimir Vladimirov created SPARK-8338: -- Summary: Ganglia fails to run because of broken httpd.conf configuration Key: SPARK-8338 URL: https://issues.apache.org/jira/browse/SPARK-8338 Project: Sp

[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8327: --- Affects Version/s: (was: 1.4.0) > Ganglia failed to start while starting standalon

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-12 Thread Holman Lan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584324#comment-14584324 ] Holman Lan commented on SPARK-5680: --- Hi Guys, Just curious about this change to return

[jira] [Created] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-12 Thread Amit Ramesh (JIRA)
Amit Ramesh created SPARK-8337: -- Summary: KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version Key: SPARK-8337 URL: https://issues.apache.org/jira/browse/SPARK-8337

[jira] [Updated] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8318: --- Issue Type: Improvement (was: Bug) > Spark Streaming Starter JIRAs >

[jira] [Updated] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8336: --- Component/s: SQL > Fix NullPointerException with functions.rand() > --

[jira] [Assigned] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8336: --- Assignee: Apache Spark > Fix NullPointerException with functions.rand() > ---

[jira] [Assigned] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8336: --- Assignee: (was: Apache Spark) > Fix NullPointerException with functions.rand() >

[jira] [Commented] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584294#comment-14584294 ] Apache Spark commented on SPARK-8336: - User 'tedyu' has created a pull request for thi

[jira] [Created] (SPARK-8336) Fix NullPointerException with functions.rand()

2015-06-12 Thread Ted Yu (JIRA)
Ted Yu created SPARK-8336: - Summary: Fix NullPointerException with functions.rand() Key: SPARK-8336 URL: https://issues.apache.org/jira/browse/SPARK-8336 Project: Spark Issue Type: Bug Re

[jira] [Updated] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Walz updated SPARK-8335: -- Labels: easyfix machine_learning (was: easyfix) > DecisionTreeModel.predict() return type not c

[jira] [Updated] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Walz updated SPARK-8335: -- Description: org.apache.spark.mllib.tree.model.DecisionTreeModel has a predict method: def pred

[jira] [Created] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-12 Thread Sebastian Walz (JIRA)
Sebastian Walz created SPARK-8335: - Summary: DecisionTreeModel.predict() return type not convenient! Key: SPARK-8335 URL: https://issues.apache.org/jira/browse/SPARK-8335 Project: Spark Issue

[jira] [Resolved] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-06-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7284. -- Resolution: Fixed Fix Version/s: 1.4.1 > Update streaming documentation for Spark 1.4.0 r

[jira] [Resolved] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7819. - Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Yin Huai > Isolated Hive

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7186: --- Assignee: Davies Liu (was: Apache Spark) > Decouple internal Row from external Row > ---

[jira] [Commented] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584151#comment-14584151 ] Apache Spark commented on SPARK-7186: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-7186) Decouple internal Row from external Row

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7186: --- Assignee: Apache Spark (was: Davies Liu) > Decouple internal Row from external Row > ---

[jira] [Commented] (SPARK-6892) Recovery from checkpoint will also reuse the application id when write eventLog in yarn-cluster mode

2015-06-12 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584086#comment-14584086 ] Hari Shreedharan commented on SPARK-6892: - This should have been fixed by SPARK-48

[jira] [Assigned] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6259: --- Assignee: (was: Apache Spark) > Python API for LDA > -- > >

[jira] [Commented] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584010#comment-14584010 ] Apache Spark commented on SPARK-6259: - User 'yu-iskw' has created a pull request for t

[jira] [Assigned] (SPARK-6259) Python API for LDA

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6259: --- Assignee: Apache Spark > Python API for LDA > -- > > Key: SPA

[jira] [Assigned] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8334: --- Assignee: Apache Spark > Binary logical plan should provide more realistic statistics > -

[jira] [Commented] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583980#comment-14583980 ] Apache Spark commented on SPARK-8334: - User 'navis' has created a pull request for thi

[jira] [Assigned] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8334: --- Assignee: (was: Apache Spark) > Binary logical plan should provide more realistic statist

[jira] [Comment Edited] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier edited comment on SPARK-7712 at 6/12/15 7:49 PM:

[jira] [Comment Edited] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier edited comment on SPARK-7712 at 6/12/15 7:49 PM:

[jira] [Commented] (SPARK-7712) Native Spark Window Functions & Performance Improvements

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583966#comment-14583966 ] Herman van Hovell tot Westerflier commented on SPARK-7712: -- A sma

[jira] [Created] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Navis (JIRA)
Navis created SPARK-8334: Summary: Binary logical plan should provide more realistic statistics Key: SPARK-8334 URL: https://issues.apache.org/jira/browse/SPARK-8334 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-12 Thread sheng (JIRA)
sheng created SPARK-8333: Summary: Spark failed to delete temp directory created by HiveContext Key: SPARK-8333 URL: https://issues.apache.org/jira/browse/SPARK-8333 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7897) Column with an unsigned bigint should be treated as DecimalType in JDBCRDD

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583937#comment-14583937 ] Apache Spark commented on SPARK-7897: - User 'rtreffer' has created a pull request for

[jira] [Reopened] (SPARK-7897) Column with an unsigned bigint should be treated as DecimalType in JDBCRDD

2015-06-12 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rene Treffer reopened SPARK-7897: - I think this should be Decimal(20,0), not Decimal.Unlimited > Column with an unsigned bigint should b

[jira] [Commented] (SPARK-4233) Simplify the Aggregation Function implementation

2015-06-12 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583931#comment-14583931 ] Herman van Hovell tot Westerflier commented on SPARK-4233: -- Ok, s

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583916#comment-14583916 ] Apache Spark commented on SPARK-8095: - User 'brkyvz' has created a pull request for th

[jira] [Updated] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-12 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-8332: -- Description: I complied new spark 1.4.0 versio. But when I run a simple WordCount demo, it throws NoSuchMethodE

[jira] [Created] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-12 Thread Tao Li (JIRA)
Tao Li created SPARK-8332: - Summary: NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer Key: SPARK-8332 URL: https://issues.apache.org/jira/browse/SPARK-8332 Project: Spark

[jira] [Comment Edited] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-12 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583886#comment-14583886 ] Debasish Das edited comment on SPARK-2336 at 6/12/15 6:51 PM: --

[jira] [Commented] (SPARK-2336) Approximate k-NN Models for MLLib

2015-06-12 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583886#comment-14583886 ] Debasish Das commented on SPARK-2336: - Very cool idea Sen. Did you also look into FLAN

[jira] [Commented] (SPARK-7028) Add filterNot to RDD

2015-06-12 Thread Eran Medan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583835#comment-14583835 ] Eran Medan commented on SPARK-7028: --- Oh, just realised I can just click reply instead of

[jira] [Commented] (SPARK-7028) Add filterNot to RDD

2015-06-12 Thread Eran Medan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583826#comment-14583826 ] Eran Medan commented on SPARK-7028: --- [~srowen] - I completely agreed with you, until I s

[jira] [Commented] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583822#comment-14583822 ] Andrew Or commented on SPARK-8330: -- Second part is merged here: https://github.com/apache

[jira] [Closed] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8330. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > DAG visualization: trim whitespace

[jira] [Resolved] (SPARK-8331) DirectStream wont work

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8331. -- Resolution: Invalid I think this should start as a question on user@ since there are really a bunch of

[jira] [Created] (SPARK-8331) DirectStream wont work

2015-06-12 Thread sid (JIRA)
sid created SPARK-8331: -- Summary: DirectStream wont work Key: SPARK-8331 URL: https://issues.apache.org/jira/browse/SPARK-8331 Project: Spark Issue Type: Bug Components: Streaming Affects

[jira] [Assigned] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8330: --- Assignee: Apache Spark (was: Andrew Or) > DAG visualization: trim whitespace from input > --

[jira] [Assigned] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8330: --- Assignee: Andrew Or (was: Apache Spark) > DAG visualization: trim whitespace from input > --

[jira] [Commented] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583806#comment-14583806 ] Apache Spark commented on SPARK-8330: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583794#comment-14583794 ] Jayant Shekhar commented on SPARK-6723: --- Hey Joseph, I created a pull request for t

[jira] [Assigned] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8329: --- Assignee: Michael Armbrust (was: Apache Spark) > DataSource options parser no longer accepts

[jira] [Commented] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583779#comment-14583779 ] Apache Spark commented on SPARK-8329: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583781#comment-14583781 ] Andrew Or commented on SPARK-8330: -- First part is merged here https://github.com/apache/s

[jira] [Updated] (SPARK-7463) DAG visualization improvements

2015-06-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7463: - Summary: DAG visualization improvements (was: Dag visualization improvements) > DAG visualization improv

[jira] [Created] (SPARK-8330) DAG visualization: trim whitespace from input

2015-06-12 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8330: Summary: DAG visualization: trim whitespace from input Key: SPARK-8330 URL: https://issues.apache.org/jira/browse/SPARK-8330 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8329: --- Assignee: Apache Spark (was: Michael Armbrust) > DataSource options parser no longer accepts

[jira] [Updated] (SPARK-8329) DataSource options parser no longer accepts '_'

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8329: Summary: DataSource options parser no longer accepts '_' (was: DataSource options parser no

[jira] [Updated] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8322: - Fix Version/s: 1.4.1 > EC2 script not fully updated for 1.4.0 release > --

[jira] [Commented] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583760#comment-14583760 ] Reynold Xin commented on SPARK-8301: I think we can take whatever the JVM source code

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583758#comment-14583758 ] Reynold Xin commented on SPARK-8159: [~jersub] sure -- let's wait a bit though. The re

[jira] [Assigned] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6723: --- Assignee: Apache Spark > Model import/export for ChiSqSelector >

[jira] [Assigned] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6723: --- Assignee: (was: Apache Spark) > Model import/export for ChiSqSelector > -

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

2015-06-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583753#comment-14583753 ] Apache Spark commented on SPARK-6723: - User 'jayantshekhar' has created a pull request

[jira] [Resolved] (SPARK-7993) Improve DataFrame.show() output

2015-06-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7993. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Akhil Thatipamula > Improve DataFra

[jira] [Updated] (SPARK-8329) DataSource options parser no longer accepts '_' or '.'

2015-06-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8329: Description: This is a regression from 1.3.1 > DataSource options parser no longer accepts '

[jira] [Created] (SPARK-8329) DataSource options parser no longer accepts '_' or '.'

2015-06-12 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-8329: --- Summary: DataSource options parser no longer accepts '_' or '.' Key: SPARK-8329 URL: https://issues.apache.org/jira/browse/SPARK-8329 Project: Spark Is

[jira] [Comment Edited] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583418#comment-14583418 ] Vladimir Vladimirov edited comment on SPARK-8327 at 6/12/15 4:05 PM: ---

[jira] [Updated] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Vladimirov updated SPARK-8327: --- Description: exception shown {code} [FAILED] Starting httpd: httpd: Syntax error on li

[jira] [Created] (SPARK-8328) Add a CheckAnalysis rule to ensure that Union branches have the same schema

2015-06-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8328: - Summary: Add a CheckAnalysis rule to ensure that Union branches have the same schema Key: SPARK-8328 URL: https://issues.apache.org/jira/browse/SPARK-8328 Project: Spark

[jira] [Updated] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8322: - Assignee: Mark Smith > EC2 script not fully updated for 1.4.0 release > --

[jira] [Resolved] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-12 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dev Lakhani resolved SPARK-8143. Resolution: Fixed Fix Version/s: 1.4.0 Verified, history for killed jobs are now available in

[jira] [Commented] (SPARK-8311) saveAsTextFile with Hadoop1 could lead to errors

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583561#comment-14583561 ] Shivaram Venkataraman commented on SPARK-8311: -- [~lian cheng] I was using Had

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-06-12 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583560#comment-14583560 ] Mridul Muralidharan commented on SPARK-8297: I am not sure why the spark appl

[jira] [Commented] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583559#comment-14583559 ] Shivaram Venkataraman commented on SPARK-8322: -- [~srowen] Could you assign th

[jira] [Resolved] (SPARK-8322) EC2 script not fully updated for 1.4.0 release

2015-06-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8322. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 677

[jira] [Updated] (SPARK-8128) Schema Merging Broken: Dataframe Fails to Recognize Column in Schema

2015-06-12 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brad Willard updated SPARK-8128: Description: I'm loading a folder of parquet files with about 600 parquet files and loading it into

[jira] [Commented] (SPARK-8159) Improve SQL/DataFrame expression coverage

2015-06-12 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583423#comment-14583423 ] Jérémy Subtil commented on SPARK-8159: -- I'd be interested by {{collect_set}} and {{co

[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583418#comment-14583418 ] Vladimir Vladimirov commented on SPARK-8327: Root cause: ganglia/init.sh scrip

[jira] [Commented] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583400#comment-14583400 ] Vladimir Vladimirov commented on SPARK-8327: There is a fix for spark 1.3.1 in

[jira] [Created] (SPARK-8327) Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2

2015-06-12 Thread Vladimir Vladimirov (JIRA)
Vladimir Vladimirov created SPARK-8327: -- Summary: Ganglia failed to start while starting standalone on EC 2 spark with spark-ec2 Key: SPARK-8327 URL: https://issues.apache.org/jira/browse/SPARK-8327

[jira] [Resolved] (SPARK-8326) Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do

2015-06-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8326. -- Resolution: Invalid This is not related to any packaging provided by spark. > Fail: Execution of '/usr/

[jira] [Created] (SPARK-8326) Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do

2015-06-12 Thread Judge Hiciano (JIRA)
Judge Hiciano created SPARK-8326: Summary: Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do Key: SPARK-8326 URL: https://issues.apache.org/jira/browse/SPARK-832

[jira] [Updated] (SPARK-8325) Ability to provide role based row level authorization through Spark SQL

2015-06-12 Thread Mayoor Rao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayoor Rao updated SPARK-8325: -- Attachment: Jira_request_table_authorization.docx More details are covered in the attached document > A

  1   2   >