[jira] [Commented] (SPARK-10130) type coercion for IF should have children resolved first

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704398#comment-14704398 ] Apache Spark commented on SPARK-10130: -- User 'adrian-wang' has created a pull reques

[jira] [Assigned] (SPARK-10130) type coercion for IF should have children resolved first

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10130: Assignee: Apache Spark > type coercion for IF should have children resolved first > --

[jira] [Assigned] (SPARK-10130) type coercion for IF should have children resolved first

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10130: Assignee: (was: Apache Spark) > type coercion for IF should have children resolved fir

[jira] [Created] (SPARK-10130) type coercion for IF should have children resolved first

2015-08-19 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-10130: --- Summary: type coercion for IF should have children resolved first Key: SPARK-10130 URL: https://issues.apache.org/jira/browse/SPARK-10130 Project: Spark Issue

[jira] [Commented] (SPARK-9040) StructField datatype Conversion Error

2015-08-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704393#comment-14704393 ] Yanbo Liang commented on SPARK-9040: [~vnayak053] The code work well on Spark 1.4. Do

[jira] [Commented] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

2015-08-19 Thread pin_zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704374#comment-14704374 ] pin_zhang commented on SPARK-9686: -- What's the status of this bug? will it be fixed in 1.

[jira] [Commented] (SPARK-10100) AggregateFunction2's Max is slower than AggregateExpression1's MaxFunction

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704351#comment-14704351 ] Yin Huai commented on SPARK-10100: -- How about we leave these functions as is for now (lo

[jira] [Comment Edited] (SPARK-10100) AggregateFunction2's Max is slower than AggregateExpression1's MaxFunction

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704322#comment-14704322 ] Yin Huai edited comment on SPARK-10100 at 8/20/15 5:53 AM: --- The

[jira] [Commented] (SPARK-10100) AggregateFunction2's Max is slower than AggregateExpression1's MaxFunction

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704322#comment-14704322 ] Yin Huai commented on SPARK-10100: -- The dataset I created has 11 columns and 2 group

[jira] [Comment Edited] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704311#comment-14704311 ] Cheng Hao edited comment on SPARK-9357 at 8/20/15 5:29 AM: --- Join

[jira] [Comment Edited] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704311#comment-14704311 ] Cheng Hao edited comment on SPARK-9357 at 8/20/15 5:28 AM: --- Join

[jira] [Commented] (SPARK-10100) AggregateFunction2's Max is slower than AggregateExpression1's MaxFunction

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704309#comment-14704309 ] Yin Huai commented on SPARK-10100: -- I was comparing 1.4 with 1.5 and found 1.5 is slower

[jira] [Commented] (SPARK-9357) Remove JoinedRow

2015-08-19 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704311#comment-14704311 ] Cheng Hao commented on SPARK-9357: -- JoinedRow does increase the overhead by adding layer

[jira] [Created] (SPARK-10129) math function: stddev_samp

2015-08-19 Thread Davies Liu (JIRA)
Davies Liu created SPARK-10129: -- Summary: math function: stddev_samp Key: SPARK-10129 URL: https://issues.apache.org/jira/browse/SPARK-10129 Project: Spark Issue Type: New Feature Comp

[jira] [Commented] (SPARK-9400) Implement code generation for StringLocate

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704283#comment-14704283 ] Apache Spark commented on SPARK-9400: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

2015-08-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704272#comment-14704272 ] Tathagata Das commented on SPARK-9523: -- Arent JavaSerializable objects automatically

[jira] [Resolved] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10128. --- Resolution: Fixed Target Version/s: 1.5.0 > Kinesis sequence numbers cannot be reco

[jira] [Updated] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10128: -- Fix Version/s: 1.5.0 > Kinesis sequence numbers cannot be recovered from WAL because WAL does n

[jira] [Updated] (SPARK-3727) Trees and ensembles: More prediction functionality

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3727: - Shepherd: Joseph K. Bradley > Trees and ensembles: More prediction functionality > ---

[jira] [Updated] (SPARK-9098) Inconsistent Dense Vectors hashing between PySpark and Scala

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9098: - Target Version/s: 1.6.0 > Inconsistent Dense Vectors hashing between PySpark and Scala > -

[jira] [Assigned] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9245: --- Assignee: Apache Spark (was: Joseph K. Bradley) > DistributedLDAModel predict top topic per

[jira] [Commented] (SPARK-9098) Inconsistent Dense Vectors hashing between PySpark and Scala

2015-08-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704250#comment-14704250 ] Yanbo Liang commented on SPARK-9098: I think this issues can be fixed after SPARK-9793

[jira] [Commented] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704249#comment-14704249 ] Apache Spark commented on SPARK-9245: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9245: --- Assignee: Joseph K. Bradley (was: Apache Spark) > DistributedLDAModel predict top topic per

[jira] [Resolved] (SPARK-7203) Python API for local linear algebra

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7203. -- Resolution: Done I'll call this done, though maybe we should create another once we figu

[jira] [Assigned] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-9245: Assignee: Joseph K. Bradley > DistributedLDAModel predict top topic per doc-term in

[jira] [Commented] (SPARK-9944) hive.metastore.warehouse.dir is not respected

2015-08-19 Thread Manku Timma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704236#comment-14704236 ] Manku Timma commented on SPARK-9944: The output that you were asking:- [default

[jira] [Comment Edited] (SPARK-9944) hive.metastore.warehouse.dir is not respected

2015-08-19 Thread Manku Timma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703098#comment-14703098 ] Manku Timma edited comment on SPARK-9944 at 8/20/15 3:23 AM: -

[jira] [Updated] (SPARK-5905) Improve RowMatrix user guide and doc.

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5905: - Issue Type: Documentation (was: Improvement) > Improve RowMatrix user guide and doc. > --

[jira] [Assigned] (SPARK-5560) LDA EM should scale to more iterations

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-5560: Assignee: Joseph K. Bradley > LDA EM should scale to more iterations >

[jira] [Resolved] (SPARK-5560) LDA EM should scale to more iterations

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-5560. -- Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: (was: 1.5.0)

[jira] [Commented] (SPARK-5560) LDA EM should scale to more iterations

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704224#comment-14704224 ] Joseph K. Bradley commented on SPARK-5560: -- I'm doing some testing on this right

[jira] [Assigned] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10128: Assignee: Tathagata Das (was: Apache Spark) > Kinesis sequence numbers cannot be recovere

[jira] [Commented] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704218#comment-14704218 ] Apache Spark commented on SPARK-10128: -- User 'tdas' has created a pull request for t

[jira] [Assigned] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10128: Assignee: Apache Spark (was: Tathagata Das) > Kinesis sequence numbers cannot be recovere

[jira] [Updated] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10128: -- Priority: Blocker (was: Major) > Kinesis sequence numbers cannot be recovered from WAL because

[jira] [Created] (SPARK-10128) Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader

2015-08-19 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-10128: - Summary: Kinesis sequence numbers cannot be recovered from WAL because WAL does not use the correct classloader Key: SPARK-10128 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-10127) Add numpy-like indexing interface for DenceMatrix

2015-08-19 Thread Hiroshi Takahashi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hiroshi Takahashi updated SPARK-10127: -- Affects Version/s: 1.4.1 > Add numpy-like indexing interface for DenceMatrix >

[jira] [Resolved] (SPARK-10125) Fix a potential deadlock in JobGenerator.stop

2015-08-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10125. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 > Fix a potenti

[jira] [Assigned] (SPARK-10127) Add numpy-like indexing interface for DenceMatrix

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10127: Assignee: Apache Spark > Add numpy-like indexing interface for DenceMatrix > -

[jira] [Assigned] (SPARK-10127) Add numpy-like indexing interface for DenceMatrix

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10127: Assignee: (was: Apache Spark) > Add numpy-like indexing interface for DenceMatrix > --

[jira] [Commented] (SPARK-10127) Add numpy-like indexing interface for DenceMatrix

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704200#comment-14704200 ] Apache Spark commented on SPARK-10127: -- User 'taishi-oss' has created a pull request

[jira] [Closed] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-10124. - Resolution: Fixed Fix Version/s: 1.5.0 > Mesos cluster mode causes exception when multiple spark a

[jira] [Created] (SPARK-10127) Add numpy-like indexing interface for DenceMatrix

2015-08-19 Thread Hiroshi Takahashi (JIRA)
Hiroshi Takahashi created SPARK-10127: - Summary: Add numpy-like indexing interface for DenceMatrix Key: SPARK-10127 URL: https://issues.apache.org/jira/browse/SPARK-10127 Project: Spark I

[jira] [Updated] (SPARK-10104) Consolidate different forms of table identifiers

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10104: - Description: Right now, we have QualifiedTableName, TableIdentifier, and Seq[String] to represent table

[jira] [Resolved] (SPARK-9812) Test all new Python API examples

2015-08-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9812. -- Resolution: Fixed Fix Version/s: 1.5.0 > Test all new Python API examples > -

[jira] [Assigned] (SPARK-10125) Fix a potential deadlock in JobGenerator.stop

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10125: Assignee: Apache Spark > Fix a potential deadlock in JobGenerator.stop > -

[jira] [Assigned] (SPARK-10125) Fix a potential deadlock in JobGenerator.stop

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10125: Assignee: (was: Apache Spark) > Fix a potential deadlock in JobGenerator.stop > --

[jira] [Commented] (SPARK-10125) Fix a potential deadlock in JobGenerator.stop

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704111#comment-14704111 ] Apache Spark commented on SPARK-10125: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-10126) Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704110#comment-14704110 ] Apache Spark commented on SPARK-10126: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-10126) Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10126: Assignee: Josh Rosen (was: Apache Spark) > Fix typo in release-build.sh which broke snaps

[jira] [Updated] (SPARK-10126) Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11

2015-08-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10126: --- Component/s: (was: Build) > Fix typo in release-build.sh which broke snapshot publishing for Scal

[jira] [Assigned] (SPARK-10126) Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10126: Assignee: Apache Spark (was: Josh Rosen) > Fix typo in release-build.sh which broke snaps

[jira] [Created] (SPARK-10126) Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11

2015-08-19 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10126: -- Summary: Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11 Key: SPARK-10126 URL: https://issues.apache.org/jira/browse/SPARK-10126 Project: Spar

[jira] [Assigned] (SPARK-10126) Fix typo in release-build.sh which broke snapshot publishing for Scala 2.11

2015-08-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-10126: -- Assignee: Josh Rosen > Fix typo in release-build.sh which broke snapshot publishing for Scala

[jira] [Created] (SPARK-10125) Fix a potential deadlock in JobGenerator.stop

2015-08-19 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-10125: Summary: Fix a potential deadlock in JobGenerator.stop Key: SPARK-10125 URL: https://issues.apache.org/jira/browse/SPARK-10125 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-8805) Spark shell not working

2015-08-19 Thread Amir Gur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14692340#comment-14692340 ] Amir Gur edited comment on SPARK-8805 at 8/20/15 12:54 AM: --- Happ

[jira] [Updated] (SPARK-10092) Multi-DB support follow up

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10092: - Summary: Multi-DB support follow up (was: saveAsTable always save the table in the folder of the current

[jira] [Updated] (SPARK-10092) saveAsTable always save the table in the folder of the current database

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10092: - Description: Seems we need a follow-up work for our multi-db support. Here are issues we need to address

[jira] [Updated] (SPARK-10092) saveAsTable always save the table in the folder of the current database

2015-08-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10092: - Description: Seems we need a follow-up work for our multi-db support. Here are issues we need to address

[jira] [Updated] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

2015-08-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9689: Target Version/s: 1.6.0 (was: 1.5.0) > Cache doesn't refresh for HadoopFsRelation based tab

[jira] [Updated] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9735: Target Version/s: 1.6.0 (was: 1.5.0) > Auto infer partition schema of HadoopFsRelation shou

[jira] [Resolved] (SPARK-9242) Audit both built-in aggregate function and UDAF interface before 1.5.0 release

2015-08-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9242. Resolution: Fixed Fix Version/s: 1.5.0 > Audit both built-in aggregate function and UDAF inte

[jira] [Updated] (SPARK-10035) Parquet filters does not process EqualNullSafe filter.

2015-08-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10035: --- Shepherd: Cheng Lian Affects Version/s: 1.5.0 1.4.1 > Parquet fil

[jira] [Resolved] (SPARK-10035) Parquet filters does not process EqualNullSafe filter.

2015-08-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10035. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8275 [https://github.c

[jira] [Assigned] (SPARK-10092) saveAsTable always save the table in the folder of the current database

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10092: Assignee: Apache Spark (was: Yin Huai) > saveAsTable always save the table in the folder

[jira] [Assigned] (SPARK-10092) saveAsTable always save the table in the folder of the current database

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10092: Assignee: Yin Huai (was: Apache Spark) > saveAsTable always save the table in the folder

[jira] [Commented] (SPARK-10092) saveAsTable always save the table in the folder of the current database

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704022#comment-14704022 ] Apache Spark commented on SPARK-10092: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-10115) MLlib ALS training fails with java.lang.ClassCastException

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703944#comment-14703944 ] Joseph K. Bradley commented on SPARK-10115: --- I think it's because your user IDs

[jira] [Closed] (SPARK-10115) MLlib ALS training fails with java.lang.ClassCastException

2015-08-19 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10115. - Resolution: Not A Problem I'll close this since it's really a lack of support for Long ID

[jira] [Commented] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

2015-08-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703897#comment-14703897 ] Michael Armbrust commented on SPARK-6489: - Fixed by: https://github.com/apache/sp

[jira] [Commented] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

2015-08-19 Thread Jerrick Hoang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703884#comment-14703884 ] Jerrick Hoang commented on SPARK-6489: -- Hi Michael, can you 1) point me to the CL th

[jira] [Commented] (SPARK-7021) JUnit output for Python tests

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703878#comment-14703878 ] Apache Spark commented on SPARK-7021: - User 'gliptak' has created a pull request for t

[jira] [Assigned] (SPARK-7021) JUnit output for Python tests

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7021: --- Assignee: (was: Apache Spark) > JUnit output for Python tests > -

[jira] [Assigned] (SPARK-7021) JUnit output for Python tests

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7021: --- Assignee: Apache Spark > JUnit output for Python tests > - > >

[jira] [Updated] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10124: -- Assignee: Timothy Chen > Mesos cluster mode causes exception when multiple spark apps are being > sche

[jira] [Commented] (SPARK-10122) AttributeError: 'RDD' object has no attribute 'offsetRanges'

2015-08-19 Thread Amit Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703870#comment-14703870 ] Amit Ramesh commented on SPARK-10122: - [~jerryshao] any ideas on what is going on her

[jira] [Updated] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated SPARK-10124: - Target Version/s: 1.5.0 (was: 1.5.1) > Mesos cluster mode causes exception when multiple spark a

[jira] [Updated] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated SPARK-10124: - Component/s: Mesos > Mesos cluster mode causes exception when multiple spark apps are being > sc

[jira] [Updated] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Chen updated SPARK-10124: - Target Version/s: 1.5.1 > Mesos cluster mode causes exception when multiple spark apps are being

[jira] [Assigned] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10124: Assignee: (was: Apache Spark) > Mesos cluster mode causes exception when multiple spar

[jira] [Commented] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703869#comment-14703869 ] Apache Spark commented on SPARK-10124: -- User 'tnachen' has created a pull request fo

[jira] [Assigned] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10124: Assignee: Apache Spark > Mesos cluster mode causes exception when multiple spark apps are

[jira] [Created] (SPARK-10124) Mesos cluster mode causes exception when multiple spark apps are being scheduled

2015-08-19 Thread Timothy Chen (JIRA)
Timothy Chen created SPARK-10124: Summary: Mesos cluster mode causes exception when multiple spark apps are being scheduled Key: SPARK-10124 URL: https://issues.apache.org/jira/browse/SPARK-10124 Proj

[jira] [Updated] (SPARK-10122) AttributeError: 'RDD' object has no attribute 'offsetRanges'

2015-08-19 Thread Amit Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Ramesh updated SPARK-10122: Description: SPARK-8389 added the offsetRanges interface to Kafka direct streams. This however app

[jira] [Created] (SPARK-10123) Cannot set "--deploy-mode" in default configuration

2015-08-19 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-10123: -- Summary: Cannot set "--deploy-mode" in default configuration Key: SPARK-10123 URL: https://issues.apache.org/jira/browse/SPARK-10123 Project: Spark Issue

[jira] [Resolved] (SPARK-9895) User Guide for RFormula Feature Transformer

2015-08-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9895. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8293 [https://githu

[jira] [Updated] (SPARK-10122) AttributeError: 'RDD' object has no attribute 'offsetRanges'

2015-08-19 Thread Amit Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Ramesh updated SPARK-10122: Description: SPARK-8337 added the offsetRanges interface to Kafka direct streams. This however app

[jira] [Created] (SPARK-10122) AttributeError: 'RDD' object has no attribute 'offsetRanges'

2015-08-19 Thread Amit Ramesh (JIRA)
Amit Ramesh created SPARK-10122: --- Summary: AttributeError: 'RDD' object has no attribute 'offsetRanges' Key: SPARK-10122 URL: https://issues.apache.org/jira/browse/SPARK-10122 Project: Spark I

[jira] [Issue Comment Deleted] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-19 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luvsandondov Lkhamsuren updated SPARK-9963: --- Comment: was deleted (was: Actually, I have a question: override private[tree]

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-19 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703842#comment-14703842 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Actually, I have a questi

[jira] [Updated] (SPARK-7992) Hide private classes/objects in in generated Java API doc

2015-08-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7992: --- Target Version/s: 1.6.0 (was: 1.5.0) > Hide private classes/objects in in generated Java API doc > --

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-08-19 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703824#comment-14703824 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Thanks for the clarificat

[jira] [Updated] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

2015-08-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6489: Target Version/s: 1.5.0 (was: 1.6.0) > Optimize lateral view with explode to not read unnec

[jira] [Resolved] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

2015-08-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6489. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > Optimize la

[jira] [Commented] (SPARK-9242) Audit both built-in aggregate function and UDAF interface before 1.5.0 release

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703813#comment-14703813 ] Apache Spark commented on SPARK-9242: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9242) Audit both built-in aggregate function and UDAF interface before 1.5.0 release

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9242: --- Assignee: Reynold Xin (was: Apache Spark) > Audit both built-in aggregate function and UDAF

[jira] [Assigned] (SPARK-9242) Audit both built-in aggregate function and UDAF interface before 1.5.0 release

2015-08-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9242: --- Assignee: Apache Spark (was: Reynold Xin) > Audit both built-in aggregate function and UDAF

[jira] [Resolved] (SPARK-3671) Batch multiput updates within partitions

2015-08-19 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-3671. --- Resolution: Fixed Issue resolved by https://github.com/amplab/spark-indexedrdd/pull/4 > Batch multipu

[jira] [Resolved] (SPARK-10119) Utils.isDynamicAllocationEnabled returns wrong value if dynAlloc is explicitly disabled

2015-08-19 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10119. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.5.0 > Utils.isD

  1   2   3   4   >