[jira] [Created] (SPARK-12770) Implement rules for removing unnecessary branches for CaseWhen in SimplifyConditionals

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12770: --- Summary: Implement rules for removing unnecessary branches for CaseWhen in SimplifyConditionals Key: SPARK-12770 URL: https://issues.apache.org/jira/browse/SPARK-12770

[jira] [Created] (SPARK-12769) Remove If expression

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12769: --- Summary: Remove If expression Key: SPARK-12769 URL: https://issues.apache.org/jira/browse/SPARK-12769 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-11 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Created] (SPARK-12768) Remove CaseKeyWhen

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12768: --- Summary: Remove CaseKeyWhen Key: SPARK-12768 URL: https://issues.apache.org/jira/browse/SPARK-12768 Project: Spark Issue Type: Sub-task Components: S

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-11 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Priority: Critical (was: Major) > pyspark broadcast fails when using multiple threads > --

[jira] [Created] (SPARK-12767) Improve conditional expressions

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12767: --- Summary: Improve conditional expressions Key: SPARK-12767 URL: https://issues.apache.org/jira/browse/SPARK-12767 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sloth updated SPARK-12765: -- Remaining Estimate: (was: 1m) Original Estimate: (was: 1m) > CountVectorizerModel.transform lost t

[jira] [Commented] (SPARK-5891) Add Binarizer

2016-01-11 Thread Mike Seddon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093472#comment-15093472 ] Mike Seddon commented on SPARK-5891: I made the changes for the Binarizer to handle bo

[jira] [Assigned] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12765: Assignee: Apache Spark > CountVectorizerModel.transform lost the transformSchema > ---

[jira] [Assigned] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12765: Assignee: (was: Apache Spark) > CountVectorizerModel.transform lost the transformSchem

[jira] [Commented] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093447#comment-15093447 ] Apache Spark commented on SPARK-12685: -- User 'hhbyyh' has created a pull request for

[jira] [Updated] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sloth updated SPARK-12765: -- Affects Version/s: 1.6.1 1.6.0 > CountVectorizerModel.transform lost the transformSchema

[jira] [Updated] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sloth updated SPARK-12765: -- Affects Version/s: (was: 1.6.0) > CountVectorizerModel.transform lost the transformSchema > ---

[jira] [Created] (SPARK-12766) Unshaded google guava classes in spark-network-common jar

2016-01-11 Thread Jake Yoon (JIRA)
Jake Yoon created SPARK-12766: - Summary: Unshaded google guava classes in spark-network-common jar Key: SPARK-12766 URL: https://issues.apache.org/jira/browse/SPARK-12766 Project: Spark Issue Typ

[jira] [Commented] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093421#comment-15093421 ] sloth commented on SPARK-12765: --- It's just one line code, I have make a PR > CountVectoriz

[jira] [Issue Comment Deleted] (SPARK-11966) Spark API for UDTFs

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11966: Comment: was deleted (was: Hi Jaka, It's targeted for Spark 1.7. -Richard -- Richard Garris

[jira] [Commented] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

2016-01-11 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093415#comment-15093415 ] Jean-Baptiste Onofré commented on SPARK-12430: -- Just to be sure: you don't u

[jira] [Created] (SPARK-12765) CountVectorizerModel.transform lost the transformSchema

2016-01-11 Thread sloth (JIRA)
sloth created SPARK-12765: - Summary: CountVectorizerModel.transform lost the transformSchema Key: SPARK-12765 URL: https://issues.apache.org/jira/browse/SPARK-12765 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12763) Spark gets stuck executing SSB query

2016-01-11 Thread Vadim Tkachenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim Tkachenko updated SPARK-12763: Attachment: Spark shell - Details for Stage 5 (Attempt 0).pdf Details on the stalled stage

[jira] [Updated] (SPARK-12764) XML Column type is not supported

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12764: Description: Hi All, I am using PostgreSQL database. I am using the following jdbc call to access

[jira] [Created] (SPARK-12764) XML Column type is not supported

2016-01-11 Thread Rajeshwar Gaini (JIRA)
Rajeshwar Gaini created SPARK-12764: --- Summary: XML Column type is not supported Key: SPARK-12764 URL: https://issues.apache.org/jira/browse/SPARK-12764 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-12763) Spark gets stuck executing SSB query

2016-01-11 Thread Vadim Tkachenko (JIRA)
Vadim Tkachenko created SPARK-12763: --- Summary: Spark gets stuck executing SSB query Key: SPARK-12763 URL: https://issues.apache.org/jira/browse/SPARK-12763 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2016-01-11 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093368#comment-15093368 ] Herman van Hovell commented on SPARK-11966: --- We could do this with the datasour

[jira] [Commented] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093355#comment-15093355 ] Apache Spark commented on SPARK-12692: -- User 'sarutak' has created a pull request fo

[jira] [Commented] (SPARK-12692) Scala style: check no white space before comma and colon

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093295#comment-15093295 ] Apache Spark commented on SPARK-12692: -- User 'sarutak' has created a pull request fo

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093247#comment-15093247 ] Josh Rosen commented on SPARK-11823: Test is now ignored in master, 1.5, and 1.6. I'l

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2016-01-11 Thread Richard Garris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093239#comment-15093239 ] Richard Garris commented on SPARK-11966: Hi Jaka, It's targeted for Spark 1.7.

[jira] [Assigned] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10620: Assignee: (was: Apache Spark) > Look into whether accumulator mechanism can replace Ta

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093209#comment-15093209 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10620: Assignee: Apache Spark > Look into whether accumulator mechanism can replace TaskMetrics >

[jira] [Assigned] (SPARK-12762) Add unit test for simplifying if expression

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12762: Assignee: Apache Spark (was: Reynold Xin) > Add unit test for simplifying if expression >

[jira] [Commented] (SPARK-12762) Add unit test for simplifying if expression

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093206#comment-15093206 ] Apache Spark commented on SPARK-12762: -- User 'rxin' has created a pull request for t

[jira] [Updated] (SPARK-12762) Add unit test for simplifying if expression

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12762: Component/s: Optimizer > Add unit test for simplifying if expression >

[jira] [Assigned] (SPARK-12762) Add unit test for simplifying if expression

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12762: Assignee: Reynold Xin (was: Apache Spark) > Add unit test for simplifying if expression >

[jira] [Created] (SPARK-12762) Add unit test for simplifying if expression

2016-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12762: --- Summary: Add unit test for simplifying if expression Key: SPARK-12762 URL: https://issues.apache.org/jira/browse/SPARK-12762 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093188#comment-15093188 ] yuhao yang commented on SPARK-12685: Hi [~josephkb] I suppose it will require 3 diffe

[jira] [Resolved] (SPARK-12498) BooleanSimplification cleanup

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12498. - Resolution: Fixed Assignee: Cheng Lian (was: Apache Spark) Fix Version/s: 2.0.0

[jira] [Assigned] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11823: Assignee: Apache Spark > HiveThriftBinaryServerSuite tests timing out, leaves hanging proc

[jira] [Assigned] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11823: Assignee: (was: Apache Spark) > HiveThriftBinaryServerSuite tests timing out, leaves h

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093179#comment-15093179 ] Apache Spark commented on SPARK-11823: -- User 'yhuai' has created a pull request for

[jira] [Closed] (SPARK-12751) Traits generated by SharedParamsCodeGen should not be private

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12751. - Resolution: Duplicate > Traits generated by SharedParamsCodeGen should not be private > -

[jira] [Comment Edited] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093173#comment-15093173 ] Yin Huai edited comment on SPARK-11823 at 1/12/16 2:33 AM: --- [~j

[jira] [Commented] (SPARK-12751) Traits generated by SharedParamsCodeGen should not be private

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093176#comment-15093176 ] Joseph K. Bradley commented on SPARK-12751: --- It'd be nice to get your feedback

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2016-01-11 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093174#comment-15093174 ] Jaka Jancar commented on SPARK-11966: - [~marmbrus] [~rlgarris_databricks] Any chance

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093173#comment-15093173 ] Yin Huai commented on SPARK-11823: -- [~joshrosen] pointed out that this test still times

[jira] [Updated] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11823: - Fix Version/s: (was: 1.6.1) (was: 2.0.0) > HiveThriftBinaryServerSuite tests t

[jira] [Reopened] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

2016-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-11823: -- Assignee: (was: Josh Rosen) > HiveThriftBinaryServerSuite tests timing out, leaves hanging proces

[jira] [Updated] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Earthson Lu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Earthson Lu updated SPARK-12746: Shepherd: Joseph K. Bradley (was: Xiangrui Meng) > ArrayType(_, true) should also accept ArrayType

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093170#comment-15093170 ] Yanbo Liang commented on SPARK-12664: - cc [~avulanov] [~mengxr] > Expose raw predict

[jira] [Updated] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12664: Component/s: (was: MLlib) > Expose raw prediction scores in MultilayerPerceptronClassificationM

[jira] [Commented] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093164#comment-15093164 ] Yanbo Liang commented on SPARK-12664: - I vote this as an important feature. Multilaye

[jira] [Updated] (SPARK-12742) org.apache.spark.sql.hive.LogicalPlanToSQLSuite failure due to Table already exists

2016-01-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12742: --- Assignee: Fei Wang > org.apache.spark.sql.hive.LogicalPlanToSQLSuite failure due to Table already >

[jira] [Resolved] (SPARK-12742) org.apache.spark.sql.hive.LogicalPlanToSQLSuite failure due to Table already exists

2016-01-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12742. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10682 [https://github.

[jira] [Updated] (SPARK-12664) Expose raw prediction scores in MultilayerPerceptronClassificationModel

2016-01-11 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12664: Priority: Major (was: Minor) > Expose raw prediction scores in MultilayerPerceptronClassificationM

[jira] [Commented] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093155#comment-15093155 ] Apache Spark commented on SPARK-12746: -- User 'Earthson' has created a pull request f

[jira] [Commented] (SPARK-12602) Join Reordering: Pushing Inner Join Through Outer Join

2016-01-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093158#comment-15093158 ] Xiao Li commented on SPARK-12602: - Sure, Thanks! > Join Reordering: Pushing Inner Join T

[jira] [Assigned] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12746: Assignee: (was: Apache Spark) > ArrayType(_, true) should also accept ArrayType(_, fal

[jira] [Updated] (SPARK-12385) Push projection into Join

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12385: Component/s: Optimizer > Push projection into Join > - > >

[jira] [Assigned] (SPARK-12746) ArrayType(_, true) should also accept ArrayType(_, false)

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12746: Assignee: Apache Spark > ArrayType(_, true) should also accept ArrayType(_, false) > -

[jira] [Updated] (SPARK-12602) Join Reordering: Pushing Inner Join Through Outer Join

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12602: Component/s: Optimizer > Join Reordering: Pushing Inner Join Through Outer Join > -

[jira] [Closed] (SPARK-12602) Join Reordering: Pushing Inner Join Through Outer Join

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12602. --- Resolution: Later Closing as later. Will revisit when we have more review bandwidth. > Join Reorder

[jira] [Updated] (SPARK-12613) Elimination of Outer Join by Parent Join Condition

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12613: Component/s: Optimizer > Elimination of Outer Join by Parent Join Condition > -

[jira] [Updated] (SPARK-12594) Outer Join Elimination by Filter Condition

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12594: Component/s: Optimizer > Outer Join Elimination by Filter Condition > -

[jira] [Updated] (SPARK-12605) Pushing Join Predicates Through Union All

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12605: Component/s: Optimizer > Pushing Join Predicates Through Union All > --

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

2016-01-11 Thread Amir Gur (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093151#comment-15093151 ] Amir Gur commented on SPARK-10528: -- Should this not be reopened given is still happens t

[jira] [Updated] (SPARK-12503) Pushdown a Limit on top of a Union

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12503: Component/s: Optimizer > Pushdown a Limit on top of a Union > -- >

[jira] [Updated] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12532: Component/s: Optimizer > Join-key Pushdown via Predicate Transitivity > ---

[jira] [Commented] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

2016-01-11 Thread Kaiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093144#comment-15093144 ] Kaiyuan Yang commented on SPARK-12066: -- Ricky Yang, if you still think this is a bug

[jira] [Commented] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-01-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093138#comment-15093138 ] Xiao Li commented on SPARK-12532: - Let me know if this is revisited. Thanks! > Join-key

[jira] [Closed] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12532. --- Resolution: Later Assignee: (was: Xiao Li) Target Version/s: (was: 2.0.0)

[jira] [Commented] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093134#comment-15093134 ] yuhao yang commented on SPARK-12685: Sorry to miss that. I'll start on it. > word2ve

[jira] [Commented] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093136#comment-15093136 ] Reynold Xin commented on SPARK-12532: - Unfortunately I don't think this rule is suffi

[jira] [Closed] (SPARK-12503) Pushdown a Limit on top of a Union

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12503. --- Resolution: Later > Pushdown a Limit on top of a Union > -- > >

[jira] [Closed] (SPARK-12505) Pushdown a Limit on top of an Outer-Join

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12505. --- Resolution: Later Assignee: (was: Apache Spark) Target Version/s: (was: 2.

[jira] [Updated] (SPARK-12536) Fix the Explain Outputs of Empty LocalRelation and LocalTableScan

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12536: Assignee: (was: Apache Spark) > Fix the Explain Outputs of Empty LocalRelation and LocalTableSc

[jira] [Closed] (SPARK-12536) Fix the Explain Outputs of Empty LocalRelation and LocalTableScan

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12536. --- Resolution: Won't Fix I'm actually not sure whether the new format is more clear. Do you mind closing

[jira] [Closed] (SPARK-12745) Limit is not supported inside Set Operation

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12745. --- Resolution: Later > Limit is not supported inside Set Operation > ---

[jira] [Commented] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093055#comment-15093055 ] Apache Spark commented on SPARK-9844: - User 'BryanCutler' has created a pull request f

[jira] [Assigned] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9844: --- Assignee: (was: Apache Spark) > File appender race condition during SparkWorker shutdown

[jira] [Assigned] (SPARK-9844) File appender race condition during SparkWorker shutdown

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9844: --- Assignee: Apache Spark > File appender race condition during SparkWorker shutdown > -

[jira] [Commented] (SPARK-9656) Add missing methods to linalg.distributed

2016-01-11 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15093018#comment-15093018 ] Mike Dusenberry commented on SPARK-9656: [~josephkb] Now that SPARK-11497 has been

[jira] [Updated] (SPARK-12577) better support of parentheses in partition by and order by clause of window function's over clause

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12577: Assignee: Liang-Chi Hsieh > better support of parentheses in partition by and order by clause of wi

[jira] [Resolved] (SPARK-12576) Enable expression parsing (used in DataFrames)

2016-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12576. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Enable expre

[jira] [Assigned] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12655: Assignee: Apache Spark > GraphX does not unpersist RDDs > -- >

[jira] [Commented] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092986#comment-15092986 ] Apache Spark commented on SPARK-12655: -- User 'jasoncl' has created a pull request fo

[jira] [Assigned] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12655: Assignee: (was: Apache Spark) > GraphX does not unpersist RDDs > -

[jira] [Assigned] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12724: Assignee: (was: Apache Spark) > SQL generation support for persisted data source relat

[jira] [Commented] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092971#comment-15092971 ] Apache Spark commented on SPARK-12724: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12724: Assignee: Apache Spark > SQL generation support for persisted data source relations >

[jira] [Assigned] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12761: Assignee: Apache Spark > Clean up duplicated code in scala 2.11 repl.Main > --

[jira] [Commented] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092963#comment-15092963 ] Apache Spark commented on SPARK-12761: -- User 'jodersky' has created a pull request f

[jira] [Updated] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-11 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-12732: Assignee: Imran Younus > Fix LinearRegression.train for the case when label is constant and > fitIntercept

[jira] [Commented] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15092964#comment-15092964 ] Jakob Odersky commented on SPARK-12761: --- @vanzin, I think this is your area of expe

[jira] [Assigned] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12761: Assignee: (was: Apache Spark) > Clean up duplicated code in scala 2.11 repl.Main > ---

[jira] [Created] (SPARK-12761) Clean up duplicated code in scala 2.11 repl.Main

2016-01-11 Thread Jakob Odersky (JIRA)
Jakob Odersky created SPARK-12761: - Summary: Clean up duplicated code in scala 2.11 repl.Main Key: SPARK-12761 URL: https://issues.apache.org/jira/browse/SPARK-12761 Project: Spark Issue Type

[jira] [Resolved] (SPARK-10809) Single-document topicDistributions method for LocalLDAModel

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10809. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9484 [ht

[jira] [Assigned] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12685: Assignee: Apache Spark (was: yuhao yang) > word2vec trainWordsCount gets overflow > -

[jira] [Reopened] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-12685: --- Reopening so I don't forget backports > word2vec trainWordsCount gets overflow > ---

[jira] [Assigned] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12685: Assignee: yuhao yang (was: Apache Spark) > word2vec trainWordsCount gets overflow > -

[jira] [Resolved] (SPARK-12685) word2vec trainWordsCount gets overflow

2016-01-11 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12685. --- Resolution: Fixed Fix Version/s: 2.0.0 > word2vec trainWordsCount gets overflo

  1   2   3   >