[jira] [Closed] (SPARK-13835) IsNotNull Filters for the BinaryComparison inside Not

2016-03-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-13835. --- Resolution: Duplicate > IsNotNull Filters for the BinaryComparison inside Not > -

[jira] [Resolved] (SPARK-13814) Delete unnecessary imports in python examples files

2016-03-11 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13814. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11651 [https://github.

[jira] [Assigned] (SPARK-13836) IsNotNull Constraints for the BinaryComparison inside Not

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13836: Assignee: (was: Apache Spark) > IsNotNull Constraints for the BinaryComparison inside

[jira] [Commented] (SPARK-13836) IsNotNull Constraints for the BinaryComparison inside Not

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191623#comment-15191623 ] Apache Spark commented on SPARK-13836: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13836) IsNotNull Constraints for the BinaryComparison inside Not

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13836: Assignee: Apache Spark > IsNotNull Constraints for the BinaryComparison inside Not > -

[jira] [Assigned] (SPARK-13834) Update sbt for 2.x

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13834: Assignee: Apache Spark > Update sbt for 2.x > -- > > Key:

[jira] [Assigned] (SPARK-13834) Update sbt for 2.x

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13834: Assignee: (was: Apache Spark) > Update sbt for 2.x > -- > >

[jira] [Assigned] (SPARK-13834) Update sbt for 2.x

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13834: Assignee: Apache Spark > Update sbt for 2.x > -- > > Key:

[jira] [Commented] (SPARK-13834) Update sbt for 2.x

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191616#comment-15191616 ] Apache Spark commented on SPARK-13834: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Created] (SPARK-13836) IsNotNull Constraints for the BinaryComparison inside Not

2016-03-11 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13836: --- Summary: IsNotNull Constraints for the BinaryComparison inside Not Key: SPARK-13836 URL: https://issues.apache.org/jira/browse/SPARK-13836 Project: Spark Issue Type: I

[jira] [Created] (SPARK-13835) IsNotNull Filters for the BinaryComparison inside Not

2016-03-11 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13835: --- Summary: IsNotNull Filters for the BinaryComparison inside Not Key: SPARK-13835 URL: https://issues.apache.org/jira/browse/SPARK-13835 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-13834) Update sbt for 2.x

2016-03-11 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-13834: - Summary: Update sbt for 2.x Key: SPARK-13834 URL: https://issues.apache.org/jira/browse/SPARK-13834 Project: Spark Issue Type: Improvement Repo

[jira] [Assigned] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13833: Assignee: Josh Rosen (was: Apache Spark) > Guard against race condition when re-caching s

[jira] [Assigned] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13833: Assignee: Apache Spark (was: Josh Rosen) > Guard against race condition when re-caching s

[jira] [Assigned] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13833: Assignee: Apache Spark (was: Josh Rosen) > Guard against race condition when re-caching s

[jira] [Assigned] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13833: Assignee: Josh Rosen (was: Apache Spark) > Guard against race condition when re-caching s

[jira] [Commented] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191598#comment-15191598 ] Apache Spark commented on SPARK-13833: -- User 'JoshRosen' has created a pull request

[jira] [Updated] (SPARK-13806) SQL round() produces incorrect results for negative values

2016-03-11 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamstra updated SPARK-13806: - Description: Round in catalyst/expressions/mathExpressions.scala appears to be untested with neg

[jira] [Created] (SPARK-13833) Guard against race condition when re-caching spilled bytes in memory

2016-03-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13833: -- Summary: Guard against race condition when re-caching spilled bytes in memory Key: SPARK-13833 URL: https://issues.apache.org/jira/browse/SPARK-13833 Project: Spark

[jira] [Assigned] (SPARK-13830) Fetch large directly result from executor is very slow

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13830: Assignee: Apache Spark > Fetch large directly result from executor is very slow >

[jira] [Commented] (SPARK-13830) Fetch large directly result from executor is very slow

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191511#comment-15191511 ] Apache Spark commented on SPARK-13830: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-13830) Fetch large directly result from executor is very slow

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13830: Assignee: (was: Apache Spark) > Fetch large directly result from executor is very slow

[jira] [Resolved] (SPARK-13328) Possible poor read performance for broadcast variables with dynamic resource allocation

2016-03-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13328. --- Resolution: Fixed Assignee: Nezih Yigitbasi Fix Version/s: 2.0.0 Target V

[jira] [Updated] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil updated SPARK-13832: -- Environment: Red Hat Enterprise Linux Server release 7.1 (Maipo) Linux bigaperf116.svl.ibm.com 3.10.0-2

[jira] [Created] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-11 Thread Roy Cecil (JIRA)
Roy Cecil created SPARK-13832: - Summary: TPC-DS Query 36 fails with Parser error Key: SPARK-13832 URL: https://issues.apache.org/jira/browse/SPARK-13832 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil updated SPARK-13832: -- Description: TPC-DS query 36 fails with the following error Analyzer error: 16/02/28 21:22:51 INFO pars

[jira] [Created] (SPARK-13831) TPC-DS Query 35 fails with the following compile error

2016-03-11 Thread Roy Cecil (JIRA)
Roy Cecil created SPARK-13831: - Summary: TPC-DS Query 35 fails with the following compile error Key: SPARK-13831 URL: https://issues.apache.org/jira/browse/SPARK-13831 Project: Spark Issue Type:

[jira] [Created] (SPARK-13830) Fetch large directly result from executor is very slow

2016-03-11 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13830: -- Summary: Fetch large directly result from executor is very slow Key: SPARK-13830 URL: https://issues.apache.org/jira/browse/SPARK-13830 Project: Spark Issue Type

[jira] [Issue Comment Deleted] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil updated SPARK-13821: -- Comment: was deleted (was: Query Text is select i_item_id ,i_item_desc ,i_category

[jira] [Issue Comment Deleted] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil updated SPARK-13821: -- Comment: was deleted (was: select i_item_id ,i_item_desc ,i_category ,i_class

[jira] [Issue Comment Deleted] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roy Cecil updated SPARK-13821: -- Comment: was deleted (was: Query Text is select i_item_id ,i_item_desc ,i_category

[jira] [Commented] (SPARK-13829) Spark submit with keytab can't submit to a non-HDFS yarn cluster

2016-03-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191372#comment-15191372 ] Steve Loughran commented on SPARK-13829: its a bit subtle here, as it's not clear

[jira] [Updated] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha updated SPARK-13821: -- Description: TPC-DS Query 20 Fails to compile with the follwing Error Message {noformat} Parsin

[jira] [Updated] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Ram Sriharsha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Sriharsha updated SPARK-13821: -- Description: TPC-DS Query 20 Fails to compile with the follwing Error Message {format} Parsing

[jira] [Resolved] (SPARK-13780) SQL "incremental" build in maven is broken

2016-03-11 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-13780. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 > SQL "incr

[jira] [Commented] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-11 Thread Erik O'Shaughnessy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191330#comment-15191330 ] Erik O'Shaughnessy commented on SPARK-13776: Looks good. Here is the log with

[jira] [Commented] (SPARK-13829) Spark submit with keytab can't submit to a non-HDFS yarn cluster

2016-03-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191315#comment-15191315 ] Steve Loughran commented on SPARK-13829: {code} 16/03/11 17:34:51 ERROR SparkCont

[jira] [Created] (SPARK-13829) Spark submit with keytab can't submit to a non-HDFS yarn cluster

2016-03-11 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-13829: -- Summary: Spark submit with keytab can't submit to a non-HDFS yarn cluster Key: SPARK-13829 URL: https://issues.apache.org/jira/browse/SPARK-13829 Project: Spark

[jira] [Commented] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-11 Thread Erik O'Shaughnessy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191233#comment-15191233 ] Erik O'Shaughnessy commented on SPARK-13776: [~zsxwing] I've got your PR buil

[jira] [Updated] (SPARK-13797) Eliminate Unnecessary Window

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13797: -- Assignee: Xiao Li > Eliminate Unnecessary Window > > > Key

[jira] [Updated] (SPARK-13732) Remove projectList from Windows

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13732: -- Assignee: Xiao Li > Remove projectList from Windows > --- > >

[jira] [Updated] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13820: -- Component/s: SQL > TPC-DS Query 10 fails to compile > > >

[jira] [Updated] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13821: -- Component/s: SQL > TPC-DS Query 20 fails to compile > > >

[jira] [Updated] (SPARK-13790) Speed up ColumnVector's getDecimal

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13790: -- Assignee: Nong Li > Speed up ColumnVector's getDecimal > -- > >

[jira] [Updated] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13825: -- Component/s: Spark Core > Upgrade to Scala 2.11.8 > --- > > Key: SP

[jira] [Assigned] (SPARK-13827) Can't add subquery to an operator with same-name outputs while generate SQL string

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13827: Assignee: (was: Apache Spark) > Can't add subquery to an operator with same-name outpu

[jira] [Assigned] (SPARK-13827) Can't add subquery to an operator with same-name outputs while generate SQL string

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13827: Assignee: Apache Spark > Can't add subquery to an operator with same-name outputs while ge

[jira] [Assigned] (SPARK-13827) Can't add subquery to an operator with same-name outputs while generate SQL string

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13827: Assignee: Apache Spark > Can't add subquery to an operator with same-name outputs while ge

[jira] [Commented] (SPARK-13827) Can't add subquery to an operator with same-name outputs while generate SQL string

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191022#comment-15191022 ] Apache Spark commented on SPARK-13827: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-13828) QueryExecution's assertAnalyzed needs to preserve the stacktrace

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13828: -- Summary: QueryExecution's assertAnalyzed needs to preserve the stacktrace Key: SPARK-13828 URL: https://issues.apache.org/jira/browse/SPARK-13828 Project: Spark

[jira] [Created] (SPARK-13827) Can't add subquery to an operator with same-name outputs while generate SQL string

2016-03-11 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-13827: --- Summary: Can't add subquery to an operator with same-name outputs while generate SQL string Key: SPARK-13827 URL: https://issues.apache.org/jira/browse/SPARK-13827 Proj

[jira] [Created] (SPARK-13826) Revise ScalaDoc of the new Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13826: -- Summary: Revise ScalaDoc of the new Dataset API Key: SPARK-13826 URL: https://issues.apache.org/jira/browse/SPARK-13826 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13817. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11656 [https://github.

[jira] [Resolved] (SPARK-13577) Allow YARN to handle multiple jars, archive when uploading Spark dependencies

2016-03-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-13577. --- Resolution: Fixed > Allow YARN to handle multiple jars, archive when uploading Spark dependen

[jira] [Updated] (SPARK-13577) Allow YARN to handle multiple jars, archive when uploading Spark dependencies

2016-03-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13577: -- Assignee: Marcelo Vanzin > Allow YARN to handle multiple jars, archive when uploading Spark dep

[jira] [Commented] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-11 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190930#comment-15190930 ] Jacek Laskowski commented on SPARK-13825: - OK. Thanks. I'm going to send a pull r

[jira] [Commented] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190914#comment-15190914 ] Sean Owen commented on SPARK-13825: --- Yes, I think it's OK to update the version in bran

[jira] [Resolved] (SPARK-13824) Upgrade to Scala 2.11.8

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13824. --- Resolution: Duplicate > Upgrade to Scala 2.11.8 > --- > > Key: SP

[jira] [Created] (SPARK-13825) Upgrade to Scala 2.11.8

2016-03-11 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13825: --- Summary: Upgrade to Scala 2.11.8 Key: SPARK-13825 URL: https://issues.apache.org/jira/browse/SPARK-13825 Project: Spark Issue Type: Improvement Aff

[jira] [Created] (SPARK-13824) Upgrade to Scala 2.11.8

2016-03-11 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-13824: --- Summary: Upgrade to Scala 2.11.8 Key: SPARK-13824 URL: https://issues.apache.org/jira/browse/SPARK-13824 Project: Spark Issue Type: Bug Affects Ver

[jira] [Assigned] (SPARK-13823) Always specify Charset in String <-> byte[] conversions (and remaining Coverity items)

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13823: Assignee: Sean Owen (was: Apache Spark) > Always specify Charset in String <-> byte[] con

[jira] [Commented] (SPARK-13823) Always specify Charset in String <-> byte[] conversions (and remaining Coverity items)

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190850#comment-15190850 ] Apache Spark commented on SPARK-13823: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-13823) Always specify Charset in String <-> byte[] conversions (and remaining Coverity items)

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13823: Assignee: Apache Spark (was: Sean Owen) > Always specify Charset in String <-> byte[] con

[jira] [Resolved] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13684. --- Resolution: Duplicate If you don't mind I'm going to bundle this up with resolution for all the rema

[jira] [Created] (SPARK-13823) Always specify Charset in String <-> byte[] conversions (and remaining Coverity items)

2016-03-11 Thread Sean Owen (JIRA)
Sean Owen created SPARK-13823: - Summary: Always specify Charset in String <-> byte[] conversions (and remaining Coverity items) Key: SPARK-13823 URL: https://issues.apache.org/jira/browse/SPARK-13823 Proj

[jira] [Updated] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13817: --- Issue Type: Sub-task (was: Test) Parent: SPARK-13822 > Re-enable MiMA check after unifying D

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190839#comment-15190839 ] Roy Cecil commented on SPARK-13821: --- select i_item_id ,i_item_desc ,i_cat

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190837#comment-15190837 ] Roy Cecil commented on SPARK-13821: --- Query Text is select i_item_id ,i_item_desc

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190835#comment-15190835 ] Roy Cecil commented on SPARK-13821: --- Query Text is select i_item_id ,i_item_desc

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190836#comment-15190836 ] Roy Cecil commented on SPARK-13821: --- Query Text is select i_item_id ,i_item_desc

[jira] [Created] (SPARK-13822) Follow-ups of DataFrame/Dataset API unification

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13822: -- Summary: Follow-ups of DataFrame/Dataset API unification Key: SPARK-13822 URL: https://issues.apache.org/jira/browse/SPARK-13822 Project: Spark Issue Type: Impro

[jira] [Resolved] (SPARK-13818) the spark streaming job will be always processing status when restart elasticsearch

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13818. --- Resolution: Invalid > the spark streaming job will be always processing status when restart > elasti

[jira] [Updated] (SPARK-13818) the spark streaming job will be always processing status when restart elasticsearch

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13818: -- @yuemeng Please don't open a JIRA until you read https://cwiki.apache.org/confluence/display/SPARK/Contrib

[jira] [Created] (SPARK-13821) TPC-DS Query 20 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
Roy Cecil created SPARK-13821: - Summary: TPC-DS Query 20 fails to compile Key: SPARK-13821 URL: https://issues.apache.org/jira/browse/SPARK-13821 Project: Spark Issue Type: Bug Affects Versio

[jira] [Updated] (SPARK-13818) the spark streaming job will be always processing status when restart elasticsearch

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13818: -- Priority: Major (was: Blocker) Fix Version/s: (was: 1.5.3) (was: 1.

[jira] [Created] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-11 Thread Roy Cecil (JIRA)
Roy Cecil created SPARK-13820: - Summary: TPC-DS Query 10 fails to compile Key: SPARK-13820 URL: https://issues.apache.org/jira/browse/SPARK-13820 Project: Spark Issue Type: Bug Affects Versio

[jira] [Deleted] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13565: --- > Migrate DataFrameReader/DataFrameWriter to Dataset API > -

[jira] [Deleted] (SPARK-13561) Migrate Dataset untyped aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13561: --- > Migrate Dataset untyped aggregations > > > Key: S

[jira] [Commented] (SPARK-13818) the spark streaming job will be always processing status when restart elasticsearch

2016-03-11 Thread yuemeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190783#comment-15190783 ] yuemeng commented on SPARK-13818: - code like: stream.foreachRDD( rdd=> {

[jira] [Created] (SPARK-13819) using a tegexp_replace in a gropu by clause raises a nullpointerexception

2016-03-11 Thread JIRA
Javier Pérez created SPARK-13819: Summary: using a tegexp_replace in a gropu by clause raises a nullpointerexception Key: SPARK-13819 URL: https://issues.apache.org/jira/browse/SPARK-13819 Project: Sp

[jira] [Created] (SPARK-13818) the spark streaming job will be always processing status when restart elasticsearch

2016-03-11 Thread yuemeng (JIRA)
yuemeng created SPARK-13818: --- Summary: the spark streaming job will be always processing status when restart elasticsearch Key: SPARK-13818 URL: https://issues.apache.org/jira/browse/SPARK-13818 Project: S

[jira] [Commented] (SPARK-13815) UnsupportedOperationException: empty collection when metadata for a Pipeline is an empty file

2016-03-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190765#comment-15190765 ] Sean Owen commented on SPARK-13815: --- This is more generally what happens when you call

[jira] [Deleted] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13563: --- > Migrate DataFrameNaFunctions to Dataset > --- > >

[jira] [Deleted] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13564: --- > Migrate DataFrameStatFunctions to Dataset > - > >

[jira] [Deleted] (SPARK-13562) Migrate Dataset typed aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13562: --- > Migrate Dataset typed aggregations > -- > > Key: SPARK

[jira] [Assigned] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13817: Assignee: Apache Spark (was: Cheng Lian) > Re-enable MiMA check after unifying DataFrame

[jira] [Commented] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190744#comment-15190744 ] Apache Spark commented on SPARK-13817: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13817: Assignee: Cheng Lian (was: Apache Spark) > Re-enable MiMA check after unifying DataFrame

[jira] [Created] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13817: -- Summary: Re-enable MiMA check after unifying DataFrame and Dataset API Key: SPARK-13817 URL: https://issues.apache.org/jira/browse/SPARK-13817 Project: Spark Is

[jira] [Deleted] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13560: --- > Migrate GroupedDataset pivoting methods > --- > >

[jira] [Deleted] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13559: --- > Migrate common GroupedDataset aggregations > -- > >

[jira] [Deleted] (SPARK-13558) Migrate basic GroupedDataset methods

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13558: --- > Migrate basic GroupedDataset methods > > > Key: S

[jira] [Deleted] (SPARK-13557) Migrate gather-to-driver actions

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13557: --- > Migrate gather-to-driver actions > > > Key: SPARK-135

[jira] [Deleted] (SPARK-13555) Migrate untyped relational operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13555: --- > Migrate untyped relational operations > - > > Key:

[jira] [Deleted] (SPARK-13556) Migrate untyped joins

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13556: --- > Migrate untyped joins > - > > Key: SPARK-13556 > U

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > > Key: SPA

[jira] [Deleted] (SPARK-13554) Migrate typed relational operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13554: --- > Migrate typed relational operations > --- > > Key: SPA

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > > Key: SPA

[jira] [Assigned] (SPARK-13816) Add parameter checks for algorithms in Graphx

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13816: Assignee: Apache Spark > Add parameter checks for algorithms in Graphx >

[jira] [Commented] (SPARK-13816) Add parameter checks for algorithms in Graphx

2016-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190703#comment-15190703 ] Apache Spark commented on SPARK-13816: -- User 'zhengruifeng' has created a pull reque

  1   2   >