[jira] [Commented] (SPARK-12818) Implement Bloom filter and count-min sketch in DataFrames

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120975#comment-15120975 ] Apache Spark commented on SPARK-12818: -- User 'liancheng' has created a pull request

[jira] [Commented] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120961#comment-15120961 ] Apache Spark commented on SPARK-10777: -- User 'kevinyu98' has created a pull request

[jira] [Updated] (SPARK-11012) Canonicalize view definitions

2016-01-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11012: Issue Type: New Feature (was: Bug) > Canonicalize view definitions > -

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-01-27 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120925#comment-15120925 ] Miao Wang commented on SPARK-13034: --- Yanbo, Thanks for your reply! I will learn the ba

[jira] [Commented] (SPARK-12987) Drop fails when columns contain dots

2016-01-27 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120922#comment-15120922 ] Jayadevan M commented on SPARK-12987: - I think the exception is occurred during selec

[jira] [Updated] (SPARK-13058) spark-shell start fail

2016-01-27 Thread geting (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] geting updated SPARK-13058: --- Summary: spark-shell start fail (was: spark-shell start failure) > spark-shell start fail >

[jira] [Updated] (SPARK-13058) spark-shell start failure

2016-01-27 Thread geting (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] geting updated SPARK-13058: --- Affects Version/s: 1.6.0 > spark-shell start failure > - > > Key: SPA

[jira] [Commented] (SPARK-12977) Factoring out StreamingListener and UI to support history UI

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120890#comment-15120890 ] Apache Spark commented on SPARK-12977: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-12977) Factoring out StreamingListener and UI to support history UI

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12977: Assignee: (was: Apache Spark) > Factoring out StreamingListener and UI to support hist

[jira] [Assigned] (SPARK-12977) Factoring out StreamingListener and UI to support history UI

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12977: Assignee: Apache Spark > Factoring out StreamingListener and UI to support history UI > --

[jira] [Created] (SPARK-13058) spark-shell start failure

2016-01-27 Thread geting (JIRA)
geting created SPARK-13058: -- Summary: spark-shell start failure Key: SPARK-13058 URL: https://issues.apache.org/jira/browse/SPARK-13058 Project: Spark Issue Type: Bug Environment: sh -versi

[jira] [Commented] (SPARK-13057) Add benchmark codes and the performance results for implemented compression schemes for InMemoryRelation

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120822#comment-15120822 ] Apache Spark commented on SPARK-13057: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-13057) Add benchmark codes and the performance results for implemented compression schemes for InMemoryRelation

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13057: Assignee: Apache Spark > Add benchmark codes and the performance results for implemented c

[jira] [Assigned] (SPARK-13057) Add benchmark codes and the performance results for implemented compression schemes for InMemoryRelation

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13057: Assignee: (was: Apache Spark) > Add benchmark codes and the performance results for im

[jira] [Created] (SPARK-13057) Add benchmark codes and the performance results for implemented compression schemes for InMemoryRelation

2016-01-27 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-13057: Summary: Add benchmark codes and the performance results for implemented compression schemes for InMemoryRelation Key: SPARK-13057 URL: https://issues.apache.org/jira/brow

[jira] [Commented] (SPARK-13056) Map column would throw NPE if value is null

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120816#comment-15120816 ] Apache Spark commented on SPARK-13056: -- User 'adrian-wang' has created a pull reques

[jira] [Assigned] (SPARK-13056) Map column would throw NPE if value is null

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13056: Assignee: (was: Apache Spark) > Map column would throw NPE if value is null >

[jira] [Assigned] (SPARK-13056) Map column would throw NPE if value is null

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13056: Assignee: Apache Spark > Map column would throw NPE if value is null > ---

[jira] [Created] (SPARK-13056) Map column would throw NPE if value is null

2016-01-27 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-13056: --- Summary: Map column would throw NPE if value is null Key: SPARK-13056 URL: https://issues.apache.org/jira/browse/SPARK-13056 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12989: Assignee: (was: Apache Spark) > Bad interaction between StarExpansion and ExtractWindo

[jira] [Assigned] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12989: Assignee: Apache Spark > Bad interaction between StarExpansion and ExtractWindowExpression

[jira] [Commented] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120677#comment-15120677 ] Apache Spark commented on SPARK-12989: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-13055) SQLHistoryListener throws ClassCastException

2016-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13055: - Summary: SQLHistoryListener throws ClassCastException Key: SPARK-13055 URL: https://issues.apache.org/jira/browse/SPARK-13055 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120648#comment-15120648 ] Yanbo Liang commented on SPARK-13034: - Hi Miao, Please feel free to take this one, t

[jira] [Commented] (SPARK-12683) SQL timestamp is wrong when accessed as Python datetime

2016-01-27 Thread Daniel Jalova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120471#comment-15120471 ] Daniel Jalova commented on SPARK-12683: --- This seems to be related to the 2038 probl

[jira] [Commented] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120469#comment-15120469 ] Seth Hendrickson commented on SPARK-13047: -- Since the change is small, I have su

[jira] [Assigned] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13047: Assignee: Apache Spark > Pyspark Params.hasParam should not throw an error > -

[jira] [Assigned] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13047: Assignee: (was: Apache Spark) > Pyspark Params.hasParam should not throw an error > --

[jira] [Commented] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120463#comment-15120463 ] Apache Spark commented on SPARK-13047: -- User 'sethah' has created a pull request for

[jira] [Assigned] (SPARK-13043) Support remaining types in ColumnarBatch

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13043: Assignee: (was: Apache Spark) > Support remaining types in ColumnarBatch > ---

[jira] [Commented] (SPARK-13043) Support remaining types in ColumnarBatch

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120430#comment-15120430 ] Apache Spark commented on SPARK-13043: -- User 'nongli' has created a pull request for

[jira] [Assigned] (SPARK-13043) Support remaining types in ColumnarBatch

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13043: Assignee: Apache Spark > Support remaining types in ColumnarBatch > --

[jira] [Commented] (SPARK-12783) Dataset map serialization error

2016-01-27 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120421#comment-15120421 ] Wenchen Fan commented on SPARK-12783: - ah... finally I reproduced it in 1.6.0! Luckil

[jira] [Resolved] (SPARK-13045) Clean up ColumnarBatch.Row and Column.Struct

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13045. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10952 [https://github.

[jira] [Assigned] (SPARK-12963) In cluster mode,spark_local_ip will cause driver exception:Service 'Driver' failed after 16 retries!

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12963: Assignee: (was: Apache Spark) > In cluster mode,spark_local_ip will cause driver excep

[jira] [Commented] (SPARK-12963) In cluster mode,spark_local_ip will cause driver exception:Service 'Driver' failed after 16 retries!

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120414#comment-15120414 ] Apache Spark commented on SPARK-12963: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-12963) In cluster mode,spark_local_ip will cause driver exception:Service 'Driver' failed after 16 retries!

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12963: Assignee: Apache Spark > In cluster mode,spark_local_ip will cause driver exception:Servic

[jira] [Updated] (SPARK-12913) Reimplement stddev/variance as declarative function

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12913: --- Summary: Reimplement stddev/variance as declarative function (was: Reimplement all builtin aggregate

[jira] [Updated] (SPARK-13053) Rectify ignored tests in InternalAccumulatorSuite

2016-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13053: -- Target Version/s: 2.0.0 > Rectify ignored tests in InternalAccumulatorSuite > -

[jira] [Updated] (SPARK-13053) Rectify ignored tests in InternalAccumulatorSuite

2016-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13053: -- Affects Version/s: 2.0.0 > Rectify ignored tests in InternalAccumulatorSuite >

[jira] [Commented] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120362#comment-15120362 ] Apache Spark commented on SPARK-13054: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13054: Assignee: Apache Spark (was: Andrew Or) > Always post TaskEnd event for tasks in cancelle

[jira] [Assigned] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13054: Assignee: Andrew Or (was: Apache Spark) > Always post TaskEnd event for tasks in cancelle

[jira] [Created] (SPARK-13054) Always post TaskEnd event for tasks in cancelled stages

2016-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13054: - Summary: Always post TaskEnd event for tasks in cancelled stages Key: SPARK-13054 URL: https://issues.apache.org/jira/browse/SPARK-13054 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-13052) waitingApps metric doesn't show the number of apps currently in the WAITING state

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13052: Assignee: (was: Apache Spark) > waitingApps metric doesn't show the number of apps cur

[jira] [Commented] (SPARK-13052) waitingApps metric doesn't show the number of apps currently in the WAITING state

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120357#comment-15120357 ] Apache Spark commented on SPARK-13052: -- User 'RaafatAkkad' has created a pull reques

[jira] [Assigned] (SPARK-13052) waitingApps metric doesn't show the number of apps currently in the WAITING state

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13052: Assignee: Apache Spark > waitingApps metric doesn't show the number of apps currently in t

[jira] [Updated] (SPARK-13052) waitingApps metric doesn't show the number of apps currently in the WAITING state

2016-01-27 Thread Raafat Akkad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raafat Akkad updated SPARK-13052: - Attachment: Incorrect waitingApps.png > waitingApps metric doesn't show the number of apps curren

[jira] [Updated] (SPARK-13052) waitingApps metric doesn't show the number of apps currently in the WAITING state

2016-01-27 Thread Raafat Akkad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raafat Akkad updated SPARK-13052: - Attachment: Correct waitingApps.png > waitingApps metric doesn't show the number of apps currentl

[jira] [Commented] (SPARK-13037) PySpark ml.recommendation support export/import

2016-01-27 Thread Evan Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120341#comment-15120341 ] Evan Chen commented on SPARK-13037: --- Hey Yanbo, I can take this one. Thank you > PyS

[jira] [Updated] (SPARK-13053) Rectify ignored tests in InternalAccumulatorSuite

2016-01-27 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13053: -- Description: {code} // TODO: these two tests are incorrect; they don't actually trigger stage retries.

[jira] [Created] (SPARK-13053) Rectify ignored tests in InternalAccumulatorSuite

2016-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13053: - Summary: Rectify ignored tests in InternalAccumulatorSuite Key: SPARK-13053 URL: https://issues.apache.org/jira/browse/SPARK-13053 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13052) waitingApps metric doesn't show the number of apps currently in the WAITING state

2016-01-27 Thread Raafat Akkad (JIRA)
Raafat Akkad created SPARK-13052: Summary: waitingApps metric doesn't show the number of apps currently in the WAITING state Key: SPARK-13052 URL: https://issues.apache.org/jira/browse/SPARK-13052 Pro

[jira] [Created] (SPARK-13051) Do not maintain global singleton map for accumulators

2016-01-27 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13051: - Summary: Do not maintain global singleton map for accumulators Key: SPARK-13051 URL: https://issues.apache.org/jira/browse/SPARK-13051 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120311#comment-15120311 ] Apache Spark commented on SPARK-10620: -- User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

2016-01-27 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120306#comment-15120306 ] Imran Younus commented on SPARK-4144: - [~cfregly] [~josephkb] If there is still intere

[jira] [Commented] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120278#comment-15120278 ] Seth Hendrickson commented on SPARK-13047: -- cc [~mengxr] who wrote the initial i

[jira] [Updated] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Hendrickson updated SPARK-13047: - Description: Pyspark {{Params}} class has a method {{hasParam(paramName)}} which returns

[jira] [Commented] (SPARK-1792) Missing Spark-Shell Configure Options

2016-01-27 Thread Jim Lohse (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120248#comment-15120248 ] Jim Lohse commented on SPARK-1792: -- Was there any movement on this? I am seeing an unreso

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-27 Thread Jai Murugesh Rajasekaran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120229#comment-15120229 ] Jai Murugesh Rajasekaran commented on SPARK-12984: -- Thanks for your resp

[jira] [Resolved] (SPARK-12866) Migrate the ExtendedHiveQlParser to the new parser

2016-01-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12866. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Migrate the

[jira] [Commented] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

2016-01-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120220#comment-15120220 ] Herman van Hovell commented on SPARK-13049: --- I have opened a PR for this. This

[jira] [Resolved] (SPARK-12865) Migrate the SparkSQLParser to the new parser

2016-01-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12865. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Migrate the

[jira] [Assigned] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13049: Assignee: (was: Apache Spark) > Cannot use FIRST/LAST ignoreNulls option in 1.6 and be

[jira] [Assigned] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13049: Assignee: Apache Spark > Cannot use FIRST/LAST ignoreNulls option in 1.6 and below > -

[jira] [Commented] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120214#comment-15120214 ] Apache Spark commented on SPARK-13049: -- User 'hvanhovell' has created a pull request

[jira] [Resolved] (SPARK-12818) Implement Bloom filter and count-min sketch in DataFrames

2016-01-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12818. - Resolution: Fixed Fix Version/s: 2.0.0 > Implement Bloom filter and count-min sketch in Da

[jira] [Resolved] (SPARK-12938) Bloom filter DataFrame API integration

2016-01-27 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12938. - Resolution: Fixed Fix Version/s: 2.0.0 > Bloom filter DataFrame API integration >

[jira] [Resolved] (SPARK-13021) Fail fast when custom RDD's violate RDD.partition's API contract

2016-01-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13021. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10932 [https://github.com/

[jira] [Updated] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-01-27 Thread Jeff Stein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Stein updated SPARK-13048: --- Description: In EMLDAOptimizer, all checkpoints are deleted before returning the DistributedLDAModel

[jira] [Updated] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-01-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12811: -- Shepherd: Xiangrui Meng > Estimator interface for generalized linear models (GLMs) > --

[jira] [Updated] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-01-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12811: -- Assignee: Yanbo Liang > Estimator interface for generalized linear models (GLMs) >

[jira] [Issue Comment Deleted] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-01-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10945: -- Comment: was deleted (was: User 'dmarcous' has created a pull request for this issue: https://g

[jira] [Assigned] (SPARK-13050) Scalatest tags fail builds with the addition of the sketch module

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13050: Assignee: (was: Apache Spark) > Scalatest tags fail builds with the addition of the sk

[jira] [Commented] (SPARK-13050) Scalatest tags fail builds with the addition of the sketch module

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120144#comment-15120144 ] Apache Spark commented on SPARK-13050: -- User 'ajbozarth' has created a pull request

[jira] [Assigned] (SPARK-13050) Scalatest tags fail builds with the addition of the sketch module

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13050: Assignee: Apache Spark > Scalatest tags fail builds with the addition of the sketch module

[jira] [Created] (SPARK-13050) Scalatest tags fail builds with the addition of the sketch module

2016-01-27 Thread Alex Bozarth (JIRA)
Alex Bozarth created SPARK-13050: Summary: Scalatest tags fail builds with the addition of the sketch module Key: SPARK-13050 URL: https://issues.apache.org/jira/browse/SPARK-13050 Project: Spark

[jira] [Commented] (SPARK-13050) Scalatest tags fail builds with the addition of the sketch module

2016-01-27 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120136#comment-15120136 ] Alex Bozarth commented on SPARK-13050: -- I have a fix, will open a PR shortly > Scal

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-01-27 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120113#comment-15120113 ] Mark Grover commented on SPARK-12177: - I have issued a new PR https://github.com/apac

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120110#comment-15120110 ] Apache Spark commented on SPARK-12177: -- User 'markgrover' has created a pull request

[jira] [Updated] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

2016-01-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-13049: -- Description: {{FIRST/LAST}} have an ignoreNulls option. These cannot be used in WindowF

[jira] [Created] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

2016-01-27 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13049: - Summary: Cannot use FIRST/LAST ignoreNulls option in 1.6 and below Key: SPARK-13049 URL: https://issues.apache.org/jira/browse/SPARK-13049 Project: Spark

[jira] [Commented] (SPARK-13045) Clean up ColumnarBatch.Row and Column.Struct

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120094#comment-15120094 ] Apache Spark commented on SPARK-13045: -- User 'nongli' has created a pull request for

[jira] [Assigned] (SPARK-13045) Clean up ColumnarBatch.Row and Column.Struct

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13045: Assignee: Apache Spark > Clean up ColumnarBatch.Row and Column.Struct > --

[jira] [Assigned] (SPARK-13045) Clean up ColumnarBatch.Row and Column.Struct

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13045: Assignee: (was: Apache Spark) > Clean up ColumnarBatch.Row and Column.Struct > ---

[jira] [Assigned] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11701: Assignee: Apache Spark (was: Thomas Graves) > YARN - dynamic allocation and speculation a

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120089#comment-15120089 ] Apache Spark commented on SPARK-11701: -- User 'tgravescs' has created a pull request

[jira] [Assigned] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11701: Assignee: Thomas Graves (was: Apache Spark) > YARN - dynamic allocation and speculation a

[jira] [Created] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

2016-01-27 Thread Jeff Stein (JIRA)
Jeff Stein created SPARK-13048: -- Summary: EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel Key: SPARK-13048 URL: https://issues.apache.org/jira/browse/SPARK-13048 Project: Spark

[jira] [Resolved] (SPARK-12896) Send only accumulator updates, not TaskMetrics, to the driver

2016-01-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12896. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10835 [https://github.

[jira] [Created] (SPARK-13047) Pyspark Params.hasParam should not throw an error

2016-01-27 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-13047: Summary: Pyspark Params.hasParam should not throw an error Key: SPARK-13047 URL: https://issues.apache.org/jira/browse/SPARK-13047 Project: Spark Iss

[jira] [Created] (SPARK-13046) Partitioning looks broken in 1.6

2016-01-27 Thread Julien Baley (JIRA)
Julien Baley created SPARK-13046: Summary: Partitioning looks broken in 1.6 Key: SPARK-13046 URL: https://issues.apache.org/jira/browse/SPARK-13046 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120023#comment-15120023 ] Shixiong Zhu commented on SPARK-12591: -- Where is LiveSequenceMergeTracker, in a sepa

[jira] [Updated] (SPARK-13046) Partitioning looks broken in 1.6

2016-01-27 Thread Julien Baley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Baley updated SPARK-13046: - Description: Hello, I have a list of files in s3: s3://bucket/some_path/date_received=2016-01-1

[jira] [Resolved] (SPARK-12895) Implement TaskMetrics using accumulators

2016-01-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12895. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10835 [https://github.

[jira] [Resolved] (SPARK-13022) Shade jackson core

2016-01-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-13022. Resolution: Won't Fix > Shade jackson core > -- > > Key: SPARK-13022 >

[jira] [Updated] (SPARK-12950) Improve performance of BytesToBytesMap

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12950: --- Assignee: (was: Davies Liu) > Improve performance of BytesToBytesMap > --

[jira] [Assigned] (SPARK-12950) Improve performance of BytesToBytesMap

2016-01-27 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12950: -- Assignee: Davies Liu > Improve performance of BytesToBytesMap > --

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119987#comment-15119987 ] Lin Zhao commented on SPARK-12591: -- I patched the server with branch-1.6, reverted the w

[jira] [Created] (SPARK-13045) Clean up ColumnarBatch.Row and Column.Struct

2016-01-27 Thread Nong Li (JIRA)
Nong Li created SPARK-13045: --- Summary: Clean up ColumnarBatch.Row and Column.Struct Key: SPARK-13045 URL: https://issues.apache.org/jira/browse/SPARK-13045 Project: Spark Issue Type: Sub-task

  1   2   >