[jira] [Commented] (SPARK-18454) Changes to improve Nearest Neighbor Search for LSH

[ https://issues.apache.org/jira/browse/SPARK-18454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875552#comment-15875552 ] Nick Pentreath commented on SPARK-18454: Can you also comment on

[jira] [Commented] (SPARK-19675) ExecutorClassLoader loads classes from SystemClassLoader

[ https://issues.apache.org/jira/browse/SPARK-19675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875526#comment-15875526 ] Kohki Nishio commented on SPARK-19675: -- Spark is picking up a class from difference places depending

[jira] [Commented] (SPARK-19675) ExecutorClassLoader loads classes from SystemClassLoader

[ https://issues.apache.org/jira/browse/SPARK-19675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875504#comment-15875504 ] Kohki Nishio commented on SPARK-19675: -- Here's a simple repro, both should say

[jira] [Resolved] (SPARK-19675) ExecutorClassLoader loads classes from SystemClassLoader

[ https://issues.apache.org/jira/browse/SPARK-19675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19675. --- Resolution: Not A Problem I'm not sure how SBT figures into this. You should be running matched

[jira] [Commented] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875482#comment-15875482 ] yuhao yang commented on SPARK-18608: Thanks [~podongfeng] > Spark ML algorithms that check RDD

[jira] [Reopened] (SPARK-19675) ExecutorClassLoader loads classes from SystemClassLoader

[ https://issues.apache.org/jira/browse/SPARK-19675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohki Nishio reopened SPARK-19675: -- SBT can manage 2.11 applications, an applicaiton runs completely with 2.11 binary however SBT is

[jira] [Resolved] (SPARK-19675) ExecutorClassLoader loads classes from SystemClassLoader

[ https://issues.apache.org/jira/browse/SPARK-19675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19675. --- Resolution: Invalid Of course, you need to run Spark with a version of Scala that matches how it

[jira] [Created] (SPARK-19675) ExecutorClassLoader loads classes from SystemClassLoader

Kohki Nishio created SPARK-19675: Summary: ExecutorClassLoader loads classes from SystemClassLoader Key: SPARK-19675 URL: https://issues.apache.org/jira/browse/SPARK-19675 Project: Spark

[jira] [Commented] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875468#comment-15875468 ] zhengruifeng commented on SPARK-18608: -- [~mlnick] I will send a PR for this according to the above

[jira] [Commented] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875465#comment-15875465 ] Nick Pentreath commented on SPARK-18608: [~podongfeng] [~yuhaoyan] I'm not aware of anyone

[jira] [Commented] (SPARK-19668) Multiple NGram sizes

[ https://issues.apache.org/jira/browse/SPARK-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875437#comment-15875437 ] Nick Pentreath commented on SPARK-19668: I'd say a range is feasible. The current API doesn't

[jira] [Closed] (SPARK-19671) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian closed SPARK-19671. --- > change 'var' to 'val' for better Specification > -- > >

[jira] [Commented] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875414#comment-15875414 ] LvDongrong commented on SPARK-19673: Before spark1.4.x, the ThriftServer name is

[jira] [Closed] (SPARK-18452) Support History Server UI to use SPNEGO

[ https://issues.apache.org/jira/browse/SPARK-18452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shi Wang closed SPARK-18452. Resolution: Invalid > Support History Server UI to use SPNEGO > --- >

[jira] [Issue Comment Deleted] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LvDongrong updated SPARK-19673: --- Comment: was deleted (was: Before spark1.4.x, the ThriftServer name is

[jira] [Commented] (SPARK-18452) Support History Server UI to use SPNEGO

[ https://issues.apache.org/jira/browse/SPARK-18452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875400#comment-15875400 ] Shi Wang commented on SPARK-18452: -- Both Spark Thrift Server UI and History server UI could be

[jira] [Commented] (SPARK-18453) Support Thrift UI to use SPNEGO

[ https://issues.apache.org/jira/browse/SPARK-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875397#comment-15875397 ] Shi Wang commented on SPARK-18453: -- Both Spark Thrift Server UI and History server UI could be

[jira] [Closed] (SPARK-18453) Support Thrift UI to use SPNEGO

[ https://issues.apache.org/jira/browse/SPARK-18453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shi Wang closed SPARK-18453. Resolution: Invalid > Support Thrift UI to use SPNEGO > --- > >

[jira] [Commented] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875398#comment-15875398 ] LvDongrong commented on SPARK-19673: Before spark1.4.x, the ThriftServer name is

[jira] [Assigned] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19673: Assignee: (was: Apache Spark) > ThriftServer default app name is changed wrong >

[jira] [Commented] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875392#comment-15875392 ] Apache Spark commented on SPARK-19673: -- User 'lvdongr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19673: Assignee: Apache Spark > ThriftServer default app name is changed wrong >

[jira] [Assigned] (SPARK-19508) Improve error message when binding service fails

[ https://issues.apache.org/jira/browse/SPARK-19508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19508: - Assignee: Liang-Chi Hsieh > Improve error message when binding service fails >

[jira] [Resolved] (SPARK-19508) Improve error message when binding service fails

[ https://issues.apache.org/jira/browse/SPARK-19508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19508. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16851

[jira] [Updated] (SPARK-19674) Ignore non-existing driver accumulator updates when merging all accumulator updates in SQLListener

[ https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carson Wang updated SPARK-19674: Summary: Ignore non-existing driver accumulator updates when merging all accumulator updates in

[jira] [Assigned] (SPARK-19674) Ignore non-existing driver accumulator updates in SQLListener

[ https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19674: Assignee: Apache Spark > Ignore non-existing driver accumulator updates in SQLListener >

[jira] [Commented] (SPARK-19674) Ignore non-existing driver accumulator updates in SQLListener

[ https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875382#comment-15875382 ] Apache Spark commented on SPARK-19674: -- User 'carsonwang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19674) Ignore non-existing driver accumulator updates in SQLListener

[ https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19674: Assignee: (was: Apache Spark) > Ignore non-existing driver accumulator updates in

[jira] [Created] (SPARK-19674) Ignore non-existing driver accumulator updates in SQLListener

Carson Wang created SPARK-19674: --- Summary: Ignore non-existing driver accumulator updates in SQLListener Key: SPARK-19674 URL: https://issues.apache.org/jira/browse/SPARK-19674 Project: Spark

[jira] [Commented] (SPARK-14174) Accelerate KMeans via Mini-Batch EM

[ https://issues.apache.org/jira/browse/SPARK-14174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875374#comment-15875374 ] Sean Owen commented on SPARK-14174: --- See the comments on SPARK-2308, in particular about sampling not

[jira] [Resolved] (SPARK-19672) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19672. --- Resolution: Duplicate > change 'var' to 'val' for better Specification >

[jira] [Reopened] (SPARK-19672) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-19672: --- > change 'var' to 'val' for better Specification > -- > >

[jira] [Resolved] (SPARK-19671) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19671. --- Resolution: Not A Problem > change 'var' to 'val' for better Specification >

[jira] [Commented] (SPARK-19673) ThriftServer default app name is changed wrong

[ https://issues.apache.org/jira/browse/SPARK-19673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875355#comment-15875355 ] Sean Owen commented on SPARK-19673: --- What is the problem? > ThriftServer default app name is changed

[jira] [Created] (SPARK-19673) ThriftServer default app name is changed wrong

LvDongrong created SPARK-19673: -- Summary: ThriftServer default app name is changed wrong Key: SPARK-19673 URL: https://issues.apache.org/jira/browse/SPARK-19673 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19671) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875319#comment-15875319 ] Apache Spark commented on SPARK-19671: -- User '10110346' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19671) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19671: Assignee: Apache Spark > change 'var' to 'val' for better Specification >

[jira] [Assigned] (SPARK-19671) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19671: Assignee: (was: Apache Spark) > change 'var' to 'val' for better Specification >

[jira] [Closed] (SPARK-19672) change 'var' to 'val' for better Specification

[ https://issues.apache.org/jira/browse/SPARK-19672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian closed SPARK-19672. --- Resolution: Fixed > change 'var' to 'val' for better Specification >

[jira] [Created] (SPARK-19672) change 'var' to 'val' for better Specification

liuxian created SPARK-19672: --- Summary: change 'var' to 'val' for better Specification Key: SPARK-19672 URL: https://issues.apache.org/jira/browse/SPARK-19672 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-19671) change 'var' to 'val' for better Specification

liuxian created SPARK-19671: --- Summary: change 'var' to 'val' for better Specification Key: SPARK-19671 URL: https://issues.apache.org/jira/browse/SPARK-19671 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-14174) Accelerate KMeans via Mini-Batch EM

[ https://issues.apache.org/jira/browse/SPARK-14174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875313#comment-15875313 ] zhengruifeng commented on SPARK-14174: -- [~srowen] the {{run}} changes were already merged, so we can

[jira] [Commented] (SPARK-19669) Open up visibility for sharedState, sessionState, and a few other functions

[ https://issues.apache.org/jira/browse/SPARK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875272#comment-15875272 ] Apache Spark commented on SPARK-19669: -- User 'windpiger' has created a pull request for this issue:

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875193#comment-15875193 ] Hyukjin Kwon commented on SPARK-17636: -- FWIW, SPARK-4502 is about nested column pruning as a related

[jira] [Assigned] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17636: Assignee: Apache Spark > Parquet filter push down doesn't handle struct fields >

[jira] [Assigned] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17636: Assignee: (was: Apache Spark) > Parquet filter push down doesn't handle struct fields

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875188#comment-15875188 ] Nick Dimiduk commented on SPARK-17636: -- I've proposed a PR for fixing this issue. Using [~maropu]'s

[jira] [Commented] (SPARK-19638) Filter pushdown not working for struct fields

[ https://issues.apache.org/jira/browse/SPARK-19638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875184#comment-15875184 ] Nick Dimiduk commented on SPARK-19638: -- Okay [~maropu], I'll continue discussion over there. >

[jira] [Assigned] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17636: Assignee: Apache Spark > Parquet filter push down doesn't handle struct fields >

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875183#comment-15875183 ] Apache Spark commented on SPARK-17636: -- User 'ndimiduk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17636: Assignee: (was: Apache Spark) > Parquet filter push down doesn't handle struct fields

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875178#comment-15875178 ] Nick Dimiduk commented on SPARK-17636: -- Per [~maropu]'s comments on SPARK-19638, this issue is not

[jira] [Commented] (SPARK-19615) Provide Dataset union convenience for divergent schema

[ https://issues.apache.org/jira/browse/SPARK-19615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875137#comment-15875137 ] Nick Dimiduk commented on SPARK-19615: -- Thanks for taking a look [~hyukjin.kwon]. These three bugs

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875115#comment-15875115 ] Jason Moore commented on SPARK-18105: - I've hit the same using a very recent build from branch-2.1

[jira] [Resolved] (SPARK-19669) Open up visibility for sharedState, sessionState, and a few other functions

[ https://issues.apache.org/jira/browse/SPARK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19669. - Resolution: Fixed Fix Version/s: 2.2.0 > Open up visibility for sharedState, sessionState, and a

[jira] [Assigned] (SPARK-14659) OneHotEncoder support drop first category alphabetically in the encoded vector

[ https://issues.apache.org/jira/browse/SPARK-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14659: Assignee: Apache Spark > OneHotEncoder support drop first category alphabetically in the

[jira] [Assigned] (SPARK-14659) OneHotEncoder support drop first category alphabetically in the encoded vector

[ https://issues.apache.org/jira/browse/SPARK-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14659: Assignee: (was: Apache Spark) > OneHotEncoder support drop first category

[jira] [Commented] (SPARK-14659) OneHotEncoder support drop first category alphabetically in the encoded vector

[ https://issues.apache.org/jira/browse/SPARK-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875004#comment-15875004 ] Apache Spark commented on SPARK-14659: -- User 'actuaryzhang' has created a pull request for this

[jira] [Commented] (SPARK-18454) Changes to improve Nearest Neighbor Search for LSH

[ https://issues.apache.org/jira/browse/SPARK-18454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874956#comment-15874956 ] Yun Ni commented on SPARK-18454: [~josephkb] [~sethah] [~mlnick] I opened a gDoc for discussions. Feel

[jira] [Assigned] (SPARK-19670) Enable Bucketed Table Reading and Writing Testing Without Hive Support

[ https://issues.apache.org/jira/browse/SPARK-19670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19670: Assignee: Xiao Li (was: Apache Spark) > Enable Bucketed Table Reading and Writing

[jira] [Assigned] (SPARK-19670) Enable Bucketed Table Reading and Writing Testing Without Hive Support

[ https://issues.apache.org/jira/browse/SPARK-19670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19670: Assignee: Apache Spark (was: Xiao Li) > Enable Bucketed Table Reading and Writing

[jira] [Commented] (SPARK-19670) Enable Bucketed Table Reading and Writing Testing Without Hive Support

[ https://issues.apache.org/jira/browse/SPARK-19670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874885#comment-15874885 ] Apache Spark commented on SPARK-19670: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-19670) Enable Bucketed Table Reading and Writing Testing Without Hive Support

Xiao Li created SPARK-19670: --- Summary: Enable Bucketed Table Reading and Writing Testing Without Hive Support Key: SPARK-19670 URL: https://issues.apache.org/jira/browse/SPARK-19670 Project: Spark

[jira] [Commented] (SPARK-19646) binaryRecords replicates records in scala API

[ https://issues.apache.org/jira/browse/SPARK-19646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874867#comment-15874867 ] Apache Spark commented on SPARK-19646: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19669) Open up visibility for sharedState, sessionState, and a few other functions

[ https://issues.apache.org/jira/browse/SPARK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19669: Assignee: Reynold Xin (was: Apache Spark) > Open up visibility for sharedState,

[jira] [Commented] (SPARK-19669) Open up visibility for sharedState, sessionState, and a few other functions

[ https://issues.apache.org/jira/browse/SPARK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874854#comment-15874854 ] Apache Spark commented on SPARK-19669: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19669) Open up visibility for sharedState, sessionState, and a few other functions

[ https://issues.apache.org/jira/browse/SPARK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19669: Assignee: Apache Spark (was: Reynold Xin) > Open up visibility for sharedState,

[jira] [Created] (SPARK-19669) Open up visibility for sharedState, sessionState, and a few other functions

Reynold Xin created SPARK-19669: --- Summary: Open up visibility for sharedState, sessionState, and a few other functions Key: SPARK-19669 URL: https://issues.apache.org/jira/browse/SPARK-19669 Project:

[jira] [Resolved] (SPARK-19646) binaryRecords replicates records in scala API

[ https://issues.apache.org/jira/browse/SPARK-19646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19646. --- Resolution: Fixed Fix Version/s: 2.2.0 2.0.3 2.1.1

[jira] [Comment Edited] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874798#comment-15874798 ] Takeshi Yamamuro edited comment on SPARK-19666 at 2/20/17 4:50 PM: ---

[jira] [Commented] (SPARK-19666) Exception when calling createDataFrame with typed RDD

[ https://issues.apache.org/jira/browse/SPARK-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874798#comment-15874798 ] Takeshi Yamamuro commented on SPARK-19666: -- It'd be better to put at least a simple query to

[jira] [Commented] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874789#comment-15874789 ] Mateusz Boryn commented on SPARK-17920: --- [~norvellj] This is similar to SPARK-19580. I'm also

[jira] [Commented] (SPARK-19580) Support for avro.schema.url while writing to hive table

[ https://issues.apache.org/jira/browse/SPARK-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874785#comment-15874785 ] Mateusz Boryn commented on SPARK-19580: --- Similar to SPARK-17920 > Support for avro.schema.url

[jira] [Assigned] (SPARK-19667) Create table with HiveEnabled in default database use warehouse path instead of the location of default database

[ https://issues.apache.org/jira/browse/SPARK-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19667: Assignee: Apache Spark > Create table with HiveEnabled in default database use warehouse

[jira] [Assigned] (SPARK-19667) Create table with HiveEnabled in default database use warehouse path instead of the location of default database

[ https://issues.apache.org/jira/browse/SPARK-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19667: Assignee: (was: Apache Spark) > Create table with HiveEnabled in default database use

[jira] [Commented] (SPARK-19667) Create table with HiveEnabled in default database use warehouse path instead of the location of default database

[ https://issues.apache.org/jira/browse/SPARK-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874638#comment-15874638 ] Apache Spark commented on SPARK-19667: -- User 'windpiger' has created a pull request for this issue:

[jira] [Commented] (SPARK-18946) treeAggregate will be low effficiency when aggregate high dimension vectors in ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-18946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874628#comment-15874628 ] Apache Spark commented on SPARK-18946: -- User 'ZunwenYou' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18946) treeAggregate will be low effficiency when aggregate high dimension vectors in ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-18946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18946: Assignee: Apache Spark > treeAggregate will be low effficiency when aggregate high

[jira] [Assigned] (SPARK-18946) treeAggregate will be low effficiency when aggregate high dimension vectors in ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-18946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18946: Assignee: (was: Apache Spark) > treeAggregate will be low effficiency when aggregate

[jira] [Comment Edited] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874614#comment-15874614 ] Deenbandhu Agarwal edited comment on SPARK-19644 at 2/20/17 2:40 PM: -

[jira] [Commented] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874614#comment-15874614 ] Deenbandhu Agarwal commented on SPARK-19644: Sorry for the delayed response. No, I didn't

[jira] [Comment Edited] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874614#comment-15874614 ] Deenbandhu Agarwal edited comment on SPARK-19644 at 2/20/17 2:42 PM: -

[jira] [Issue Comment Deleted] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deenbandhu Agarwal updated SPARK-19644: --- Comment: was deleted (was: This is for smaller heap dump taken at the application

[jira] [Updated] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deenbandhu Agarwal updated SPARK-19644: --- Attachment: Dominator_tree.png > Memory leak in Spark Streaming >

[jira] [Updated] (SPARK-19644) Memory leak in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deenbandhu Agarwal updated SPARK-19644: --- Attachment: Path2GCRoot.png This is for smaller heap dump taken at the application

[jira] [Reopened] (SPARK-18946) treeAggregate will be low effficiency when aggregate high dimension vectors in ML algorithm

[ https://issues.apache.org/jira/browse/SPARK-18946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zunwen you reopened SPARK-18946: I have implement a sliceAggregate for RDD, which proform better than treeAggregate when dimension of

[jira] [Created] (SPARK-19668) Multiple NGram sizes

Jacek KK created SPARK-19668: Summary: Multiple NGram sizes Key: SPARK-19668 URL: https://issues.apache.org/jira/browse/SPARK-19668 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-19667) Create table with HiveEnabled in default database use warehouse path instead of the location of default database

Song Jun created SPARK-19667: Summary: Create table with HiveEnabled in default database use warehouse path instead of the location of default database Key: SPARK-19667 URL:

[jira] [Commented] (SPARK-19661) Spark-2.1.0 can not connect hbase

[ https://issues.apache.org/jira/browse/SPARK-19661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874459#comment-15874459 ] Sean Owen commented on SPARK-19661: --- I'm not sure, it could be related to using the Hive syntax parser

[jira] [Created] (SPARK-19666) Exception when calling createDataFrame with typed RDD

Colin Breame created SPARK-19666: Summary: Exception when calling createDataFrame with typed RDD Key: SPARK-19666 URL: https://issues.apache.org/jira/browse/SPARK-19666 Project: Spark Issue

[jira] [Comment Edited] (SPARK-17890) scala.ScalaReflectionException

[ https://issues.apache.org/jira/browse/SPARK-17890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874360#comment-15874360 ] Mathieu D edited comment on SPARK-17890 at 2/20/17 11:01 AM: - We experience

[jira] [Commented] (SPARK-17890) scala.ScalaReflectionException

[ https://issues.apache.org/jira/browse/SPARK-17890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874360#comment-15874360 ] Mathieu D commented on SPARK-17890: --- We experience the same issue. When running from our tests (no

[jira] [Commented] (SPARK-19573) Make NaN/null handling consistent in approxQuantile

[ https://issues.apache.org/jira/browse/SPARK-19573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874321#comment-15874321 ] Nick Pentreath commented on SPARK-19573: cc [~timhunter] - can you take a look at the discussion

[jira] [Commented] (SPARK-18922) Fix more resource-closing-related and path-related test failures in identified ones on Windows

[ https://issues.apache.org/jira/browse/SPARK-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874282#comment-15874282 ] Apache Spark commented on SPARK-18922: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-19665) Improve constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-19665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19665: Assignee: (was: Apache Spark) > Improve constraint propagation >

[jira] [Assigned] (SPARK-19665) Improve constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-19665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19665: Assignee: Apache Spark > Improve constraint propagation > --

[jira] [Commented] (SPARK-19665) Improve constraint propagation

[ https://issues.apache.org/jira/browse/SPARK-19665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874230#comment-15874230 ] Apache Spark commented on SPARK-19665: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-19665) Improve constraint propagation

Liang-Chi Hsieh created SPARK-19665: --- Summary: Improve constraint propagation Key: SPARK-19665 URL: https://issues.apache.org/jira/browse/SPARK-19665 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-15679) Passing functions do not work in classes

[ https://issues.apache.org/jira/browse/SPARK-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-15679. -- Resolution: Invalid Your test codes look not working as is. I manually modified your codes and