[jira] [Commented] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140465#comment-15140465 ] Mark Grover commented on SPARK-13252: - Yeah, this is a very small subset of the patch

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140463#comment-15140463 ] Xiao Li commented on SPARK-13219: - Great! > Pushdown predicate propagation in SparkSQL

[jira] [Updated] (SPARK-13264) Remove multi-byte character in spark-env.sh.template

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13264: -- Priority: Trivial (was: Minor) Fix Version/s: (was: 2.0.0) Do not set Fix version You sho

[jira] [Commented] (SPARK-13264) Remove multi-byte character in spark-env.sh.template

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140458#comment-15140458 ] Sean Owen commented on SPARK-13264: --- This was not worth a JIRA. > Remove multi-byte ch

[jira] [Assigned] (SPARK-13264) Remove multi-byte character in spark-env.sh.template

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13264: Assignee: Apache Spark > Remove multi-byte character in spark-env.sh.template > --

[jira] [Assigned] (SPARK-13264) Remove multi-byte character in spark-env.sh.template

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13264: Assignee: (was: Apache Spark) > Remove multi-byte character in spark-env.sh.template >

[jira] [Commented] (SPARK-13264) Remove multi-byte character in spark-env.sh.template

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140456#comment-15140456 ] Apache Spark commented on SPARK-13264: -- User 'sasakitoa' has created a pull request

[jira] [Created] (SPARK-13264) Remove multi-byte character in spark-env.sh.template

2016-02-09 Thread Sasaki Toru (JIRA)
Sasaki Toru created SPARK-13264: --- Summary: Remove multi-byte character in spark-env.sh.template Key: SPARK-13264 URL: https://issues.apache.org/jira/browse/SPARK-13264 Project: Spark Issue Type

[jira] [Commented] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140448#comment-15140448 ] Sean Owen commented on SPARK-13220: --- +1 to deprecate. My sense is we may still want to

[jira] [Commented] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140447#comment-15140447 ] Sean Owen commented on SPARK-13252: --- How does this differ from SPARK-12177? it seems li

[jira] [Resolved] (SPARK-13251) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13251. --- Resolution: Duplicate > Bump up Kafka to 0.9.0.0 > > > Key:

[jira] [Resolved] (SPARK-7827) kafka streaming NotLeaderForPartition Exception could not be handled normally

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7827. -- Resolution: Not A Problem > kafka streaming NotLeaderForPartition Exception could not be handled normall

[jira] [Reopened] (SPARK-13256) Strange Error

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-13256: --- > Strange Error > - > > Key: SPARK-13256 > URL: https://issue

[jira] [Resolved] (SPARK-13256) Strange Error

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13256. --- Resolution: Invalid > Strange Error > - > > Key: SPARK-13256 >

[jira] [Closed] (SPARK-13256) Strange Error

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-13256. - > Strange Error > - > > Key: SPARK-13256 > URL: https://issues.ap

[jira] [Commented] (SPARK-3220) K-Means clusterer should perform K-Means initialization in parallel

2016-02-09 Thread Tsai Li Ming (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140434#comment-15140434 ] Tsai Li Ming commented on SPARK-3220: - [~derrickburns], Is your private fork at https

[jira] [Assigned] (SPARK-13263) SQL generation support for tablesample

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13263: Assignee: Apache Spark > SQL generation support for tablesample >

[jira] [Assigned] (SPARK-13263) SQL generation support for tablesample

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13263: Assignee: (was: Apache Spark) > SQL generation support for tablesample > -

[jira] [Commented] (SPARK-13263) SQL generation support for tablesample

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140421#comment-15140421 ] Apache Spark commented on SPARK-13263: -- User 'gatorsmile' has created a pull request

[jira] [Updated] (SPARK-13263) SQL generation support for tablesample

2016-02-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13263: Description: {{code}} SELECT s.id FROM t0 TABLESAMPLE(0.1 PERCENT) s {{code}} was:SELECT s.id FROM t0 T

[jira] [Updated] (SPARK-13263) SQL generation support for tablesample

2016-02-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13263: Description: {code} SELECT s.id FROM t0 TABLESAMPLE(0.1 PERCENT) s {code} was: {{code}} SELECT s.id FRO

[jira] [Created] (SPARK-13263) SQL generation support for tablesample

2016-02-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13263: --- Summary: SQL generation support for tablesample Key: SPARK-13263 URL: https://issues.apache.org/jira/browse/SPARK-13263 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-13246) Avro 1.7.7 Schema.parse race condition hangs task

2016-02-09 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140290#comment-15140290 ] koert kuipers commented on SPARK-13246: --- it seems this only happens when i build sp

[jira] [Created] (SPARK-13262) cannot coerce type 'environment' to vector of type 'list'

2016-02-09 Thread Samuel Alexander (JIRA)
Samuel Alexander created SPARK-13262: Summary: cannot coerce type 'environment' to vector of type 'list' Key: SPARK-13262 URL: https://issues.apache.org/jira/browse/SPARK-13262 Project: Spark

[jira] [Commented] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140286#comment-15140286 ] Apache Spark commented on SPARK-13261: -- User 'falaki' has created a pull request for

[jira] [Assigned] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13261: Assignee: (was: Apache Spark) > Expose maxCharactersPerColumn as a user configurable o

[jira] [Assigned] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13261: Assignee: Apache Spark > Expose maxCharactersPerColumn as a user configurable option > ---

[jira] [Created] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

2016-02-09 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-13261: -- Summary: Expose maxCharactersPerColumn as a user configurable option Key: SPARK-13261 URL: https://issues.apache.org/jira/browse/SPARK-13261 Project: Spark

[jira] [Created] (SPARK-13260) count(*) does not work with CSV data source

2016-02-09 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-13260: -- Summary: count(*) does not work with CSV data source Key: SPARK-13260 URL: https://issues.apache.org/jira/browse/SPARK-13260 Project: Spark Issue Type: B

[jira] [Resolved] (SPARK-13149) Add FileStreamSource

2016-02-09 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-13149. --- Resolution: Fixed Fix Version/s: 2.0.0 > Add FileStreamSource > >

[jira] [Assigned] (SPARK-13257) Refine naive Bayes example code

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13257: Assignee: (was: Apache Spark) > Refine naive Bayes example code >

[jira] [Assigned] (SPARK-13257) Refine naive Bayes example code

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13257: Assignee: Apache Spark > Refine naive Bayes example code > ---

[jira] [Commented] (SPARK-13257) Refine naive Bayes example code

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140222#comment-15140222 ] Apache Spark commented on SPARK-13257: -- User 'movelikeriver' has created a pull requ

[jira] [Created] (SPARK-13259) SPARK_HOME should not be used as the CWD in docker executors

2016-02-09 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-13259: --- Summary: SPARK_HOME should not be used as the CWD in docker executors Key: SPARK-13259 URL: https://issues.apache.org/jira/browse/SPARK-13259 Project: Spark

[jira] [Updated] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

2016-02-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12476: - Assignee: Takeshi Yamamuro > Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filte

[jira] [Resolved] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

2016-02-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12476. -- Resolution: Fixed Fix Version/s: 2.0.0 > Implement JdbcRelation#unhandledFilters for removing un

[jira] [Commented] (SPARK-12476) Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Filter

2016-02-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140192#comment-15140192 ] Yin Huai commented on SPARK-12476: -- This issue has been resolved by https://github.com/a

[jira] [Commented] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

2016-02-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140164#comment-15140164 ] Joseph K. Bradley commented on SPARK-10524: --- Note: I only backported to 1.6 sin

[jira] [Updated] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-02-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-13258: Description: Spark properties set on {{spark-submit}} via the deprecated {{SPARK_JAVA_OPTS}

[jira] [Updated] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

2016-02-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10524: -- Affects Version/s: 1.6.0 > Decision tree binary classification with ordered categorical

[jira] [Updated] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

2016-02-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10524: -- Fix Version/s: 2.0.0 1.6.1 > Decision tree binary classification wit

[jira] [Resolved] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

2016-02-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10524. --- Resolution: Fixed > Decision tree binary classification with ordered categorical feat

[jira] [Updated] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

2016-02-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10524: -- Target Version/s: 1.6.1, 2.0.0 (was: 2.0.0) > Decision tree binary classification with

[jira] [Updated] (SPARK-10524) Decision tree binary classification with ordered categorical features: incorrect centroid

2016-02-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10524: -- Assignee: Liang-Chi Hsieh > Decision tree binary classification with ordered categorica

[jira] [Updated] (SPARK-13258) --conf properties not honored in Mesos cluster mode

2016-02-09 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-13258: Summary: --conf properties not honored in Mesos cluster mode (was: --conf variables not ho

[jira] [Created] (SPARK-13258) --conf variables not honored in Mesos cluster mode

2016-02-09 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-13258: --- Summary: --conf variables not honored in Mesos cluster mode Key: SPARK-13258 URL: https://issues.apache.org/jira/browse/SPARK-13258 Project: Spark Issu

[jira] [Resolved] (SPARK-12950) Improve performance of BytesToBytesMap

2016-02-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12950. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11010 [https://github.

[jira] [Resolved] (SPARK-13256) Strange Error

2016-02-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-13256. --- Resolution: Incomplete Please use the spark user mailing list / stack overflo

[jira] [Commented] (SPARK-11618) Refactoring of basic ML import/export

2016-02-09 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140103#comment-15140103 ] Yu Ishikawa commented on SPARK-11618: - Hi [~josephkb], I have a question about ML i

[jira] [Commented] (SPARK-13257) Refine naive Bayes example code

2016-02-09 Thread Lenjoy Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140101#comment-15140101 ] Lenjoy Lin commented on SPARK-13257: a change is ready: https://github.com/apache/sp

[jira] [Created] (SPARK-13257) Refine naive Bayes example code

2016-02-09 Thread Lenjoy Lin (JIRA)
Lenjoy Lin created SPARK-13257: -- Summary: Refine naive Bayes example code Key: SPARK-13257 URL: https://issues.apache.org/jira/browse/SPARK-13257 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13245) ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple threads

2016-02-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13245: - Fix Version/s: 2.0.0 > ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple thre

[jira] [Updated] (SPARK-13245) ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple threads

2016-02-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13245: - Target Version/s: (was: 2.0.0) > ShuffleBlockFetcherIterator should not use shuffleMetrics in m

[jira] [Resolved] (SPARK-13245) ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple threads

2016-02-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13245. -- Resolution: Fixed Assignee: Shixiong Zhu Target Version/s: 2.0.0 > Shuffl

[jira] [Created] (SPARK-13256) Strange Error

2016-02-09 Thread JIRA
邱承 created SPARK-13256: -- Summary: Strange Error Key: SPARK-13256 URL: https://issues.apache.org/jira/browse/SPARK-13256 Project: Spark Issue Type: Bug Components: SparkR Affects Versions:

[jira] [Assigned] (SPARK-13255) Integrate vectorized parquet scan with whole stage codegen.

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13255: Assignee: Apache Spark > Integrate vectorized parquet scan with whole stage codegen. > ---

[jira] [Assigned] (SPARK-13255) Integrate vectorized parquet scan with whole stage codegen.

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13255: Assignee: (was: Apache Spark) > Integrate vectorized parquet scan with whole stage cod

[jira] [Commented] (SPARK-13255) Integrate vectorized parquet scan with whole stage codegen.

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140029#comment-15140029 ] Apache Spark commented on SPARK-13255: -- User 'nongli' has created a pull request for

[jira] [Commented] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

2016-02-09 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140024#comment-15140024 ] Hari Shreedharan commented on SPARK-12316: -- So the issue is that the driver got

[jira] [Created] (SPARK-13255) Integrate vectorized parquet scan with whole stage codegen.

2016-02-09 Thread Nong Li (JIRA)
Nong Li created SPARK-13255: --- Summary: Integrate vectorized parquet scan with whole stage codegen. Key: SPARK-13255 URL: https://issues.apache.org/jira/browse/SPARK-13255 Project: Spark Issue Type

[jira] [Resolved] (SPARK-6017) Provide transparent secure communication channel on Yarn

2016-02-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-6017. --- Resolution: Fixed All sub-tasks are done, so closing this. > Provide transparent secure commu

[jira] [Commented] (SPARK-13254) Fix planning of TakeOrderedAndProject operator

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140015#comment-15140015 ] Apache Spark commented on SPARK-13254: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-13254) Fix planning of TakeOrderedAndProject operator

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13254: Assignee: Apache Spark (was: Josh Rosen) > Fix planning of TakeOrderedAndProject operator

[jira] [Assigned] (SPARK-13254) Fix planning of TakeOrderedAndProject operator

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13254: Assignee: Josh Rosen (was: Apache Spark) > Fix planning of TakeOrderedAndProject operator

[jira] [Created] (SPARK-13254) Fix planning of TakeOrderedAndProject operator

2016-02-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13254: -- Summary: Fix planning of TakeOrderedAndProject operator Key: SPARK-13254 URL: https://issues.apache.org/jira/browse/SPARK-13254 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13253) Error aliasing array columns.

2016-02-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13253: - Description: Getting an "UnsupportedOperationException" when trying to alias an array col

[jira] [Updated] (SPARK-13253) Error aliasing array columns.

2016-02-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13253: - Target Version/s: 1.6.1, 2.0.0 > Error aliasing array columns. >

[jira] [Updated] (SPARK-13253) Error aliasing array columns.

2016-02-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13253: - Affects Version/s: 1.6.0 > Error aliasing array columns. > -

[jira] [Commented] (SPARK-13091) Rewrite/Propagate constraints for Aliases

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139979#comment-15139979 ] Apache Spark commented on SPARK-13091: -- User 'sameeragarwal' has created a pull requ

[jira] [Created] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Mark Grover (JIRA)
Mark Grover created SPARK-13252: --- Summary: Bump up Kafka to 0.9.0.0 Key: SPARK-13252 URL: https://issues.apache.org/jira/browse/SPARK-13252 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-9307) Logging: Make it either stable or private[spark]

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9307: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-11806 > Logging: Make it either stable or p

[jira] [Assigned] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13252: Assignee: Apache Spark > Bump up Kafka to 0.9.0.0 > > >

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

2016-02-09 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139900#comment-15139900 ] Gayathri Murali commented on SPARK-13174: - There is already a way to read CSV fil

[jira] [Updated] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-13252: Summary: Bump up Kafka to 0.9.0.0 (was: [STREAMING] Bump up Kafka to 0.9.0.0) > Bump up Kafka to

[jira] [Assigned] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13252: Assignee: (was: Apache Spark) > Bump up Kafka to 0.9.0.0 > >

[jira] [Commented] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139916#comment-15139916 ] Apache Spark commented on SPARK-13252: -- User 'markgrover' has created a pull request

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

2016-02-09 Thread Aaditya Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139898#comment-15139898 ] Aaditya Ramesh commented on SPARK-13027: [~zsxwing] I've submitted a pull request

[jira] [Assigned] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13017: Assignee: (was: Apache Spark) > Replace example code in mllib-feature-extraction.md us

[jira] [Assigned] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13017: Assignee: Apache Spark > Replace example code in mllib-feature-extraction.md using include

[jira] [Commented] (SPARK-13017) Replace example code in mllib-feature-extraction.md using include_example

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139910#comment-15139910 ] Apache Spark commented on SPARK-13017: -- User 'keypointt' has created a pull request

[jira] [Updated] (SPARK-13252) [STREAMING] Bump up Kafka to 0.9.0.0

2016-02-09 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-13252: Summary: [STREAMING] Bump up Kafka to 0.9.0.0 (was: Bump up Kafka to 0.9.0.0) > [STREAMING] Bump

[jira] [Created] (SPARK-13253) Error aliasing array columns.

2016-02-09 Thread Rakesh Chalasani (JIRA)
Rakesh Chalasani created SPARK-13253: Summary: Error aliasing array columns. Key: SPARK-13253 URL: https://issues.apache.org/jira/browse/SPARK-13253 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13220: -- Description: We currently allow `\-\-master yarn-client`. Instead, the user should do `\-\-master yarn

[jira] [Created] (SPARK-13251) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Mark Grover (JIRA)
Mark Grover created SPARK-13251: --- Summary: Bump up Kafka to 0.9.0.0 Key: SPARK-13251 URL: https://issues.apache.org/jira/browse/SPARK-13251 Project: Spark Issue Type: Improvement Comp

[jira] [Updated] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13220: -- Description: We currently allow `\--master yarn-client`. Instead, the user should do `--master yarn --d

[jira] [Updated] (SPARK-9307) Logging: Make it either stable or private[spark]

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9307: - Assignee: Sean Owen > Logging: Make it either stable or private[spark] > -

[jira] [Updated] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13220: -- Description: We currently allow `--master yarn-client`. Instead, the user should do `--master yarn --de

[jira] [Updated] (SPARK-9307) Logging: Make it either stable or private[spark]

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9307: - Affects Version/s: 1.0.0 Target Version/s: 2.0.0 > Logging: Make it either stable or private[spark] >

[jira] [Updated] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13220: -- Description: We currently allow `\-\-master yarn-client`. Instead, the user should do `\-\-master yarn

[jira] [Assigned] (SPARK-13080) Implementation of the internal catalog API using Hive

2016-02-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-13080: - Assignee: Andrew Or > Implementation of the internal catalog API using Hive > --

[jira] [Updated] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-09 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-13241: Component/s: Web UI > add long--formatted timestamps to > org.apache.spark

[jira] [Updated] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-09 Thread Abhinav Chawade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Chawade updated SPARK-13219: Affects Version/s: 1.5.2 > Pushdown predicate propagation in SparkSQL with join > -

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-09 Thread Abhinav Chawade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139845#comment-15139845 ] Abhinav Chawade commented on SPARK-13219: - [~smilegator] I changed the patch base

[jira] [Assigned] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13250: Assignee: Apache Spark > Make vectorized parquet reader work as the build side of a broadc

[jira] [Assigned] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13250: Assignee: (was: Apache Spark) > Make vectorized parquet reader work as the build side

[jira] [Created] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

2016-02-09 Thread Nong Li (JIRA)
Nong Li created SPARK-13250: --- Summary: Make vectorized parquet reader work as the build side of a broadcast join Key: SPARK-13250 URL: https://issues.apache.org/jira/browse/SPARK-13250 Project: Spark

[jira] [Commented] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139815#comment-15139815 ] Apache Spark commented on SPARK-13250: -- User 'nongli' has created a pull request for

[jira] [Updated] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-02-09 Thread Joe Halliwell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Halliwell updated SPARK-13242: -- Description: Moderately complex `when` expressions produce generated code that busts the 64KB

[jira] [Commented] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139765#comment-15139765 ] Apache Spark commented on SPARK-12729: -- User 'GayathriMurali' has created a pull req

[jira] [Assigned] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12729: Assignee: (was: Apache Spark) > phantom references to replace the finalize call in pyt

  1   2   3   >