[jira] [Closed] (SPARK-9872) Allow passing of 'numPartitions' to DataFrame joins

[ https://issues.apache.org/jira/browse/SPARK-9872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-9872. --- Resolution: Won't Fix > Allow passing of 'numPartitions' to DataFrame joins >

[jira] [Commented] (SPARK-9872) Allow passing of 'numPartitions' to DataFrame joins

[ https://issues.apache.org/jira/browse/SPARK-9872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906443#comment-15906443 ] Takeshi Yamamuro commented on SPARK-9872: - I think SPARK-4630 could handle the cas

[jira] [Commented] (SPARK-8577) ScalaReflectionLock.synchronized can cause deadlock

[ https://issues.apache.org/jira/browse/SPARK-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906442#comment-15906442 ] Takeshi Yamamuro commented on SPARK-8577: - Could we close this because we couldn't

[jira] [Closed] (SPARK-7629) Unroll AggregateFunction "update" in the case of a single input expression

[ https://issues.apache.org/jira/browse/SPARK-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-7629. --- Resolution: Won't Fix > Unroll AggregateFunction "update" in the case of a single input expres

[jira] [Commented] (SPARK-7629) Unroll AggregateFunction "update" in the case of a single input expression

[ https://issues.apache.org/jira/browse/SPARK-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906440#comment-15906440 ] Takeshi Yamamuro commented on SPARK-7629: - Since this ticket is inactive and aggre

[jira] [Commented] (SPARK-7239) Statistic functions for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906437#comment-15906437 ] Takeshi Yamamuro commented on SPARK-7239: - Could we close SPARK-7245 and this Umbr

[jira] [Closed] (SPARK-6921) Spark SQL API "saveAsParquetFile" will output tachyon file with different block size

[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-6921. --- Resolution: Won't Fix > Spark SQL API "saveAsParquetFile" will output tachyon file with differ

[jira] [Commented] (SPARK-6921) Spark SQL API "saveAsParquetFile" will output tachyon file with different block size

[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906436#comment-15906436 ] Takeshi Yamamuro commented on SPARK-6921: - Since Spark already has not supported t

[jira] [Assigned] (SPARK-19923) Remove unnecessary type conversion per call in Hive

[ https://issues.apache.org/jira/browse/SPARK-19923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19923: Assignee: (was: Apache Spark) > Remove unnecessary type conversion per call in Hive >

[jira] [Assigned] (SPARK-19923) Remove unnecessary type conversion per call in Hive

[ https://issues.apache.org/jira/browse/SPARK-19923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19923: Assignee: Apache Spark > Remove unnecessary type conversion per call in Hive > ---

[jira] [Commented] (SPARK-19923) Remove unnecessary type conversion per call in Hive

[ https://issues.apache.org/jira/browse/SPARK-19923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906435#comment-15906435 ] Apache Spark commented on SPARK-19923: -- User 'maropu' has created a pull request for

[jira] [Updated] (SPARK-19923) Remove unnecessary type conversion per call in Hive

[ https://issues.apache.org/jira/browse/SPARK-19923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-19923: - Description: IIUC I found unnecessary type conversions in HiveGenericUDF: https://github.

[jira] [Created] (SPARK-19923) Remove unnecessary type conversion per call in Hive

Takeshi Yamamuro created SPARK-19923: Summary: Remove unnecessary type conversion per call in Hive Key: SPARK-19923 URL: https://issues.apache.org/jira/browse/SPARK-19923 Project: Spark I

[jira] [Assigned] (SPARK-19922) faster Word2Vec findSynonyms

[ https://issues.apache.org/jira/browse/SPARK-19922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19922: Assignee: Apache Spark > faster Word2Vec findSynonyms > > >

[jira] [Assigned] (SPARK-19922) faster Word2Vec findSynonyms

[ https://issues.apache.org/jira/browse/SPARK-19922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19922: Assignee: (was: Apache Spark) > faster Word2Vec findSynonyms > ---

[jira] [Commented] (SPARK-19922) faster Word2Vec findSynonyms

[ https://issues.apache.org/jira/browse/SPARK-19922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906403#comment-15906403 ] Apache Spark commented on SPARK-19922: -- User 'Krimit' has created a pull request for

[jira] [Created] (SPARK-19922) faster Word2Vec findSynonyms

Asher Krim created SPARK-19922: -- Summary: faster Word2Vec findSynonyms Key: SPARK-19922 URL: https://issues.apache.org/jira/browse/SPARK-19922 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-19920) How to capture reasons (log/trace/info/anything?) for "[ERROR]Driver 172.31.25.77:45151 disassociated! Shutting down."

[ https://issues.apache.org/jira/browse/SPARK-19920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906336#comment-15906336 ] Sridhar Rana commented on SPARK-19920: -- [~sro...@gmail.comm]How to send it to u...@s

[jira] [Resolved] (SPARK-19920) How to capture reasons (log/trace/info/anything?) for "[ERROR]Driver 172.31.25.77:45151 disassociated! Shutting down."

[ https://issues.apache.org/jira/browse/SPARK-19920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19920. --- Resolution: Invalid Questions should go to u...@spark.apache.org > How to capture reasons (log/trace

[jira] [Commented] (SPARK-17262) Spark SizeEstimator does not ignore transient fields in java classes when calculates class size

[ https://issues.apache.org/jira/browse/SPARK-17262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906312#comment-15906312 ] Apache Spark commented on SPARK-17262: -- User 'elviento' has created a pull request f

[jira] [Commented] (SPARK-17261) Using HiveContext after re-creating SparkContext in Spark 2.0 throws "Java.lang.illegalStateException: Cannot call methods on a stopped sparkContext"

[ https://issues.apache.org/jira/browse/SPARK-17261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906309#comment-15906309 ] Apache Spark commented on SPARK-17261: -- User 'elviento' has created a pull request f

[jira] [Commented] (SPARK-17261) Using HiveContext after re-creating SparkContext in Spark 2.0 throws "Java.lang.illegalStateException: Cannot call methods on a stopped sparkContext"

[ https://issues.apache.org/jira/browse/SPARK-17261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906305#comment-15906305 ] Apache Spark commented on SPARK-17261: -- User 'elviento' has created a pull request f

[jira] [Assigned] (SPARK-19921) Enable end-to-end testing using different Hive metastore versions.

[ https://issues.apache.org/jira/browse/SPARK-19921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19921: Assignee: Apache Spark (was: Xiao Li) > Enable end-to-end testing using different Hive me

[jira] [Assigned] (SPARK-19921) Enable end-to-end testing using different Hive metastore versions.

[ https://issues.apache.org/jira/browse/SPARK-19921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19921: Assignee: Xiao Li (was: Apache Spark) > Enable end-to-end testing using different Hive me

[jira] [Commented] (SPARK-19921) Enable end-to-end testing using different Hive metastore versions.

[ https://issues.apache.org/jira/browse/SPARK-19921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906296#comment-15906296 ] Apache Spark commented on SPARK-19921: -- User 'gatorsmile' has created a pull request

[jira] [Created] (SPARK-19921) Enable end-to-end testing using different Hive metastore versions.

Xiao Li created SPARK-19921: --- Summary: Enable end-to-end testing using different Hive metastore versions. Key: SPARK-19921 URL: https://issues.apache.org/jira/browse/SPARK-19921 Project: Spark Is

[jira] [Commented] (SPARK-16394) Timestamp conversion error in pyspark.sql.Row because of timezones

[ https://issues.apache.org/jira/browse/SPARK-16394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906266#comment-15906266 ] Keith Bourgoin commented on SPARK-16394: We've been having the same issue. To ill

[jira] [Created] (SPARK-19920) How to capture reasons (log/trace/info/anything?) for "[ERROR]Driver 172.31.25.77:45151 disassociated! Shutting down."

Sridhar Rana created SPARK-19920: Summary: How to capture reasons (log/trace/info/anything?) for "[ERROR]Driver 172.31.25.77:45151 disassociated! Shutting down." Key: SPARK-19920 URL: https://issues.apache.org/jir

[jira] [Commented] (SPARK-19742) When using SparkSession to write a dataset to Hive the schema is ignored

[ https://issues.apache.org/jira/browse/SPARK-19742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906213#comment-15906213 ] Navin Goel commented on SPARK-19742: Work around code in Java for anyone else ho is i

[jira] [Assigned] (SPARK-19807) Add reason for cancellation when a stage is killed using web UI

[ https://issues.apache.org/jira/browse/SPARK-19807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19807: Assignee: Apache Spark > Add reason for cancellation when a stage is killed using web UI >

[jira] [Assigned] (SPARK-19807) Add reason for cancellation when a stage is killed using web UI

[ https://issues.apache.org/jira/browse/SPARK-19807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19807: Assignee: (was: Apache Spark) > Add reason for cancellation when a stage is killed usi

[jira] [Commented] (SPARK-19807) Add reason for cancellation when a stage is killed using web UI

[ https://issues.apache.org/jira/browse/SPARK-19807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906185#comment-15906185 ] Apache Spark commented on SPARK-19807: -- User 'shaolinliu' has created a pull request

[jira] [Commented] (SPARK-12134) Spark Streaming Kinesis: Allow a mechanism to bypass validateRegion

[ https://issues.apache.org/jira/browse/SPARK-12134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906165#comment-15906165 ] Takeshi Yamamuro commented on SPARK-12134: -- I think only a few people are intere

[jira] [Closed] (SPARK-12134) Spark Streaming Kinesis: Allow a mechanism to bypass validateRegion

[ https://issues.apache.org/jira/browse/SPARK-12134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-12134. Resolution: Won't Fix > Spark Streaming Kinesis: Allow a mechanism to bypass validateRegion

[jira] [Resolved] (SPARK-7661) Support for dynamic allocation of resources in Kinesis Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-7661. - Resolution: Fixed Fix Version/s: 2.0.0 > Support for dynamic allocation of resource

[jira] [Commented] (SPARK-7661) Support for dynamic allocation of resources in Kinesis Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906164#comment-15906164 ] Takeshi Yamamuro commented on SPARK-7661: - I think most of parts have been resolve

[jira] [Comment Edited] (SPARK-14503) spark.ml Scala API for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-14503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906122#comment-15906122 ] yuhao yang edited comment on SPARK-14503 at 3/11/17 7:59 AM: -