[jira] [Resolved] (SPARK-13105) Spark 1.6 and earlier should reject NATURAL JOIN queries instead of returning wrong answers

[ https://issues.apache.org/jira/browse/SPARK-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13105. Resolution: Not A Problem I'm going to resolve this as "not a problem" per discussion on my per

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125491#comment-15125491 ] Placek commented on SPARK-9141: --- Can it be that this problem still persists in spark 1.6? I have a program

[jira] [Comment Edited] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125491#comment-15125491 ] Placek edited comment on SPARK-9141 at 1/31/16 8:43 PM: Can it be that this

[jira] [Updated] (SPARK-13106) KafkaUtils.createDirectStream method with messageHandler and topics

[ https://issues.apache.org/jira/browse/SPARK-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Alves updated SPARK-13106: --- Issue Type: Improvement (was: Bug) > KafkaUtils.createDirectStream method with messageHandler and

[jira] [Comment Edited] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125517#comment-15125517 ] Placek edited comment on SPARK-9141 at 1/31/16 10:46 PM: - It grows linearly. I got

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125498#comment-15125498 ] Justin Uang commented on SPARK-9141: Does your explain() string grow exponentially w.r.t. to the

[jira] [Resolved] (SPARK-13049) Cannot use FIRST/LAST ignoreNulls option in 1.6 and below

[ https://issues.apache.org/jira/browse/SPARK-13049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13049. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Cannot use

[jira] [Comment Edited] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125491#comment-15125491 ] Placek edited comment on SPARK-9141 at 1/31/16 8:47 PM: Can it be that this

[jira] [Commented] (SPARK-13039) Spark Streaming with Mesos shutdown without any reason on logs

[ https://issues.apache.org/jira/browse/SPARK-13039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125516#comment-15125516 ] Luis Alves commented on SPARK-13039: I'll do it next time it fails. > Spark Streaming with Mesos

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125517#comment-15125517 ] Placek commented on SPARK-9141: --- It grows linearly. I got the errors when the string wasn't printed out. I

[jira] [Created] (SPARK-13106) KafkaUtils.createDirectStream method with messageHandler and topics

Luis Alves created SPARK-13106: -- Summary: KafkaUtils.createDirectStream method with messageHandler and topics Key: SPARK-13106 URL: https://issues.apache.org/jira/browse/SPARK-13106 Project: Spark

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125564#comment-15125564 ] Marcelo Vanzin commented on SPARK-11157: bq. Prior to removing the assemblies, it would be great

[jira] [Comment Edited] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125491#comment-15125491 ] Placek edited comment on SPARK-9141 at 1/31/16 10:44 PM: - Can it be that this

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125559#comment-15125559 ] Hitoshi Ozawa commented on SPARK-11416: --- Will try to get something going. > Upgrade kryo package

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125566#comment-15125566 ] Marcelo Vanzin commented on SPARK-7481: --- It doesn't necessarily affect this proposal. It would make

[jira] [Commented] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125587#comment-15125587 ] Cheng Lian commented on SPARK-12725: There are other analysis rules that may use generated attributes

[jira] [Assigned] (SPARK-341) Added MapPartitionsWithSplitRDD.

[ https://issues.apache.org/jira/browse/SPARK-341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-341: - Assignee: Reynold Xin > Added MapPartitionsWithSplitRDD. > > >

[jira] [Commented] (SPARK-13065) streaming-twitter pass twitter4j.FilterQuery argument to TwitterUtils.createStream()

[ https://issues.apache.org/jira/browse/SPARK-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125834#comment-15125834 ] sachin aggarwal commented on SPARK-13065: - I would like to work on this , will issue a pull

[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125802#comment-15125802 ] Hyukjin Kwon commented on SPARK-13108: -- I will work on this but here are several things to say. Now

[jira] [Updated] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

[ https://issues.apache.org/jira/browse/SPARK-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13093: Assignee: Wenchen Fan > improve null check in nullSafeCodeGen for unary, binary and ternary

[jira] [Commented] (SPARK-13106) KafkaUtils.createDirectStream method with messageHandler and topics

[ https://issues.apache.org/jira/browse/SPARK-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125904#comment-15125904 ] Luis Alves commented on SPARK-13106: Yes, but it requires me to pass the fromOffsets instead of a set

[jira] [Resolved] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

[ https://issues.apache.org/jira/browse/SPARK-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13093. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10987

[jira] [Commented] (SPARK-12917) Add DML support to Spark SQL for HIVE

[ https://issues.apache.org/jira/browse/SPARK-12917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125606#comment-15125606 ] Zhou Weimin commented on SPARK-12917: - It seems like a transaction table feature. > Add DML support

[jira] [Commented] (SPARK-13104) Spark Metrics currently does not return executors hostname

[ https://issues.apache.org/jira/browse/SPARK-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125790#comment-15125790 ] Karthik commented on SPARK-13104: - I am using version Spark 1.6 and the Coda Hale Metrics. > Spark

[jira] [Commented] (SPARK-6319) Should throw analysis exception when using binary type in groupby/join

[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125710#comment-15125710 ] Low Chin Wei commented on SPARK-6319: - Hi guys, Any resolution for group by binary column using

[jira] [Commented] (SPARK-13104) Spark Metrics currently does not return executors hostname

[ https://issues.apache.org/jira/browse/SPARK-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125655#comment-15125655 ] Saisai Shao commented on SPARK-13104: - I think it should be Codahale metrics. > Spark Metrics

[jira] [Commented] (SPARK-11111) Fast null-safe join

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125659#comment-15125659 ] Ruslan Dautkhanov commented on SPARK-1: --- Does this affect all OUTER JOINS? I have poor

[jira] [Updated] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12725: --- Description: Some analysis rules generate auxiliary attribute references with the same name but

[jira] [Created] (SPARK-13107) [Spark SQL]'hiveconf' parameters in Beeline command can't be got after enter Beeline session

William Zhou created SPARK-13107: Summary: [Spark SQL]'hiveconf' parameters in Beeline command can't be got after enter Beeline session Key: SPARK-13107 URL: https://issues.apache.org/jira/browse/SPARK-13107

[jira] [Commented] (SPARK-13106) KafkaUtils.createDirectStream method with messageHandler and topics

[ https://issues.apache.org/jira/browse/SPARK-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125598#comment-15125598 ] Saisai Shao commented on SPARK-13106: - IIUC, creating direct stream also supports passing

[jira] [Updated] (SPARK-13107) [Spark SQL]'hiveconf' parameters in Beeline command can't be got after enter Beeline session

[ https://issues.apache.org/jira/browse/SPARK-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zhou updated SPARK-13107: - Labels: beeline (was: ) > [Spark SQL]'hiveconf' parameters in Beeline command can't be got

[jira] [Commented] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125754#comment-15125754 ] Xiao Li commented on SPARK-12725: - You are right. : ) > SQL generation suffers from name conficts

[jira] [Comment Edited] (SPARK-13104) Spark Metrics currently does not return executors hostname

[ https://issues.apache.org/jira/browse/SPARK-13104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125790#comment-15125790 ] Karthik edited comment on SPARK-13104 at 2/1/16 5:41 AM: - I am using Spark 1.6

[jira] [Updated] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13108: - Description: This library uses Hadoop's

[jira] [Created] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

Hyukjin Kwon created SPARK-13108: Summary: Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.) Key: SPARK-13108 URL: https://issues.apache.org/jira/browse/SPARK-13108 Project:

[jira] [Commented] (SPARK-13035) PySpark ml.clustering support export/import

[ https://issues.apache.org/jira/browse/SPARK-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125268#comment-15125268 ] Apache Spark commented on SPARK-13035: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13035) PySpark ml.clustering support export/import

[ https://issues.apache.org/jira/browse/SPARK-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13035: Assignee: Apache Spark > PySpark ml.clustering support export/import >

[jira] [Assigned] (SPARK-13035) PySpark ml.clustering support export/import

[ https://issues.apache.org/jira/browse/SPARK-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13035: Assignee: (was: Apache Spark) > PySpark ml.clustering support export/import >

[jira] [Commented] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125252#comment-15125252 ] Xiao Li commented on SPARK-12725: - Recently, I am working on a PR related to ResolveAggregateFunctions.

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125349#comment-15125349 ] Sean Owen commented on SPARK-6305: -- Yeah I'll take up this and more next week when I'm back. Will follow