[jira] [Commented] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957080#comment-14957080 ] Thomas Graves commented on SPARK-10873: --- Has anyone discussed just using something like jquery

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957144#comment-14957144 ] Sandy Ryza commented on SPARK-: --- Maybe you all have thought through this as well, but I had some

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957170#comment-14957170 ] Xiao Li commented on SPARK-10925: - Hi, Alexis, The schema of your query results has the duplicate

[jira] [Assigned] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2533: --- Assignee: (was: Apache Spark) > Show summary of locality level of completed tasks in the

[jira] [Assigned] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2533: --- Assignee: Apache Spark > Show summary of locality level of completed tasks in the each stage

[jira] [Commented] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957131#comment-14957131 ] Apache Spark commented on SPARK-2533: - User 'jbonofre' has created a pull request for this issue:

[jira] [Updated] (SPARK-11102) Unreadable exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Summary: Unreadable exception when specifing non-exist input for JSON data source (was: Not

[jira] [Updated] (SPARK-10876) display total application time in spark history UI

[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10876: -- Assignee: Jean-Baptiste Onofré > display total application time in spark history UI >

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957232#comment-14957232 ] Marcelo Vanzin commented on SPARK-11098: I'm not explicitly working on this a.t.m.. > RPC

[jira] [Updated] (SPARK-11108) OneHotEncoder should support other numeric input types

[ https://issues.apache.org/jira/browse/SPARK-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11108: -- Description: See parent JIRA for more info. Also see [SPARK-10513] for motivation

[jira] [Resolved] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11040. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 >

[jira] [Created] (SPARK-11108) OneHotEncoder should support other numeric input types

Joseph K. Bradley created SPARK-11108: - Summary: OneHotEncoder should support other numeric input types Key: SPARK-11108 URL: https://issues.apache.org/jira/browse/SPARK-11108 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-10943) NullType Column cannot be written to Parquet

[ https://issues.apache.org/jira/browse/SPARK-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason C Lee updated SPARK-10943: Comment: was deleted (was: I'd like to work on this. Thanx) > NullType Column cannot be written

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-11099: --- Affects Version/s: (was: 1.5.1) (Removing affected version. This code does not exist in

[jira] [Created] (SPARK-11105) Dsitribute the log4j.properties files from the client to the executors

Srinivasa Reddy Vundela created SPARK-11105: --- Summary: Dsitribute the log4j.properties files from the client to the executors Key: SPARK-11105 URL: https://issues.apache.org/jira/browse/SPARK-11105

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957301#comment-14957301 ] Zhan Zhang commented on SPARK-11087: I will take a look at this one. > spark.sql.orc.filterPushdown

[jira] [Assigned] (SPARK-11078) Ensure spilling tests are actually spilling

[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-11078: - Assignee: Andrew Or > Ensure spilling tests are actually spilling >

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957194#comment-14957194 ] Cheolsoo Park commented on SPARK-6910: -- You're right that 2nd query is faster because the

[jira] [Commented] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957230#comment-14957230 ] Marcelo Vanzin commented on SPARK-11097: Hi [~rxin], can you explain what would be the use case

[jira] [Updated] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srinivasa Reddy Vundela updated SPARK-11105: Summary: Disitribute the log4j.properties files from the client to the

[jira] [Resolved] (SPARK-10619) Can't sort columns on Executor Page

[ https://issues.apache.org/jira/browse/SPARK-10619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10619. - Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 > Can't sort columns on

[jira] [Created] (SPARK-11106) Should ML Models contains single models or Pipelines?

Joseph K. Bradley created SPARK-11106: - Summary: Should ML Models contains single models or Pipelines? Key: SPARK-11106 URL: https://issues.apache.org/jira/browse/SPARK-11106 Project: Spark

[jira] [Commented] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957375#comment-14957375 ] Marcelo Vanzin commented on SPARK-10873: What I mean is that while replacing the sorting library

[jira] [Commented] (SPARK-10513) Springleaf Marketing Response

[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957345#comment-14957345 ] Joseph K. Bradley commented on SPARK-10513: --- [~yanboliang] This is really helpful feedback.

[jira] [Created] (SPARK-11109) move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException

Steve Loughran created SPARK-11109: -- Summary: move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException Key: SPARK-11109 URL: https://issues.apache.org/jira/browse/SPARK-11109

[jira] [Commented] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957210#comment-14957210 ] Marcelo Vanzin commented on SPARK-10873: As part of trying to fix SPARK-10172 I played with

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Description: spark.driver.extraClassPath doesn't take effect in the latest code, and find the root

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956341#comment-14956341 ] Sandy Ryza commented on SPARK-: --- Thanks for the explanation [~rxin] and [~marmbrus]. I understand

[jira] [Created] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

Reynold Xin created SPARK-11096: --- Summary: Post-hoc review Netty based RPC implementation - round 2 Key: SPARK-11096 URL: https://issues.apache.org/jira/browse/SPARK-11096 Project: Spark Issue

[jira] [Commented] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956390#comment-14956390 ] Apache Spark commented on SPARK-11096: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11096: Assignee: Apache Spark (was: Reynold Xin) > Post-hoc review Netty based RPC

[jira] [Created] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

Reynold Xin created SPARK-11097: --- Summary: Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive Key: SPARK-11097 URL:

[jira] [Commented] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956394#comment-14956394 ] Reynold Xin commented on SPARK-11097: - cc [~vanzin] do you have time to do this? > Add connection

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956367#comment-14956367 ] Xiao Li edited comment on SPARK-10925 at 10/14/15 7:16 AM: --- Also hit the same

[jira] [Created] (SPARK-11099) Default conf property file is not loaded

Jeff Zhang created SPARK-11099: -- Summary: Default conf property file is not loaded Key: SPARK-11099 URL: https://issues.apache.org/jira/browse/SPARK-11099 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11098) RPC message ordering is not guaranteed

Reynold Xin created SPARK-11098: --- Summary: RPC message ordering is not guaranteed Key: SPARK-11098 URL: https://issues.apache.org/jira/browse/SPARK-11098 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-11098) RPC message ordering is not guaranteed

[ https://issues.apache.org/jira/browse/SPARK-11098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956396#comment-14956396 ] Reynold Xin commented on SPARK-11098: - [~vanzin] zsxwing told me you were working on this. Let me

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Component/s: Spark Submit > Default conf property file is not loaded >

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956367#comment-14956367 ] Xiao Li commented on SPARK-10925: - Also hit the same problem. Trying to narrow down the root cause of the

[jira] [Assigned] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11096: Assignee: Reynold Xin (was: Apache Spark) > Post-hoc review Netty based RPC

[jira] [Commented] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956399#comment-14956399 ] Jeff Zhang commented on SPARK-11099: Will create a pull request soon > Default conf property file is

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Component/s: Spark Shell > Default conf property file is not loaded >

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956453#comment-14956453 ] Weizhong commented on SPARK-11083: -- I have retest on latest master branch(end at commit

[jira] [Resolved] (SPARK-11101) pipe() operation OOM

[ https://issues.apache.org/jira/browse/SPARK-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11101. --- Resolution: Invalid If it's a question, you should ask as u...@spark.apache.org, not make a JIRA.

[jira] [Assigned] (SPARK-11100) HiveThriftServer not registering with Zookeeper

[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11100: Assignee: Apache Spark > HiveThriftServer not registering with Zookeeper >

[jira] [Assigned] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11099: Assignee: (was: Apache Spark) > Default conf property file is not loaded >

[jira] [Commented] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956470#comment-14956470 ] Apache Spark commented on SPARK-11099: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11099: Assignee: Apache Spark > Default conf property file is not loaded >

[jira] [Updated] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Issue Type: Improvement (was: Bug) > Not readable exception when specifing non-exist input for JSON

[jira] [Created] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

Jeff Zhang created SPARK-11102: -- Summary: Not readable exception when specifing non-exist input for JSON data source Key: SPARK-11102 URL: https://issues.apache.org/jira/browse/SPARK-11102 Project:

[jira] [Updated] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Priority: Minor (was: Major) > Not readable exception when specifing non-exist input for JSON data

[jira] [Commented] (SPARK-11102) Not readable exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956491#comment-14956491 ] Jeff Zhang commented on SPARK-11102: Will create a pull request soon > Not readable exception when

[jira] [Comment Edited] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956508#comment-14956508 ] qian, chen edited comment on SPARK-6910 at 10/14/15 9:03 AM: - I'm using

[jira] [Resolved] (SPARK-7099) Floating point literals cannot be specified using exponent

[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7099. -- Resolution: Not A Problem > Floating point literals cannot be specified using exponent >

[jira] [Updated] (SPARK-11101) pipe() operation OOM

[ https://issues.apache.org/jira/browse/SPARK-11101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hotdog updated SPARK-11101: --- Description: when using pipe() operation with large data(10TB), the pipe() operation always OOM. I use

[jira] [Assigned] (SPARK-11100) HiveThriftServer not registering with Zookeeper

[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11100: Assignee: (was: Apache Spark) > HiveThriftServer not registering with Zookeeper >

[jira] [Commented] (SPARK-11100) HiveThriftServer not registering with Zookeeper

[ https://issues.apache.org/jira/browse/SPARK-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956467#comment-14956467 ] Apache Spark commented on SPARK-11100: -- User 'xiaowangyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956508#comment-14956508 ] qian, chen commented on SPARK-6910: --- I'm using spark-sql (spark version 1.5.1 && hadoop 2.4.0) and found

[jira] [Updated] (SPARK-11099) Default conf property file is not loaded

[ https://issues.apache.org/jira/browse/SPARK-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11099: --- Affects Version/s: 1.5.1 > Default conf property file is not loaded >

[jira] [Resolved] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10845. - Resolution: Fixed I backported it. > SQL option "spark.sql.hive.version" doesn't show up in

[jira] [Updated] (SPARK-10845) SQL option "spark.sql.hive.version" doesn't show up in the result of "SET -v"

[ https://issues.apache.org/jira/browse/SPARK-10845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10845: Fix Version/s: 1.5.2 > SQL option "spark.sql.hive.version" doesn't show up in the result of "SET

[jira] [Updated] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11105: Target Version/s: (was: 1.5.1) > Disitribute the log4j.properties files from the client to the

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957641#comment-14957641 ] Joseph K. Bradley commented on SPARK-10973: --- Yes, thanks! > __gettitem__ method throws

[jira] [Created] (SPARK-11111) Fast null-safe join

Davies Liu created SPARK-1: -- Summary: Fast null-safe join Key: SPARK-1 URL: https://issues.apache.org/jira/browse/SPARK-1 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11110) Scala 2.11 build fails due to compiler errors

[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-0: Assignee: Jakob Odersky > Scala 2.11 build fails due to compiler errors >

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957546#comment-14957546 ] Reynold Xin commented on SPARK-6235: Is your data skewed? i.e. maybe there is a single key that's

[jira] [Updated] (SPARK-10577) [PySpark] DataFrame hint for broadcast join

[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10577: Fix Version/s: 1.5.2 > [PySpark] DataFrame hint for broadcast join >

[jira] [Commented] (SPARK-11110) Scala 2.11 build fails due to compiler errors

[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957721#comment-14957721 ] Jakob Odersky commented on SPARK-0: --- exactly what I got, I'll take a look at it > Scala 2.11

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957554#comment-14957554 ] Glenn Strycker commented on SPARK-6235: --- I don't think so, but I can check. My RDD came from an RDD

[jira] [Updated] (SPARK-10538) java.lang.NegativeArraySizeException during join

[ https://issues.apache.org/jira/browse/SPARK-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10538: Target Version/s: 1.6.0 (was: 1.5.2) > java.lang.NegativeArraySizeException during join >

[jira] [Commented] (SPARK-10577) [PySpark] DataFrame hint for broadcast join

[ https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957569#comment-14957569 ] Reynold Xin commented on SPARK-10577: - I also backported this into branch-1.5 so this can be included

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957587#comment-14957587 ] Reynold Xin commented on SPARK-10973: - [~josephkb] this should be closed now right? > __gettitem__

[jira] [Resolved] (SPARK-11096) Post-hoc review Netty based RPC implementation - round 2

[ https://issues.apache.org/jira/browse/SPARK-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11096. - Resolution: Fixed Fix Version/s: 1.6.0 > Post-hoc review Netty based RPC implementation -

[jira] [Commented] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957661#comment-14957661 ] Balaji Krish commented on SPARK-10528: -- Following steps solved my problem 1. Open Command Prompt in

[jira] [Assigned] (SPARK-11105) Disitribute the log4j.properties files from the client to the executors

[ https://issues.apache.org/jira/browse/SPARK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11105: Assignee: (was: Apache Spark) > Disitribute the log4j.properties files from the

[jira] [Resolved] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10973. - Resolution: Fixed Fix Version/s: 1.5.2 1.4.2 1.3.2

[jira] [Assigned] (SPARK-11111) Fast null-safe join

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Davies Liu (was: Apache Spark) > Fast null-safe join > --- > >

[jira] [Assigned] (SPARK-11111) Fast null-safe join

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Apache Spark (was: Davies Liu) > Fast null-safe join > --- > >

[jira] [Commented] (SPARK-11111) Fast null-safe join

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957669#comment-14957669 ] Apache Spark commented on SPARK-1: -- User 'davies' has created a pull request for this issue:

[jira] [Created] (SPARK-11112) DAG visualization: display RDD callsite

Andrew Or created SPARK-2: - Summary: DAG visualization: display RDD callsite Key: SPARK-2 URL: https://issues.apache.org/jira/browse/SPARK-2 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11112) DAG visualization: display RDD callsite

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7463 > DAG visualization: display RDD

[jira] [Updated] (SPARK-11110) Scala 2.11 build fails due to compiler errors

[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-0: Priority: Critical (was: Major) > Scala 2.11 build fails due to compiler errors >

[jira] [Resolved] (SPARK-8386) DataFrame and JDBC regression

[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8386. Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 1.6.0 1.5.2

[jira] [Created] (SPARK-11110) Scala 2.11 build fails due to compiler errors

Patrick Wendell created SPARK-0: --- Summary: Scala 2.11 build fails due to compiler errors Key: SPARK-0 URL: https://issues.apache.org/jira/browse/SPARK-0 Project: Spark Issue

[jira] [Commented] (SPARK-9999) RDD-like API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957926#comment-14957926 ] Michael Armbrust commented on SPARK-: - [~sandyr] did you look at the test cases [in

[jira] [Commented] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957935#comment-14957935 ] Apache Spark commented on SPARK-10534: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-11078) Ensure spilling tests are actually spilling

[ https://issues.apache.org/jira/browse/SPARK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957940#comment-14957940 ] Apache Spark commented on SPARK-11078: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957965#comment-14957965 ] Hyukjin Kwon commented on SPARK-11103: -- In this case, this should be fine because filter is not

[jira] [Assigned] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4: Assignee: Davies Liu (was: Apache Spark) > Add getOrCreate for SparkContext/SQLContext

[jira] [Created] (SPARK-11116) Initial API Draft

Michael Armbrust created SPARK-6: Summary: Initial API Draft Key: SPARK-6 URL: https://issues.apache.org/jira/browse/SPARK-6 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957731#comment-14957731 ] Alexis Seigneurin commented on SPARK-10925: --- Well, technically, it's not a duplicate column. An

[jira] [Updated] (SPARK-11113) Remove DeveloperApi annotation from private classes

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3: Description: For a variety of reasons, we tagged a bunch of internal classes in the execution

[jira] [Assigned] (SPARK-11113) Remove DeveloperApi annotation from private classes

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark (was: Reynold Xin) > Remove DeveloperApi annotation from private

[jira] [Assigned] (SPARK-11113) Remove DeveloperApi annotation from private classes

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Reynold Xin (was: Apache Spark) > Remove DeveloperApi annotation from private

[jira] [Commented] (SPARK-11113) Remove DeveloperApi annotation from private classes

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957776#comment-14957776 ] Apache Spark commented on SPARK-3: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-11113) Remove DeveloperApi annotation from private classes

Reynold Xin created SPARK-3: --- Summary: Remove DeveloperApi annotation from private classes Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue

[jira] [Assigned] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4: Assignee: Apache Spark (was: Davies Liu) > Add getOrCreate for SparkContext/SQLContext

[jira] [Created] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

Davies Liu created SPARK-4: -- Summary: Add getOrCreate for SparkContext/SQLContext for Python Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue

[jira] [Commented] (SPARK-11114) Add getOrCreate for SparkContext/SQLContext for Python

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957779#comment-14957779 ] Apache Spark commented on SPARK-4: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10534) ORDER BY clause allows only columns that are present in SELECT statement

[ https://issues.apache.org/jira/browse/SPARK-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10534: Assignee: Apache Spark > ORDER BY clause allows only columns that are present in SELECT

  1   2   >