[jira] [Created] (SPARK-6672) createDataFrame from RDD[Row] with UDTs cannot be saved

Xiangrui Meng created SPARK-6672: Summary: createDataFrame from RDD[Row] with UDTs cannot be saved Key: SPARK-6672 URL: https://issues.apache.org/jira/browse/SPARK-6672 Project: Spark Issue

[jira] [Commented] (SPARK-6671) Add status command for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392236#comment-14392236 ] PRADEEP CHANUMOLU commented on SPARK-6671: -- created a pull request for the fix.

[jira] [Commented] (SPARK-6662) Allow variable substitution in spark.yarn.historyServer.address

[ https://issues.apache.org/jira/browse/SPARK-6662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392361#comment-14392361 ] Sean Owen commented on SPARK-6662: -- This is kind of a subset of

[jira] [Commented] (SPARK-5972) Cache residuals for GradientBoostedTrees during training

[ https://issues.apache.org/jira/browse/SPARK-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392455#comment-14392455 ] Apache Spark commented on SPARK-5972: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-5972) Cache residuals for GradientBoostedTrees during training

[ https://issues.apache.org/jira/browse/SPARK-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5972: --- Assignee: (was: Apache Spark) Cache residuals for GradientBoostedTrees during training

[jira] [Assigned] (SPARK-5972) Cache residuals for GradientBoostedTrees during training

[ https://issues.apache.org/jira/browse/SPARK-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5972: --- Assignee: Apache Spark Cache residuals for GradientBoostedTrees during training

[jira] [Assigned] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

[ https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6676: --- Assignee: Apache Spark Add hadoop 2.4+ for profiles in POM.xml

[jira] [Assigned] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

[ https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6676: --- Assignee: (was: Apache Spark) Add hadoop 2.4+ for profiles in POM.xml

[jira] [Commented] (SPARK-6671) Add status command for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392207#comment-14392207 ] PRADEEP CHANUMOLU commented on SPARK-6671: -- Its fairly simple fix and I can

[jira] [Created] (SPARK-6671) Add status command for spark daemons

PRADEEP CHANUMOLU created SPARK-6671: Summary: Add status command for spark daemons Key: SPARK-6671 URL: https://issues.apache.org/jira/browse/SPARK-6671 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-6627) Clean up of shuffle code and interfaces

[ https://issues.apache.org/jira/browse/SPARK-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6627. Resolution: Fixed Fix Version/s: 1.4.0 Clean up of shuffle code and interfaces

[jira] [Commented] (SPARK-6639) Create a new script to start multiple masters

[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392352#comment-14392352 ] Sean Owen commented on SPARK-6639: -- I can see the value; it also seems like a fair bit of

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392475#comment-14392475 ] Sudharma Puranik commented on SPARK-2243: - [~jahubba] : Running on the seperate

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392474#comment-14392474 ] Sudharma Puranik commented on SPARK-2243: - [~jahubba] : Running on the seperate

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392234#comment-14392234 ] Marius Soutier commented on SPARK-6613: --- It's combination of actorStreams and

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HAO REN updated SPARK-6675: --- Description: I find HiveContext.setConf does not work correctly. Here are some code snippets showing the

[jira] [Assigned] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6673: --- Assignee: (was: Apache Spark) spark-shell.cmd can't start even when spark was built in

[jira] [Assigned] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6673: --- Assignee: Apache Spark spark-shell.cmd can't start even when spark was built in Windows

[jira] [Commented] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

[ https://issues.apache.org/jira/browse/SPARK-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392246#comment-14392246 ] Apache Spark commented on SPARK-6673: - User 'tsudukim' has created a pull request for

[jira] [Assigned] (SPARK-5794) add jar should return 0

[ https://issues.apache.org/jira/browse/SPARK-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5794: --- Assignee: (was: Apache Spark) add jar should return 0 ---

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392366#comment-14392366 ] Yu Ishikawa commented on SPARK-5992: As I said when we talked in Spark Summit East, I

[jira] [Assigned] (SPARK-5794) add jar should return 0

[ https://issues.apache.org/jira/browse/SPARK-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5794: --- Assignee: Apache Spark add jar should return 0 ---

[jira] [Commented] (SPARK-6665) Randomly Shuffle an RDD

[ https://issues.apache.org/jira/browse/SPARK-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392382#comment-14392382 ] Sean Owen commented on SPARK-6665: -- If you are doing cross-validation, I think a direct

[jira] [Created] (SPARK-6675) HiveContext setConf seems not stable

HAO REN created SPARK-6675: -- Summary: HiveContext setConf seems not stable Key: SPARK-6675 URL: https://issues.apache.org/jira/browse/SPARK-6675 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

[ https://issues.apache.org/jira/browse/SPARK-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392466#comment-14392466 ] Apache Spark commented on SPARK-6676: - User 'liyezhang556520' has created a pull

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392214#comment-14392214 ] Apache Spark commented on SPARK-3862: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-3862) MultiWayBroadcastInnerHashJoin

[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3862: --- Assignee: (was: Apache Spark) MultiWayBroadcastInnerHashJoin

[jira] [Assigned] (SPARK-3862) MultiWayBroadcastInnerHashJoin

[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3862: --- Assignee: Apache Spark MultiWayBroadcastInnerHashJoin --

[jira] [Created] (SPARK-6673) spark-shell.cmd can't start even when spark was built in Windows

Masayoshi TSUZUKI created SPARK-6673: Summary: spark-shell.cmd can't start even when spark was built in Windows Key: SPARK-6673 URL: https://issues.apache.org/jira/browse/SPARK-6673 Project:

[jira] [Commented] (SPARK-6639) Create a new script to start multiple masters

[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392374#comment-14392374 ] Tao Wang commented on SPARK-6639: - I'd say this is a useful feature for Standalone

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HAO REN updated SPARK-6675: --- Description: I find HiveContext.setConf does not work correctly. Here are some code snippets showing the

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HAO REN updated SPARK-6675: --- Description: I find HiveContext.setConf does not work correctly. Here are some code snippets showing the

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HAO REN updated SPARK-6675: --- Description: I find HiveContext.setConf does not work correctly. Here are some code snippets showing the

[jira] [Commented] (SPARK-6664) Split Ordered RDD into multiple RDDs by keys (boundaries or intervals)

[ https://issues.apache.org/jira/browse/SPARK-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392376#comment-14392376 ] Sean Owen commented on SPARK-6664: -- This sounds like what {{MLUtils.kFold}} does, which

[jira] [Resolved] (SPARK-4361) SparkContext HadoopRDD is not clear about how to use a Hadoop Configuration

[ https://issues.apache.org/jira/browse/SPARK-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4361. - Resolution: Fixed Fix Version/s: 1.3.0 SparkContext HadoopRDD is not clear about how to

[jira] [Created] (SPARK-6676) Add hadoop 2.4+ for profiles in POM.xml

Zhang, Liye created SPARK-6676: -- Summary: Add hadoop 2.4+ for profiles in POM.xml Key: SPARK-6676 URL: https://issues.apache.org/jira/browse/SPARK-6676 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HAO REN updated SPARK-6675: --- Summary: HiveContext setConf is not stable (was: HiveContext setConf seems not stable) HiveContext setConf

[jira] [Assigned] (SPARK-4194) Exceptions thrown during SparkContext or SparkEnv construction might lead to resource leaks or corrupted global state

[ https://issues.apache.org/jira/browse/SPARK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4194: --- Assignee: (was: Apache Spark) Exceptions thrown during SparkContext or SparkEnv

[jira] [Updated] (SPARK-6685) Use DSYRK to compute AtA in ALS

[ https://issues.apache.org/jira/browse/SPARK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6685: - Description: Now we use DSPR to compute AtA in ALS, which is a Level 2 BLAS routine. We should

[jira] [Created] (SPARK-6685) Use DSYRK to compute AtA in ALS

Xiangrui Meng created SPARK-6685: Summary: Use DSYRK to compute AtA in ALS Key: SPARK-6685 URL: https://issues.apache.org/jira/browse/SPARK-6685 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6578) Outbound channel in network library is not thread-safe, can lead to fetch failures

[ https://issues.apache.org/jira/browse/SPARK-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6578: --- Target Version/s: 1.2.2, 1.3.1, 1.4.0 (was: 1.3.1, 1.4.0) Outbound channel in network library is

[jira] [Assigned] (SPARK-6671) Add status command for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6671: --- Assignee: (was: Apache Spark) Add status command for spark daemons

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6675: Target Version/s: 1.4.0 (was: 1.3.0) HiveContext setConf is not stable

[jira] [Updated] (SPARK-6675) HiveContext setConf is not stable

[ https://issues.apache.org/jira/browse/SPARK-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6675: Labels: (was: patch) HiveContext setConf is not stable

[jira] [Comment Edited] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393141#comment-14393141 ] Zhan Zhang edited comment on SPARK-2883 at 4/2/15 7:54 PM: ---

[jira] [Updated] (SPARK-6414) Spark driver failed with NPE on job cancelation

[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6414: -- Assignee: Hung Lin Spark driver failed with NPE on job cancelation

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Affects Version/s: 1.0.0 Could not submit app in standalone cluster mode when HA is enabled

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Description: == EDIT by Andrew == From a quick survey in the code I can confirm that

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Description: == EDIT by Andrew == From a quick survey in the code I can confirm that

[jira] [Comment Edited] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393590#comment-14393590 ] Zhan Zhang edited comment on SPARK-6479 at 4/2/15 10:24 PM:

[jira] [Comment Edited] (SPARK-2883) Spark Support for ORCFile format

[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393141#comment-14393141 ] Zhan Zhang edited comment on SPARK-2883 at 4/2/15 7:54 PM: ---

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster modehen HA is enabled

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Summary: Support HA in standalone cluster modehen HA is enabled (was: Could not submit app in standalone

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Priority: Major (was: Critical) Support HA in standalone cluster mode

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Summary: Support HA in standalone cluster mode (was: Support HA in standalone cluster modehen HA is

[jira] [Assigned] (SPARK-6669) Lock metastore client in analyzeTable

[ https://issues.apache.org/jira/browse/SPARK-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6669: --- Assignee: Apache Spark (was: Michael Armbrust) Lock metastore client in analyzeTable

[jira] [Updated] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-6479: -- Attachment: SPARK-6479OffheapAPIdesign.pdf Add failure case handling overall design and example.

[jira] [Commented] (SPARK-6669) Lock metastore client in analyzeTable

[ https://issues.apache.org/jira/browse/SPARK-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393582#comment-14393582 ] Apache Spark commented on SPARK-6669: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-6669) Lock metastore client in analyzeTable

[ https://issues.apache.org/jira/browse/SPARK-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6669: --- Assignee: Michael Armbrust (was: Apache Spark) Lock metastore client in analyzeTable

[jira] [Updated] (SPARK-6079) Use index to speed up StatusTracker.getJobIdsForGroup()

[ https://issues.apache.org/jira/browse/SPARK-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6079: -- Fix Version/s: 1.3.1 Use index to speed up StatusTracker.getJobIdsForGroup()

[jira] [Assigned] (SPARK-2669) Hadoop configuration is not localised when submitting job in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2669: --- Assignee: (was: Apache Spark) Hadoop configuration is not localised when submitting job

[jira] [Assigned] (SPARK-2669) Hadoop configuration is not localised when submitting job in yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2669: --- Assignee: Apache Spark Hadoop configuration is not localised when submitting job in

[jira] [Commented] (SPARK-6112) Provide OffHeap support through HDFS RAM_DISK

[ https://issues.apache.org/jira/browse/SPARK-6112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393287#comment-14393287 ] Zhan Zhang commented on SPARK-6112: --- Design spec for API attached to SPARK-6479 and wait

[jira] [Assigned] (SPARK-6671) Add status command for spark daemons

[ https://issues.apache.org/jira/browse/SPARK-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6671: --- Assignee: Apache Spark Add status command for spark daemons

[jira] [Resolved] (SPARK-6414) Spark driver failed with NPE on job cancelation

[ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6414. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 1.2.2 Fixed

[jira] [Updated] (SPARK-6578) Outbound channel in network library is not thread-safe, can lead to fetch failures

[ https://issues.apache.org/jira/browse/SPARK-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6578: --- Fix Version/s: 1.2.2 Outbound channel in network library is not thread-safe, can lead to fetch

[jira] [Updated] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-6479: -- Attachment: SPARK-6479.pdf This is the updated version for offheap store internal api design. Create

[jira] [Commented] (SPARK-6578) Outbound channel in network library is not thread-safe, can lead to fetch failures

[ https://issues.apache.org/jira/browse/SPARK-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393284#comment-14393284 ] Apache Spark commented on SPARK-6578: - User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393331#comment-14393331 ] Reynold Xin commented on SPARK-6479: Looks good overall. I have some comments but

[jira] [Updated] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

[ https://issues.apache.org/jira/browse/SPARK-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4346: - Affects Version/s: 1.0.0 YarnClientSchedulerBack.asyncMonitorApplication should be common with

[jira] [Updated] (SPARK-6443) Support HA in standalone cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6443: - Description: After digging some codes, I found user could not submit app in standalone cluster mode when

[jira] [Comment Edited] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393590#comment-14393590 ] Zhan Zhang edited comment on SPARK-6479 at 4/2/15 10:23 PM:

[jira] [Commented] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393590#comment-14393590 ] Zhan Zhang commented on SPARK-6479: --- [~rxin] Thanks for the feedback. I updated the

[jira] [Resolved] (SPARK-6618) HiveMetastoreCatalog.lookupRelation should use fine-grained lock

[ https://issues.apache.org/jira/browse/SPARK-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6618. - Resolution: Fixed HiveMetastoreCatalog.lookupRelation should use fine-grained lock

[jira] [Assigned] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4699: --- Assignee: (was: Apache Spark) Make caseSensitive configurable in Analyzer.scala

[jira] [Assigned] (SPARK-4699) Make caseSensitive configurable in Analyzer.scala

[ https://issues.apache.org/jira/browse/SPARK-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4699: --- Assignee: Apache Spark Make caseSensitive configurable in Analyzer.scala

[jira] [Assigned] (SPARK-5453) Use hive-site.xml to set class for adding custom filter for input files

[ https://issues.apache.org/jira/browse/SPARK-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5453: --- Assignee: Apache Spark Use hive-site.xml to set class for adding custom filter for input

[jira] [Assigned] (SPARK-5453) Use hive-site.xml to set class for adding custom filter for input files

[ https://issues.apache.org/jira/browse/SPARK-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5453: --- Assignee: (was: Apache Spark) Use hive-site.xml to set class for adding custom filter

[jira] [Assigned] (SPARK-5325) Simplifying Hive shim implementation

[ https://issues.apache.org/jira/browse/SPARK-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5325: --- Assignee: (was: Apache Spark) Simplifying Hive shim implementation

[jira] [Assigned] (SPARK-5325) Simplifying Hive shim implementation

[ https://issues.apache.org/jira/browse/SPARK-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5325: --- Assignee: Apache Spark Simplifying Hive shim implementation

[jira] [Assigned] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6356: --- Assignee: Apache Spark Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

[jira] [Updated] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

[ https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang, Liye updated SPARK-6689: --- Description: when running unit test *YarnClusterSuite* with *hadoop-2.2*, exception will throw

[jira] [Created] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

Zhang, Liye created SPARK-6689: -- Summary: MiniYarnCLuster still test failed with hadoop-2.2 Key: SPARK-6689 URL: https://issues.apache.org/jira/browse/SPARK-6689 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-5215) concat support in sqlcontext

[ https://issues.apache.org/jira/browse/SPARK-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5215: --- Assignee: Apache Spark concat support in sqlcontext

[jira] [Assigned] (SPARK-5215) concat support in sqlcontext

[ https://issues.apache.org/jira/browse/SPARK-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5215: --- Assignee: (was: Apache Spark) concat support in sqlcontext

[jira] [Assigned] (SPARK-6201) INSET should coerce types

[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6201: --- Assignee: Apache Spark INSET should coerce types -

[jira] [Assigned] (SPARK-6201) INSET should coerce types

[ https://issues.apache.org/jira/browse/SPARK-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6201: --- Assignee: (was: Apache Spark) INSET should coerce types -

[jira] [Assigned] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5068: --- Assignee: (was: Apache Spark) When the path not found in the hdfs,we can't get the

[jira] [Assigned] (SPARK-5068) When the path not found in the hdfs,we can't get the result

[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5068: --- Assignee: Apache Spark When the path not found in the hdfs,we can't get the result

[jira] [Assigned] (SPARK-5817) UDTF column names didn't set properly

[ https://issues.apache.org/jira/browse/SPARK-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5817: --- Assignee: (was: Apache Spark) UDTF column names didn't set properly

[jira] [Assigned] (SPARK-5817) UDTF column names didn't set properly

[ https://issues.apache.org/jira/browse/SPARK-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5817: --- Assignee: Apache Spark UDTF column names didn't set properly

[jira] [Resolved] (SPARK-6686) toDF column rename does not work when columns contain '.'

[ https://issues.apache.org/jira/browse/SPARK-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6686. - Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by

[jira] [Commented] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

[ https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394000#comment-14394000 ] Zhang, Liye commented on SPARK-6689: cc [~vanzin] [~srowen] MiniYarnCLuster still

[jira] [Updated] (SPARK-6640) Executor may connect to HeartbeartReceiver before it's setup in the driver side

[ https://issues.apache.org/jira/browse/SPARK-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6640: - Assignee: Shixiong Zhu Executor may connect to HeartbeartReceiver before it's setup in the driver side

[jira] [Commented] (SPARK-6479) Create off-heap block storage API (internal)

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14393618#comment-14393618 ] Reynold Xin commented on SPARK-6479: Sorry what I meant was in the API description for

[jira] [Resolved] (SPARK-6670) HiveContext.analyze should throw UnsupportedOperationException instead of NotImplementedError

[ https://issues.apache.org/jira/browse/SPARK-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6670. - Resolution: Fixed Fix Version/s: 1.4.0 1.3.1

[jira] [Assigned] (SPARK-6034) DESCRIBE EXTENDED viewname is not supported for HiveContext

[ https://issues.apache.org/jira/browse/SPARK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6034: --- Assignee: (was: Apache Spark) DESCRIBE EXTENDED viewname is not supported for

[jira] [Assigned] (SPARK-6034) DESCRIBE EXTENDED viewname is not supported for HiveContext

[ https://issues.apache.org/jira/browse/SPARK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6034: --- Assignee: Apache Spark DESCRIBE EXTENDED viewname is not supported for HiveContext

[jira] [Assigned] (SPARK-6130) support if not exists for insert overwrite into partition in hiveQl

[ https://issues.apache.org/jira/browse/SPARK-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6130: --- Assignee: (was: Apache Spark) support if not exists for insert overwrite into partition

[jira] [Assigned] (SPARK-6130) support if not exists for insert overwrite into partition in hiveQl

[ https://issues.apache.org/jira/browse/SPARK-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6130: --- Assignee: Apache Spark support if not exists for insert overwrite into partition in hiveQl

[jira] [Assigned] (SPARK-6006) Optimize count distinct in case of high cardinality columns

[ https://issues.apache.org/jira/browse/SPARK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6006: --- Assignee: Apache Spark Optimize count distinct in case of high cardinality columns

  1   2   3   >