[jira] [Closed] (SPARK-5000) Alias support string literal in spark sql

[ https://issues.apache.org/jira/browse/SPARK-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei closed SPARK-5000. -- Resolution: Fixed > Alias support string literal in spark sql > - > >

[jira] [Commented] (SPARK-5000) Alias support string literal in spark sql

[ https://issues.apache.org/jira/browse/SPARK-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270718#comment-14270718 ] wangfei commented on SPARK-5000: backticks can do this, so close this one. > Alias suppor

[jira] [Commented] (SPARK-2621) Update task InputMetrics incrementally

[ https://issues.apache.org/jira/browse/SPARK-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270714#comment-14270714 ] Rui Li commented on SPARK-2621: --- Hey [~sandyr], it seems after this change we require the in

[jira] [Comment Edited] (SPARK-5147) write ahead logs from streaming receiver are not purged because cleanupOldBlocks in WriteAheadLogBasedBlockHandler is never called

[ https://issues.apache.org/jira/browse/SPARK-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270574#comment-14270574 ] Saisai Shao edited comment on SPARK-5147 at 1/9/15 7:29 AM: Hi

[jira] [Commented] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270678#comment-14270678 ] Apache Spark commented on SPARK-4989: - User 'liyezhang556520' has created a pull reque

[jira] [Commented] (SPARK-5153) flaky test of "Reliable Kafka input stream with multiple topics"

[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270655#comment-14270655 ] Saisai Shao commented on SPARK-5153: Hi [~CodingCat], thanks a lot for your reporting,

[jira] [Commented] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270634#comment-14270634 ] Apache Spark commented on SPARK-4989: - User 'liyezhang556520' has created a pull reque

[jira] [Commented] (SPARK-5141) CaseInsensitiveMap throws "java.io.NotSerializableException"

[ https://issues.apache.org/jira/browse/SPARK-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270636#comment-14270636 ] Gankun Luo commented on SPARK-5141: --- Resolved > CaseInsensitiveMap throws "java.io.NotS

[jira] [Commented] (SPARK-5141) CaseInsensitiveMap throws "java.io.NotSerializableException"

[ https://issues.apache.org/jira/browse/SPARK-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270635#comment-14270635 ] Gankun Luo commented on SPARK-5141: --- Resolved > CaseInsensitiveMap throws "java.io.NotS

[jira] [Commented] (SPARK-4989) wrong application configuration cause cluster down in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270630#comment-14270630 ] Apache Spark commented on SPARK-4989: - User 'liyezhang556520' has created a pull reque

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270626#comment-14270626 ] Patrick Wendell commented on SPARK-5136: I've updated it to be in the new location

[jira] [Commented] (SPARK-5136) Improve documentation around setting up Spark IntelliJ project

[ https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270624#comment-14270624 ] Patrick Wendell commented on SPARK-5136: Hey Guys, I wrote that on the wiki quite

[jira] [Commented] (SPARK-1882) Support dynamic memory sharing in Mesos

[ https://issues.apache.org/jira/browse/SPARK-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270621#comment-14270621 ] Jongyoul Lee commented on SPARK-1882: - [~aash] First of all, It looks like that It's v

[jira] [Comment Edited] (SPARK-5152) Let metrics.properties file take an hdfs:// path

[ https://issues.apache.org/jira/browse/SPARK-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270616#comment-14270616 ] Patrick Wendell edited comment on SPARK-5152 at 1/9/15 6:19 AM:

[jira] [Commented] (SPARK-5152) Let metrics.properties file take an hdfs:// path

[ https://issues.apache.org/jira/browse/SPARK-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270616#comment-14270616 ] Patrick Wendell commented on SPARK-5152: Should we be loading the metrics properti

[jira] [Commented] (SPARK-1143) ClusterSchedulerSuite (soon to be TaskSchedulerImplSuite) does not actually test the ClusterScheduler/TaskSchedulerImpl

[ https://issues.apache.org/jira/browse/SPARK-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270612#comment-14270612 ] Apache Spark commented on SPARK-1143: - User 'kayousterhout' has created a pull request

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2620: --- Assignee: Tobias Schlatter > case class cannot be used as key for reduce > ---

[jira] [Commented] (SPARK-5168) Make SQLConf a field rather than mixin in SQLContext

[ https://issues.apache.org/jira/browse/SPARK-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270575#comment-14270575 ] Apache Spark commented on SPARK-5168: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-5168) Make SQLConf a field rather than mixin in SQLContext

Reynold Xin created SPARK-5168: -- Summary: Make SQLConf a field rather than mixin in SQLContext Key: SPARK-5168 URL: https://issues.apache.org/jira/browse/SPARK-5168 Project: Spark Issue Type: Su

[jira] [Commented] (SPARK-5147) write ahead logs from streaming receiver are not purged because cleanupOldBlocks in WriteAheadLogBasedBlockHandler is never called

[ https://issues.apache.org/jira/browse/SPARK-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270574#comment-14270574 ] Saisai Shao commented on SPARK-5147: Hi Max, I think this is a left problem for the c

[jira] [Commented] (SPARK-1882) Support dynamic memory sharing in Mesos

[ https://issues.apache.org/jira/browse/SPARK-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270559#comment-14270559 ] Andrew Ash commented on SPARK-1882: --- Yes -- in the simplest case where you have one mach

[jira] [Commented] (SPARK-1882) Support dynamic memory sharing in Mesos

[ https://issues.apache.org/jira/browse/SPARK-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270553#comment-14270553 ] Jongyoul Lee commented on SPARK-1882: - [~aash] I have a question. Do you think 'dynami

[jira] [Created] (SPARK-5167) Move Row into sql package and make it usable for Java

Reynold Xin created SPARK-5167: -- Summary: Move Row into sql package and make it usable for Java Key: SPARK-5167 URL: https://issues.apache.org/jira/browse/SPARK-5167 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-5097) Adding data frame APIs to SchemaRDD

[ https://issues.apache.org/jira/browse/SPARK-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5097: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-5166 > Adding data frame APIs to Schema

[jira] [Updated] (SPARK-5123) Stabilize Spark SQL data type API

[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5123: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-5166 > Stabilize Spark SQL data type API >

[jira] [Updated] (SPARK-5123) Stabilize Spark SQL data type API

[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5123: --- Description: Having two versions of the data type APIs (one for Java, one for Scala) requires downstr

[jira] [Issue Comment Deleted] (SPARK-5123) Stabilize Spark SQL data type API

[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5123: --- Comment: was deleted (was: User 'rxin' has created a pull request for this issue: https://github.com/a

[jira] [Updated] (SPARK-5166) Stabilize Spark SQL APIs

[ https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5166: --- Description: Before we take Spark SQL out of alpha, we need to audit the APIs and stabilize them. A

[jira] [Updated] (SPARK-5123) Stabilize Spark SQL data type API

[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5123: --- Summary: Stabilize Spark SQL data type API (was: Expose only one version of the data type APIs (i.e.

[jira] [Created] (SPARK-5166) Stabilize Spark SQL APIs

Reynold Xin created SPARK-5166: -- Summary: Stabilize Spark SQL APIs Key: SPARK-5166 URL: https://issues.apache.org/jira/browse/SPARK-5166 Project: Spark Issue Type: Task Components: SQL

[jira] [Commented] (SPARK-5162) Python yarn-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270543#comment-14270543 ] Harry Brundage commented on SPARK-5162: --- [~sandyr] are you familiar with why the Pyt

[jira] [Updated] (SPARK-5164) YARN | Spark job submits from windows machine to a linux YARN cluster fail

[ https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Bhatnagar updated SPARK-5164: Description: While submitting spark jobs from a windows machine to a linux YARN cluster, the

[jira] [Updated] (SPARK-5164) YARN | Spark job submits from windows machine to a linux YARN cluster fail

[ https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Bhatnagar updated SPARK-5164: Description: While submitting spark jobs from a windows machine to a linux YARN cluster, the

[jira] [Commented] (SPARK-5165) Add support for rollup and cube in sqlcontext

[ https://issues.apache.org/jira/browse/SPARK-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270542#comment-14270542 ] Apache Spark commented on SPARK-5165: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-5165) Add support for rollup and cube in sqlcontext

wangfei created SPARK-5165: -- Summary: Add support for rollup and cube in sqlcontext Key: SPARK-5165 URL: https://issues.apache.org/jira/browse/SPARK-5165 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-5164) YARN | Spark job submits from windows machine to a linux YARN cluster fail

[ https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270533#comment-14270533 ] Aniket Bhatnagar commented on SPARK-5164: - First issue can be fixed by using Envir

[jira] [Created] (SPARK-5164) YARN | Spark job submits from windows machine to a linux YARN cluster fail

Aniket Bhatnagar created SPARK-5164: --- Summary: YARN | Spark job submits from windows machine to a linux YARN cluster fail Key: SPARK-5164 URL: https://issues.apache.org/jira/browse/SPARK-5164 Projec

[jira] [Commented] (SPARK-5163) Load properties from configuration file for example spark-defaults.conf when creating SparkConf object

[ https://issues.apache.org/jira/browse/SPARK-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270491#comment-14270491 ] Apache Spark commented on SPARK-5163: - User 'YanTangZhai' has created a pull request f

[jira] [Comment Edited] (SPARK-4636) Cluster By & Distribute By output different with Hive

[ https://issues.apache.org/jira/browse/SPARK-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270466#comment-14270466 ] Cheng Hao edited comment on SPARK-4636 at 1/9/15 2:57 AM: -- The an

[jira] [Comment Edited] (SPARK-4636) Cluster By & Distribute By output different with Hive

[ https://issues.apache.org/jira/browse/SPARK-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270466#comment-14270466 ] Cheng Hao edited comment on SPARK-4636 at 1/9/15 2:56 AM: -- The an

[jira] [Resolved] (SPARK-4636) Cluster By & Distribute By output different with Hive

[ https://issues.apache.org/jira/browse/SPARK-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao resolved SPARK-4636. -- Resolution: Not a Problem The answer with highest score seems not correct, in might tested with the Hive

[jira] [Comment Edited] (SPARK-2387) Remove the stage barrier for better resource utilization

[ https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270444#comment-14270444 ] Lianhui Wang edited comment on SPARK-2387 at 1/9/15 2:44 AM: -

[jira] [Comment Edited] (SPARK-2387) Remove the stage barrier for better resource utilization

[ https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270444#comment-14270444 ] Lianhui Wang edited comment on SPARK-2387 at 1/9/15 2:44 AM: -

[jira] [Commented] (SPARK-2387) Remove the stage barrier for better resource utilization

[ https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270444#comment-14270444 ] Lianhui Wang commented on SPARK-2387: - [~xuefuz] [~sandyr] [~lirui] yes, i think first

[jira] [Created] (SPARK-5163) Load properties from configuration file for example spark-defaults.conf when creating SparkConf object

YanTang Zhai created SPARK-5163: --- Summary: Load properties from configuration file for example spark-defaults.conf when creating SparkConf object Key: SPARK-5163 URL: https://issues.apache.org/jira/browse/SPARK-5163

[jira] [Commented] (SPARK-2387) Remove the stage barrier for better resource utilization

[ https://issues.apache.org/jira/browse/SPARK-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270442#comment-14270442 ] Apache Spark commented on SPARK-2387: - User 'lianhuiwang' has created a pull request f

[jira] [Commented] (SPARK-4955) Executor does not get killed after configured interval.

[ https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270434#comment-14270434 ] Apache Spark commented on SPARK-4955: - User 'lianhuiwang' has created a pull request f

[jira] [Closed] (SPARK-5007) Try random port when startServiceOnPort to reduce the chance of port collision

[ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YanTang Zhai closed SPARK-5007. --- Resolution: Won't Fix > Try random port when startServiceOnPort to reduce the chance of port collision

[jira] [Commented] (SPARK-5007) Try random port when startServiceOnPort to reduce the chance of port collision

[ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270421#comment-14270421 ] YanTang Zhai commented on SPARK-5007: - [~rxin] Oh, I see. Thank you very much. > Try

[jira] [Commented] (SPARK-4865) Include temporary tables in SHOW TABLES

[ https://issues.apache.org/jira/browse/SPARK-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270394#comment-14270394 ] Bill Bejeck commented on SPARK-4865: Since I've worked on the related task SPARK-3299,

[jira] [Created] (SPARK-5162) Python yarn-cluster mode

Dana Klassen created SPARK-5162: --- Summary: Python yarn-cluster mode Key: SPARK-5162 URL: https://issues.apache.org/jira/browse/SPARK-5162 Project: Spark Issue Type: New Feature Compon

[jira] [Commented] (SPARK-4122) Add library to write data back to Kafka

[ https://issues.apache.org/jira/browse/SPARK-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270373#comment-14270373 ] Hari Shreedharan commented on SPARK-4122: - The current design doc talks only about

[jira] [Closed] (SPARK-5122) Remove Shark from spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5122. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Nicholas Chammas Target Version

[jira] [Updated] (SPARK-5122) Remove Shark from spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5122: - Affects Version/s: 1.0.0 > Remove Shark from spark-ec2 > --- > > K

[jira] [Commented] (SPARK-3299) [SQL] Public API in SQLContext to list tables

[ https://issues.apache.org/jira/browse/SPARK-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270346#comment-14270346 ] Apache Spark commented on SPARK-3299: - User 'bbejeck' has created a pull request for t

[jira] [Resolved] (SPARK-4048) Enhance and extend hadoop-provided profile

[ https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4048. Resolution: Fixed Fix Version/s: 1.3.0 > Enhance and extend hadoop-provided profile >

[jira] [Commented] (SPARK-3431) Parallelize Scala/Java test execution

[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270324#comment-14270324 ] Nicholas Chammas commented on SPARK-3431: - Generic update: * For those not followi

[jira] [Reopened] (SPARK-3490) Alleviate port collisions during tests

[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3490: -- > Alleviate port collisions during tests > -- > > Key: S

[jira] [Updated] (SPARK-3490) Alleviate port collisions during tests

[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3490: - Target Version/s: 1.2.0, 1.1.1, 0.9.3, 1.0.3 (was: 1.1.1, 1.2.0) > Alleviate port collisions during tests

[jira] [Commented] (SPARK-3490) Alleviate port collisions during tests

[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270320#comment-14270320 ] Andrew Or commented on SPARK-3490: -- Reopening this for branches 0.9 and 1.0 > Alleviate

[jira] [Created] (SPARK-5161) Parallelize Python test execution

Nicholas Chammas created SPARK-5161: --- Summary: Parallelize Python test execution Key: SPARK-5161 URL: https://issues.apache.org/jira/browse/SPARK-5161 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5119) java.lang.ArrayIndexOutOfBoundsException on trying to train decision tree model

[ https://issues.apache.org/jira/browse/SPARK-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270316#comment-14270316 ] Kai Sasaki commented on SPARK-5119: --- I think impurity implemented MLlib cannot keep nega

[jira] [Updated] (SPARK-3431) Parallelize Scala/Java test execution

[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3431: Summary: Parallelize Scala/Java test execution (was: Parallelize execution of tests) > Par

[jira] [Commented] (SPARK-3490) Alleviate port collisions during tests

[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270256#comment-14270256 ] Apache Spark commented on SPARK-3490: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-3490) Alleviate port collisions during tests

[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270254#comment-14270254 ] Apache Spark commented on SPARK-3490: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-4912) Persistent data source tables

[ https://issues.apache.org/jira/browse/SPARK-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270242#comment-14270242 ] Apache Spark commented on SPARK-4912: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-3490) Alleviate port collisions during tests

[ https://issues.apache.org/jira/browse/SPARK-3490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270224#comment-14270224 ] Apache Spark commented on SPARK-3490: - User 'andrewor14' has created a pull request fo

[jira] [Created] (SPARK-5160) Python module in jars

Davies Liu created SPARK-5160: - Summary: Python module in jars Key: SPARK-5160 URL: https://issues.apache.org/jira/browse/SPARK-5160 Project: Spark Issue Type: New Feature Components: P

[jira] [Closed] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2100. Resolution: Duplicate > Allow users to disable Jetty Spark UI in local mode > --

[jira] [Commented] (SPARK-5123) Expose only one version of the data type APIs (i.e. remove the Java-specific API)

[ https://issues.apache.org/jira/browse/SPARK-5123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270188#comment-14270188 ] Apache Spark commented on SPARK-5123: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-4891) Add exponential, log normal, and gamma distributions to data generator to PySpark's MLlib

[ https://issues.apache.org/jira/browse/SPARK-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4891. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3955 [https://githu

[jira] [Created] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

Andrew Ray created SPARK-5159: - Summary: Thrift server does not respect hive.server2.enable.doAs=true Key: SPARK-5159 URL: https://issues.apache.org/jira/browse/SPARK-5159 Project: Spark Issue T

[jira] [Commented] (SPARK-4983) Tag EC2 instances in the same call that launches them

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270147#comment-14270147 ] Nicholas Chammas commented on SPARK-4983: - Yeah, I took a quick look at the boto A

[jira] [Commented] (SPARK-5157) Configure more JVM options properly when we use ConcMarkSweepGC for AM.

[ https://issues.apache.org/jira/browse/SPARK-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270128#comment-14270128 ] Apache Spark commented on SPARK-5157: - User 'sarutak' has created a pull request for t

[jira] [Commented] (SPARK-5061) SQLContext: overload createParquetFile

[ https://issues.apache.org/jira/browse/SPARK-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270102#comment-14270102 ] Apache Spark commented on SPARK-5061: - User 'alexbaretta' has created a pull request f

[jira] [Commented] (SPARK-1630) PythonRDDs don't handle nulls gracefully

[ https://issues.apache.org/jira/browse/SPARK-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270097#comment-14270097 ] Davies Liu commented on SPARK-1630: --- We hit this issue with Kafka Python API, it will be

[jira] [Closed] (SPARK-4973) Local directory in the driver of client-mode continues remaining even if application finished when external shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4973. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Target Version/s: 1.3.0,

[jira] [Commented] (SPARK-4983) Tag EC2 instances in the same call that launches them

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270084#comment-14270084 ] Gen TANG commented on SPARK-4983: - By boto, we can only tag instance after it launched, to

[jira] [Commented] (SPARK-5154) Python API for Kafka streaming

[ https://issues.apache.org/jira/browse/SPARK-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270077#comment-14270077 ] Apache Spark commented on SPARK-5154: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5158: --- Description: There have been a handful of patches for allowing access to Kerberized HDFS clus

[jira] [Created] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

Patrick Wendell created SPARK-5158: -- Summary: Allow for keytab-based HDFS security in Standalone mode Key: SPARK-5158 URL: https://issues.apache.org/jira/browse/SPARK-5158 Project: Spark Iss

[jira] [Resolved] (SPARK-5148) Make usersOut/productsOut storagelevel in ALS configurable

[ https://issues.apache.org/jira/browse/SPARK-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5148. -- Resolution: Implemented Fix Version/s: 1.3.0 > Make usersOut/productsOut storagelevel in

[jira] [Updated] (SPARK-5148) Make usersOut/productsOut storagelevel in ALS configurable

[ https://issues.apache.org/jira/browse/SPARK-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5148: - Target Version/s: 1.3.0 > Make usersOut/productsOut storagelevel in ALS configurable > ---

[jira] [Updated] (SPARK-5148) Make usersOut/productsOut storagelevel in ALS configurable

[ https://issues.apache.org/jira/browse/SPARK-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5148: - Assignee: Fernando Ruben Otero > Make usersOut/productsOut storagelevel in ALS configurable >

[jira] [Updated] (SPARK-5149) Type mismatch when defining classes in Spark REPL

[ https://issues.apache.org/jira/browse/SPARK-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Schlatter updated SPARK-5149: Component/s: Spark Shell > Type mismatch when defining classes in Spark REPL > -

[jira] [Updated] (SPARK-5150) Strange implicit resolution behavior in Spark REPL

[ https://issues.apache.org/jira/browse/SPARK-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Schlatter updated SPARK-5150: Component/s: Spark Shell > Strange implicit resolution behavior in Spark REPL >

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Schlatter updated SPARK-2620: Component/s: (was: Spark Core) Spark Shell > case class cannot be used

[jira] [Updated] (SPARK-2632) Importing a method of class in Spark REPL causes the REPL to pulls in unnecessary stuff.

[ https://issues.apache.org/jira/browse/SPARK-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobias Schlatter updated SPARK-2632: Component/s: Spark Shell > Importing a method of class in Spark REPL causes the REPL to pull

[jira] [Created] (SPARK-5157) Configure more JVM options properly when we use ConcMarkSweepGC for AM.

Kousuke Saruta created SPARK-5157: - Summary: Configure more JVM options properly when we use ConcMarkSweepGC for AM. Key: SPARK-5157 URL: https://issues.apache.org/jira/browse/SPARK-5157 Project: Spar

[jira] [Updated] (SPARK-5156) Priority queue for cross application scheduling

[ https://issues.apache.org/jira/browse/SPARK-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Wilder updated SPARK-5156: -- Description: FIFO is useful, but for many use cases, something more fine-grained would be excel

[jira] [Created] (SPARK-5156) Priority queue for cross application scheduling

Timothy Wilder created SPARK-5156: - Summary: Priority queue for cross application scheduling Key: SPARK-5156 URL: https://issues.apache.org/jira/browse/SPARK-5156 Project: Spark Issue Type: W

[jira] [Created] (SPARK-5155) Python API for MQTT streaming

Davies Liu created SPARK-5155: - Summary: Python API for MQTT streaming Key: SPARK-5155 URL: https://issues.apache.org/jira/browse/SPARK-5155 Project: Spark Issue Type: New Feature Compo

[jira] [Created] (SPARK-5154) Python API for Kafka streaming

Davies Liu created SPARK-5154: - Summary: Python API for Kafka streaming Key: SPARK-5154 URL: https://issues.apache.org/jira/browse/SPARK-5154 Project: Spark Issue Type: New Feature Comp

[jira] [Updated] (SPARK-5006) spark.port.maxRetries doesn't work

[ https://issues.apache.org/jira/browse/SPARK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5006: - Affects Version/s: 1.1.0 > spark.port.maxRetries doesn't work > -- > >

[jira] [Created] (SPARK-5153) flaky test of "Reliable Kafka input stream with multiple topics"

Nan Zhu created SPARK-5153: -- Summary: flaky test of "Reliable Kafka input stream with multiple topics" Key: SPARK-5153 URL: https://issues.apache.org/jira/browse/SPARK-5153 Project: Spark Issue Typ

[jira] [Updated] (SPARK-5153) flaky test of "Reliable Kafka input stream with multiple topics"

[ https://issues.apache.org/jira/browse/SPARK-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-5153: --- Component/s: Streaming > flaky test of "Reliable Kafka input stream with multiple topics" > --

[jira] [Updated] (SPARK-1825) Windows Spark fails to work with Linux YARN

[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1825: - Assignee: Masayoshi TSUZUKI > Windows Spark fails to work with Linux YARN > --

[jira] [Closed] (SPARK-5130) yarn-cluster mode should not be considered as client mode in spark-submit

[ https://issues.apache.org/jira/browse/SPARK-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5130. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Assignee: WangTao

[jira] [Updated] (SPARK-5130) yarn-cluster mode should not be considered as client mode in spark-submit

[ https://issues.apache.org/jira/browse/SPARK-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-5130: - Affects Version/s: 1.2.0 > yarn-cluster mode should not be considered as client mode in spark-submit > ---

[jira] [Comment Edited] (SPARK-1405) parallel Latent Dirichlet Allocation (LDA) atop of spark in MLlib

[ https://issues.apache.org/jira/browse/SPARK-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269933#comment-14269933 ] Joseph K. Bradley edited comment on SPARK-1405 at 1/8/15 7:39 PM: --

  1   2   >