[jira] [Updated] (SPARK-5202) HiveContext doesn't support the Variables Substitution

2015-01-11 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-5202: - Description: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+VariableSubstitution This is

[jira] [Commented] (SPARK-5202) HiveContext doesn't support the Variables Substitution

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273293#comment-14273293 ] Apache Spark commented on SPARK-5202: - User 'chenghao-intel' has created a pull reques

[jira] [Commented] (SPARK-5201) ParallelCollectionRDD.slice(seq, numSlices) has int overflow when dealing with inclusive range

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273289#comment-14273289 ] Apache Spark commented on SPARK-5201: - User 'advancedxy' has created a pull request fo

[jira] [Created] (SPARK-5202) HiveContext doesn't support the Variables Substitution

2015-01-11 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-5202: Summary: HiveContext doesn't support the Variables Substitution Key: SPARK-5202 URL: https://issues.apache.org/jira/browse/SPARK-5202 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5201) ParallelCollectionRDD.slice(seq, numSlices) has int overflow when dealing with inclusive range

2015-01-11 Thread Ye Xianjin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273277#comment-14273277 ] Ye Xianjin commented on SPARK-5201: --- I will send a pr for this. > ParallelCollectionRDD

[jira] [Created] (SPARK-5201) ParallelCollectionRDD.slice(seq, numSlices) has int overflow when dealing with inclusive range

2015-01-11 Thread Ye Xianjin (JIRA)
Ye Xianjin created SPARK-5201: - Summary: ParallelCollectionRDD.slice(seq, numSlices) has int overflow when dealing with inclusive range Key: SPARK-5201 URL: https://issues.apache.org/jira/browse/SPARK-5201

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273271#comment-14273271 ] Apache Spark commented on SPARK-4908: - User 'baishuo' has created a pull request for t

[jira] [Commented] (SPARK-5196) Add comment field in StructField

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273251#comment-14273251 ] Apache Spark commented on SPARK-5196: - User 'OopsOutOfMemory' has created a pull reque

[jira] [Commented] (SPARK-5200) Disable web UI in Hive Thriftserver tests

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273247#comment-14273247 ] Apache Spark commented on SPARK-5200: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-5124) Standardize internal RPC interface

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273246#comment-14273246 ] Reynold Xin commented on SPARK-5124: Thanks for the response. 1. Let's not rely on th

[jira] [Created] (SPARK-5200) Disable web UI in Hive Thriftserver tests

2015-01-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5200: - Summary: Disable web UI in Hive Thriftserver tests Key: SPARK-5200 URL: https://issues.apache.org/jira/browse/SPARK-5200 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5095) Support launching multiple mesos executors in coarse grained mesos mode

2015-01-11 Thread Timothy Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273244#comment-14273244 ] Timothy Chen commented on SPARK-5095: - [~joshdevins] [~gmaas] indeed capping the cores

[jira] [Resolved] (SPARK-5018) Make MultivariateGaussian public

2015-01-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5018. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3923 [https://githu

[jira] [Commented] (SPARK-3561) Allow for pluggable execution contexts in Spark

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273225#comment-14273225 ] Patrick Wendell commented on SPARK-3561: So if the question is: "Is Spark only API

[jira] [Commented] (SPARK-5186) Vector.equals and Vector.hashCode are very inefficient

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273224#comment-14273224 ] Apache Spark commented on SPARK-5186: - User 'hhbyyh' has created a pull request for th

[jira] [Updated] (SPARK-4924) Factor out code to launch Spark applications into a separate library

2015-01-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-4924: -- Assignee: Marcelo Vanzin > Factor out code to launch Spark applications into a separate library > --

[jira] [Updated] (SPARK-5088) Use spark-class for running executors directly on mesos

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5088: Fix Version/s: 1.2.1 1.3.0 > Use spark-class for running executors directly on me

[jira] [Updated] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5197: Target Version/s: 1.3.0 (was: 1.3.0, 1.2.1) > Support external shuffle service in fine-grained mode

[jira] [Updated] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5197: Fix Version/s: 1.3.0 > Support external shuffle service in fine-grained mode on mesos cluster >

[jira] [Updated] (SPARK-5166) Stabilize Spark SQL APIs

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5166: --- Priority: Blocker (was: Critical) > Stabilize Spark SQL APIs > > >

[jira] [Updated] (SPARK-3340) Deprecate ADD_JARS and ADD_FILES

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3340: --- Labels: starter (was: ) > Deprecate ADD_JARS and ADD_FILES >

[jira] [Resolved] (SPARK-3450) Enable specifiying the --jars CLI option multiple times

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3450. Resolution: Won't Fix I'd prefer not to do this one, it complicates our parsing substantiall

[jira] [Resolved] (SPARK-4399) Support multiple cloud providers

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4399. Resolution: Won't Fix We'll let the community take this one on. > Support multiple cloud pr

[jira] [Commented] (SPARK-1422) Add scripts for launching Spark on Google Compute Engine

2015-01-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273197#comment-14273197 ] Nicholas Chammas commented on SPARK-1422: - [~pwendell] - I would consider doing th

[jira] [Commented] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

2015-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273196#comment-14273196 ] Yin Huai commented on SPARK-4296: - I was wondering if we can also find this issue at other

[jira] [Updated] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

2015-01-11 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-4296: Target Version/s: 1.3.0, 1.2.1 (was: 1.2.0) Affects Version/s: 1.1.1 1.2

[jira] [Commented] (SPARK-4296) Throw "Expression not in GROUP BY" when using same expression in group by clause and select clause

2015-01-11 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273194#comment-14273194 ] Yin Huai commented on SPARK-4296: - [~lian cheng] Seems this issues is similar with [this

[jira] [Commented] (SPARK-2621) Update task InputMetrics incrementally

2015-01-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273192#comment-14273192 ] Sandy Ryza commented on SPARK-2621: --- Definitely - just filed SPARK-5199 for this. > Upd

[jira] [Created] (SPARK-5199) Input metrics should show up for InputFormats that return CombineFileSplits

2015-01-11 Thread Sandy Ryza (JIRA)
Sandy Ryza created SPARK-5199: - Summary: Input metrics should show up for InputFormats that return CombineFileSplits Key: SPARK-5199 URL: https://issues.apache.org/jira/browse/SPARK-5199 Project: Spark

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2015-01-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273187#comment-14273187 ] Nicholas Chammas commented on SPARK-3821: - Updated launch stats: * Launching clust

[jira] [Commented] (SPARK-1422) Add scripts for launching Spark on Google Compute Engine

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273178#comment-14273178 ] Patrick Wendell commented on SPARK-1422: Good call NIck - yeah let's close this as

[jira] [Resolved] (SPARK-1422) Add scripts for launching Spark on Google Compute Engine

2015-01-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1422. Resolution: Won't Fix > Add scripts for launching Spark on Google Compute Engine > -

[jira] [Comment Edited] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273169#comment-14273169 ] Jongyoul Lee edited comment on SPARK-5198 at 1/12/15 2:38 AM: --

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Description: In fine-grained mode, SchedulerBackend set executor name as same as slave id with any

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Description: In fine-grained mode, SchedulerBackend set executor name as same as slave id with any

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Description: In fine-grained mode, SchedulerBackend set executor name as same as slave id with any

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Attachment: Screen Shot 2015-01-12 at 11.34.41 AM.png Screen Shot 2015-01-12 at 11.34

[jira] [Commented] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273165#comment-14273165 ] Apache Spark commented on SPARK-5198: - User 'jongyoul' has created a pull request for

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Description: In fine-grained mode, SchedulerBackend set executor name as same as slave id with any t

[jira] [Comment Edited] (SPARK-4689) Unioning 2 SchemaRDDs should return a SchemaRDD in Python, Scala, and Java

2015-01-11 Thread Bibudh Lahiri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268720#comment-14268720 ] Bibudh Lahiri edited comment on SPARK-4689 at 1/12/15 2:13 AM: -

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Component/s: Mesos > Change executorId more unique on mesos fine-grained mode >

[jira] [Updated] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5198: Fix Version/s: 1.2.1 1.3.0 > Change executorId more unique on mesos fine-grained

[jira] [Created] (SPARK-5198) Change executorId more unique on mesos fine-grained mode

2015-01-11 Thread Jongyoul Lee (JIRA)
Jongyoul Lee created SPARK-5198: --- Summary: Change executorId more unique on mesos fine-grained mode Key: SPARK-5198 URL: https://issues.apache.org/jira/browse/SPARK-5198 Project: Spark Issue Ty

[jira] [Commented] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273137#comment-14273137 ] Jongyoul Lee commented on SPARK-5197: - Please, assign it to me. [~andrewor14] [~adav]

[jira] [Updated] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

2015-01-11 Thread Jongyoul Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5197: Description: I think dynamic allocation is almost satisfied on mesos' fine-grained mode, which alre

[jira] [Created] (SPARK-5197) Support external shuffle service in fine-grained mode on mesos cluster

2015-01-11 Thread Jongyoul Lee (JIRA)
Jongyoul Lee created SPARK-5197: --- Summary: Support external shuffle service in fine-grained mode on mesos cluster Key: SPARK-5197 URL: https://issues.apache.org/jira/browse/SPARK-5197 Project: Spark

[jira] [Closed] (SPARK-4033) Integer overflow when SparkPi is called with more than 25000 slices

2015-01-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4033. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: SaintBacchus Target Version/s:

[jira] [Closed] (SPARK-4951) A busy executor may be killed when dynamicAllocation is enabled

2015-01-11 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4951. Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Target Version/s: 1.3.0,

[jira] [Resolved] (SPARK-5073) "spark.storage.memoryMapThreshold" has two default values

2015-01-11 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-5073. --- Resolution: Fixed > "spark.storage.memoryMapThreshold" has two default values > --

[jira] [Commented] (SPARK-4159) Maven build doesn't run JUnit test suites

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273062#comment-14273062 ] Apache Spark commented on SPARK-4159: - User 'srowen' has created a pull request for th

[jira] [Commented] (SPARK-5172) spark-examples-***.jar shades a wrong Hadoop distribution

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273041#comment-14273041 ] Apache Spark commented on SPARK-5172: - User 'srowen' has created a pull request for th

[jira] [Commented] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

2015-01-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273007#comment-14273007 ] Nicholas Chammas commented on SPARK-5008: - Use [{{copy-dir}}|https://github.com/me

[jira] [Commented] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

2015-01-11 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272991#comment-14272991 ] Brad Willard commented on SPARK-5008: - [~nchammas] I can try that once I get back into

[jira] [Commented] (SPARK-5162) Python yarn-cluster mode

2015-01-11 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272943#comment-14272943 ] Lianhui Wang commented on SPARK-5162: - [~dklassen] i submit a PR for this issue.https

[jira] [Commented] (SPARK-5196) Add comment field in StructField

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272937#comment-14272937 ] Apache Spark commented on SPARK-5196: - User 'OopsOutOfMemory' has created a pull reque

[jira] [Created] (SPARK-5196) Add comment field in StructField

2015-01-11 Thread shengli (JIRA)
shengli created SPARK-5196: -- Summary: Add comment field in StructField Key: SPARK-5196 URL: https://issues.apache.org/jira/browse/SPARK-5196 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-5195) when hive table is query with alias the cache data lose effectiveness.

2015-01-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272934#comment-14272934 ] Apache Spark commented on SPARK-5195: - User 'seayi' has created a pull request for thi

[jira] [Created] (SPARK-5195) when hive table is query with alias the cache data lose effectiveness.

2015-01-11 Thread yixiaohua (JIRA)
yixiaohua created SPARK-5195: Summary: when hive table is query with alias the cache data lose effectiveness. Key: SPARK-5195 URL: https://issues.apache.org/jira/browse/SPARK-5195 Project: Spark

[jira] [Updated] (SPARK-5192) Parquet fails to parse schema contains '\r'

2015-01-11 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-5192: - Summary: Parquet fails to parse schema contains '\r' (was: Parquet fails to parse schemas contains '\r')

[jira] [Created] (SPARK-5194) ADD JAR doesn't update classpath until reconnect

2015-01-11 Thread Oleg Danilov (JIRA)
Oleg Danilov created SPARK-5194: --- Summary: ADD JAR doesn't update classpath until reconnect Key: SPARK-5194 URL: https://issues.apache.org/jira/browse/SPARK-5194 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4861) Refactory command in spark sql

2015-01-11 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272862#comment-14272862 ] wangfei commented on SPARK-4861: [~yhuai]of course if possible, but i have not find a way

[jira] [Updated] (SPARK-5166) Stabilize Spark SQL APIs

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5166: --- Assignee: Reynold Xin > Stabilize Spark SQL APIs > > > Key: S

[jira] [Updated] (SPARK-5166) Stabilize Spark SQL APIs

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5166: --- Priority: Critical (was: Major) > Stabilize Spark SQL APIs > > >

[jira] [Updated] (SPARK-5193) Make Spark SQL API usable in Java and remove the Java-specific API

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5193: --- Description: Java version of the SchemaRDD API causes high maintenance burden for Spark SQL itself an

[jira] [Commented] (SPARK-5193) Make Spark SQL API usable in Java and remove the Java-specific API

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272860#comment-14272860 ] Reynold Xin commented on SPARK-5193: cc [~marmbrus] > Make Spark SQL API usable in Ja

[jira] [Created] (SPARK-5193) Make Spark SQL API usable in Java and remove the Java-specific API

2015-01-11 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5193: -- Summary: Make Spark SQL API usable in Java and remove the Java-specific API Key: SPARK-5193 URL: https://issues.apache.org/jira/browse/SPARK-5193 Project: Spark

[jira] [Updated] (SPARK-3299) [SQL] Public API in SQLContext to list tables

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3299: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-5166 > [SQL] Public API in SQLContext t

[jira] [Updated] (SPARK-5167) Move Row into sql package and make it usable for Java

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5167: --- Assignee: Reynold Xin > Move Row into sql package and make it usable for Java > --

[jira] [Updated] (SPARK-2096) Correctly parse dot notations for accessing an array of structs

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2096: --- Target Version/s: 1.3.0 (was: 1.2.0) > Correctly parse dot notations for accessing an array of struct

[jira] [Updated] (SPARK-4508) Native Date type for SQL92 Date

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4508: --- Assignee: Adrian Wang > Native Date type for SQL92 Date > --- > >

[jira] [Updated] (SPARK-4508) Native Date type for SQL92 Date

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4508: --- Summary: Native Date type for SQL92 Date (was: build native date type to conform behavior to Hive) >

[jira] [Updated] (SPARK-4508) Native Date type for SQL92 Date

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4508: --- Target Version/s: 1.3.0 > Native Date type for SQL92 Date > --- > >

[jira] [Updated] (SPARK-4508) build native date type to conform behavior to Hive

2015-01-11 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4508: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-5166 > build native date type to confor