[jira] [Commented] (SPARK-6468) Fix the race condition of subDirs in DiskBlockManager

[ https://issues.apache.org/jira/browse/SPARK-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375873#comment-14375873 ] Apache Spark commented on SPARK-6468: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-6468) Fix the race condition of subDirs in DiskBlockManager

Shixiong Zhu created SPARK-6468: --- Summary: Fix the race condition of subDirs in DiskBlockManager Key: SPARK-6468 URL: https://issues.apache.org/jira/browse/SPARK-6468 Project: Spark Issue

[jira] [Commented] (SPARK-2394) Make it easier to read LZO-compressed files from EC2 clusters

[ https://issues.apache.org/jira/browse/SPARK-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375766#comment-14375766 ] Theodore Vasiloudis commented on SPARK-2394: Just adding some more info here

[jira] [Comment Edited] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375599#comment-14375599 ] Littlestar edited comment on SPARK-1702 at 3/23/15 11:00 AM: -

[jira] [Comment Edited] (SPARK-2394) Make it easier to read LZO-compressed files from EC2 clusters

[ https://issues.apache.org/jira/browse/SPARK-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375766#comment-14375766 ] Theodore Vasiloudis edited comment on SPARK-2394 at 3/23/15 11:38 AM:

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375707#comment-14375707 ] vijay commented on SPARK-6435: -- I tested this on Linux with the 1.3.0 release, works fine.

[jira] [Commented] (SPARK-2167) spark-submit should return exit code based on failure/success

[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376001#comment-14376001 ] Sean Owen commented on SPARK-2167: -- (Thanks [~tgraves] for having a look at some of these

[jira] [Closed] (SPARK-6436) io/netty missing from external shuffle service jars for yarn

[ https://issues.apache.org/jira/browse/SPARK-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-6436. Resolution: Invalid This is working for me. Sorry for the confusion, I had build environment

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376009#comment-14376009 ] Christophe PRÉAUD commented on SPARK-6469: -- Sorry if I'm saying something stupid,

[jira] [Commented] (SPARK-4227) Document external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376022#comment-14376022 ] Thomas Graves commented on SPARK-4227: -- Looks like I had build issues. The

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376039#comment-14376039 ] Christophe PRÉAUD commented on SPARK-6469: -- Not exactly, sorry if this was not

[jira] [Commented] (SPARK-6255) Python MLlib API missing items: Classification

[ https://issues.apache.org/jira/browse/SPARK-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375994#comment-14375994 ] Apache Spark commented on SPARK-6255: - User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376017#comment-14376017 ] Sean Owen commented on SPARK-6469: -- Ah I get you, I think you have a point. So, you are

[jira] [Commented] (SPARK-3735) Sending the factor directly or AtA based on the cost in ALS

[ https://issues.apache.org/jira/browse/SPARK-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376046#comment-14376046 ] Debasish Das commented on SPARK-3735: - We might want to consider doing some of these

[jira] [Updated] (SPARK-6463) AttributeSet.equal should compare size

[ https://issues.apache.org/jira/browse/SPARK-6463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] June updated SPARK-6463: Summary: AttributeSet.equal should compare size (was: [SPARK][SQL] AttributeSet.equal should compare size)

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050-3453-S3/frameworks/20150323-133400-1214949568-5050-15440-0007/executors/20150323-100710-1214949568-5050-3453-S3/runs/915b40d8-f7c4-428a-9df8-ac9804c6cd21/spark-1.3.0-bin-2.4.0.tar.gz' sh: hadoop

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375976#comment-14375976 ] Sean Owen commented on SPARK-6469: -- So, if {{YARN_LOCAL_DIRS}} is set, then

[jira] [Commented] (SPARK-6449) Driver OOM results in reported application result SUCCESS

[ https://issues.apache.org/jira/browse/SPARK-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375905#comment-14375905 ] Thomas Graves commented on SPARK-6449: -- [~rdub] Was there an exception in the log

[jira] [Comment Edited] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375941#comment-14375941 ] Christophe PRÉAUD edited comment on SPARK-6469 at 3/23/15 2:16 PM:

[jira] [Comment Edited] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375941#comment-14375941 ] Christophe PRÉAUD edited comment on SPARK-6469 at 3/23/15 2:15 PM:

[jira] [Updated] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe PRÉAUD updated SPARK-6469: - Attachment: TestYarnVars.scala Attached a simple application to check the value of the

[jira] [Created] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

Christophe PRÉAUD created SPARK-6469: Summary: Local directories configured for YARN are not used in yarn-client mode Key: SPARK-6469 URL: https://issues.apache.org/jira/browse/SPARK-6469

[jira] [Commented] (SPARK-2394) Make it easier to read LZO-compressed files from EC2 clusters

[ https://issues.apache.org/jira/browse/SPARK-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375929#comment-14375929 ] Nicholas Chammas commented on SPARK-2394: - Thank you for posting this information

[jira] [Commented] (SPARK-6255) Python MLlib API missing items: Classification

[ https://issues.apache.org/jira/browse/SPARK-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376095#comment-14376095 ] Yanbo Liang commented on SPARK-6255: [~josephkb] Can you assign it to me? Python

[jira] [Commented] (SPARK-6451) Support CombineSum in Code Gen

[ https://issues.apache.org/jira/browse/SPARK-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376088#comment-14376088 ] Apache Spark commented on SPARK-6451: - User 'gvramana' has created a pull request for

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376065#comment-14376065 ] Thomas Graves commented on SPARK-6469: -- Note if its purely the documentation confused

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376061#comment-14376061 ] Thomas Graves commented on SPARK-6469: -- Are you saying they are not set on the driver

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376084#comment-14376084 ] Christophe PRÉAUD commented on SPARK-6469: -- The problem I have is that spark

[jira] [Commented] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376092#comment-14376092 ] Thomas Graves commented on SPARK-6469: -- Yeah so you should be able to set the

[jira] [Updated] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe PRÉAUD updated SPARK-6469: - Issue Type: Documentation (was: Bug) Local directories configured for YARN are not used

[jira] [Created] (SPARK-6460) Implement OpensslAesCtrCryptoCodec to enable encrypted shuffle algorithms which openssl provides

liyunzhang_intel created SPARK-6460: --- Summary: Implement OpensslAesCtrCryptoCodec to enable encrypted shuffle algorithms which openssl provides Key: SPARK-6460 URL:

[jira] [Updated] (SPARK-6460) Implement OpensslAesCtrCryptoCodec to enable encrypted shuffle algorithms which openssl provides

[ https://issues.apache.org/jira/browse/SPARK-6460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-6460: Issue Type: Sub-task (was: Bug) Parent: SPARK-5682 Implement

[jira] [Commented] (SPARK-6483) Spark SQL udf(ScalaUdf) is very slow

[ https://issues.apache.org/jira/browse/SPARK-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377338#comment-14377338 ] Apache Spark commented on SPARK-6483: - User 'zzcclp' has created a pull request for

[jira] [Commented] (SPARK-3306) Addition of external resource dependency in executors

[ https://issues.apache.org/jira/browse/SPARK-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377343#comment-14377343 ] Reynold Xin commented on SPARK-3306: Can you elaborate on why this needs to be Spark

[jira] [Commented] (SPARK-6477) Run MIMA tests before the Spark test suite

[ https://issues.apache.org/jira/browse/SPARK-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376740#comment-14376740 ] Apache Spark commented on SPARK-6477: - User 'brennonyork' has created a pull request

[jira] [Commented] (SPARK-6229) Support SASL encryption in network/common module

[ https://issues.apache.org/jira/browse/SPARK-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376147#comment-14376147 ] Marcelo Vanzin commented on SPARK-6229: --- [~adav] the problem of exposing the

[jira] [Closed] (SPARK-4746) integration tests should be separated from faster unit tests

[ https://issues.apache.org/jira/browse/SPARK-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid closed SPARK-4746. --- Resolution: Won't Fix looks like there isn't interest in this, closing to clean up jira integration

[jira] [Updated] (SPARK-6469) Local directories configured for YARN are not used in yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe PRÉAUD updated SPARK-6469: - Description: According to the [Spark YARN doc

[jira] [Updated] (SPARK-6469) The YARN driver in yarn-client mode will not use the local directories configured for YARN

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe PRÉAUD updated SPARK-6469: - Summary: The YARN driver in yarn-client mode will not use the local directories

[jira] [Updated] (SPARK-6469) The YARN driver in yarn-client mode will not use the local directories configured for YARN

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christophe PRÉAUD updated SPARK-6469: - Description: According to the [Spark YARN doc

[jira] [Commented] (SPARK-6469) The YARN driver in yarn-client mode will not use the local directories configured for YARN

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376111#comment-14376111 ] Christophe PRÉAUD commented on SPARK-6469: -- I've changed the JIRA title, type and

[jira] [Updated] (SPARK-6469) The YARN driver in yarn-client mode will not use the local directories configured for YARN

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-6469: - Component/s: (was: Spark Core) YARN The YARN driver in yarn-client mode

[jira] [Commented] (SPARK-6469) The YARN driver in yarn-client mode will not use the local directories configured for YARN

[ https://issues.apache.org/jira/browse/SPARK-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376119#comment-14376119 ] Thomas Graves commented on SPARK-6469: -- looks good, thanks. The YARN driver in

[jira] [Updated] (SPARK-6308) VectorUDT is displayed as `vecto` in dtypes

[ https://issues.apache.org/jira/browse/SPARK-6308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6308: - Assignee: Manoj Kumar VectorUDT is displayed as `vecto` in dtypes

[jira] [Updated] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6435: - Component/s: Windows Great debugging! [~tsudukim] do you have thoughts on this? I think this bit was

[jira] [Commented] (SPARK-6320) Adding new query plan strategy to SQLContext

[ https://issues.apache.org/jira/browse/SPARK-6320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376434#comment-14376434 ] Michael Armbrust commented on SPARK-6320: - If that can be done in a minimally

[jira] [Commented] (SPARK-6200) Support dialect in SQL

[ https://issues.apache.org/jira/browse/SPARK-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376450#comment-14376450 ] Michael Armbrust commented on SPARK-6200: - Making comments there would be a good

[jira] [Resolved] (SPARK-6200) Support dialect in SQL

[ https://issues.apache.org/jira/browse/SPARK-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6200. - Resolution: Duplicate Support dialect in SQL --

[jira] [Updated] (SPARK-6255) Python MLlib API missing items: Classification

[ https://issues.apache.org/jira/browse/SPARK-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6255: - Assignee: Yanbo Liang Python MLlib API missing items: Classification

[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376430#comment-14376430 ] Imran Rashid commented on SPARK-5928: - sorry to hear that [~douglaz]. To help

[jira] [Commented] (SPARK-2331) SparkContext.emptyRDD should return RDD[T] not EmptyRDD[T]

[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376495#comment-14376495 ] Patrick Wendell commented on SPARK-2331: By the way - [~rxin] recently pointed out

[jira] [Created] (SPARK-6472) Elements of an array of structs cannot be accessed.

Yin Huai created SPARK-6472: --- Summary: Elements of an array of structs cannot be accessed. Key: SPARK-6472 URL: https://issues.apache.org/jira/browse/SPARK-6472 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6472) Elements of an array of structs cannot be accessed.

[ https://issues.apache.org/jira/browse/SPARK-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6472: Component/s: SQL Elements of an array of structs cannot be accessed.

[jira] [Resolved] (SPARK-6472) Elements of an array of structs cannot be accessed.

[ https://issues.apache.org/jira/browse/SPARK-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-6472. - Resolution: Not a Problem It is not a problem. For select, we support column name string. I need to use

[jira] [Updated] (SPARK-2331) SparkContext.emptyRDD should return RDD[T] not EmptyRDD[T]

[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2331: --- Description: The return type for SparkContext.emptyRDD is EmptyRDD[T]. It should be RDD[T]. That

[jira] [Commented] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376454#comment-14376454 ] Imran Rashid commented on SPARK-5945: - Hi [~ilganeli], sorry for taking a while to

[jira] [Updated] (SPARK-5945) Spark should not retry a stage infinitely on a FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-5945: Assignee: Ilya Ganelin Spark should not retry a stage infinitely on a FetchFailedException

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376501#comment-14376501 ] vijay commented on SPARK-6435: -- I came up with square brackets after 2 minutes of

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Description: After digging some codes, I found user could not submit app in standalone cluster mode when

[jira] [Created] (SPARK-6465) GenericRowWithSchema: KryoException: Class cannot be created (missing no-arg constructor):

Earthson Lu created SPARK-6465: -- Summary: GenericRowWithSchema: KryoException: Class cannot be created (missing no-arg constructor): Key: SPARK-6465 URL: https://issues.apache.org/jira/browse/SPARK-6465

[jira] [Commented] (SPARK-6466) Remove unnecessary attributes when resolving GroupingSets

[ https://issues.apache.org/jira/browse/SPARK-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375657#comment-14375657 ] Apache Spark commented on SPARK-6466: - User 'viirya' has created a pull request for

[jira] [Created] (SPARK-6467) Override QueryPlan.missingInput when necessary and rely on it CheckAnalysis

Cheng Lian created SPARK-6467: - Summary: Override QueryPlan.missingInput when necessary and rely on it CheckAnalysis Key: SPARK-6467 URL: https://issues.apache.org/jira/browse/SPARK-6467 Project: Spark

[jira] [Updated] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Description: Virtual columns like GROUPING__ID should never be considered as missing input, and thus

[jira] [Commented] (SPARK-1480) Choose classloader consistently inside of Spark codebase

100%.. I0323 16:32:18.933440 14504 fetcher.cpp:64] Extracted resource '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050-3453-S4/frameworks/20150323-152848-1214949568-5050-21134-0009/executors/20150323-100710-1214949568-5050-3453-S4/runs/3d8f22f5-7fed-44ed-b5f9-98a219133911/spark-1.3.0

[jira] [Comment Edited] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375590#comment-14375590 ] iward edited comment on SPARK-3720 at 3/23/15 9:10 AM: --- hi,[~zhzhan]

[jira] [Commented] (SPARK-6430) Cannot resolve column correctlly when using left semi join

[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375453#comment-14375453 ] Michael Armbrust commented on SPARK-6430: - Actually, I might be wrong. Let me

[jira] [Reopened] (SPARK-6430) Cannot resolve column correctlly when using left semi join

[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-6430: - Cannot resolve column correctlly when using left semi join

[jira] [Created] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

spark.executorEnv.JAVA_HOME E0323 14:24:36.400635 11355 fetcher.cpp:109] HDFS copyToLocal failed: hadoop fs -copyToLocal 'hdfs://192.168.1.9:54310/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050-3453-S3/frameworks/20150323-133400-1214949568-5050-15440

[jira] [Updated] (SPARK-6430) Cannot resolve column correctlly when using left semi join

[ https://issues.apache.org/jira/browse/SPARK-6430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6430: Target Version/s: 1.3.1 Cannot resolve column correctlly when using left semi join

[jira] [Comment Edited] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375481#comment-14375481 ] Cheng Lian edited comment on SPARK-6456 at 3/23/15 7:21 AM:

[jira] [Created] (SPARK-6463) [SPARK][SQL] AttributeSet.equal should compare size

June created SPARK-6463: --- Summary: [SPARK][SQL] AttributeSet.equal should compare size Key: SPARK-6463 URL: https://issues.apache.org/jira/browse/SPARK-6463 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

spark.executorEnv.JAVA_HOME E0323 14:24:36.400635 11355 fetcher.cpp:109] HDFS copyToLocal failed: hadoop fs -copyToLocal 'hdfs://192.168.1.9:54310/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050-3453-S3/frameworks/20150323-133400-1214949568-5050-15440-0007

[jira] [Commented] (SPARK-6463) AttributeSet.equal should compare size

[ https://issues.apache.org/jira/browse/SPARK-6463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375581#comment-14375581 ] Apache Spark commented on SPARK-6463: - User 'sisihj' has created a pull request for

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

/work_dir/slaves/20150323-100710-1214949568-5050-3453-S3/frameworks/20150323-133400-1214949568-5050-15440-0007/executors/20150323-100710-1214949568-5050-3453-S3/runs/915b40d8-f7c4-428a-9df8-ac9804c6cd21/spark-1.3.0-bin-2.4.0.tar.gz' sh: hadoop: command not found -- This message was sent by Atlassian

[jira] [Comment Edited] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375590#comment-14375590 ] iward edited comment on SPARK-3720 at 3/23/15 9:05 AM: --- hi,[~zhzhan]

[jira] [Commented] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375599#comment-14375599 ] Littlestar commented on SPARK-1702: --- I met this on spak 1.3.0 + mesos 0.21.1 Mesos

[jira] [Comment Edited] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375599#comment-14375599 ] Littlestar edited comment on SPARK-1702 at 3/23/15 9:05 AM: I

[jira] [Updated] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6464: Description: Nowadays, the transformation *coalesce* was always used to expand or reduce the

[jira] [Updated] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Summary: Exclude virtual columns from QueryPlan.missingInput (was: Override QueryPlan.missingInput

[jira] [Commented] (SPARK-6451) Support CombineSum in Code Gen

[ https://issues.apache.org/jira/browse/SPARK-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375456#comment-14375456 ] Venkata Ramana G commented on SPARK-6451: - Working on the same. Support

[jira] [Created] (SPARK-6462) UpdateStateByKey should allow inner join of new with old keys

Andre Schumacher created SPARK-6462: --- Summary: UpdateStateByKey should allow inner join of new with old keys Key: SPARK-6462 URL: https://issues.apache.org/jira/browse/SPARK-6462 Project: Spark

[jira] [Commented] (SPARK-1480) Choose classloader consistently inside of Spark codebase

[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375576#comment-14375576 ] Littlestar commented on SPARK-1480: --- same as

[jira] [Commented] (SPARK-3720) support ORC in spark sql

[ https://issues.apache.org/jira/browse/SPARK-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375590#comment-14375590 ] iward commented on SPARK-3720: -- hi,Zhan Zhang , I have the same problem.And I just contact

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

spark.executorEnv.HADOOP_HOME spark.executorEnv.JAVA_HOME E0323 14:24:36.400635 11355 fetcher.cpp:109] HDFS copyToLocal failed: hadoop fs -copyToLocal 'hdfs://192.168.1.9:54310/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050-3453-S3

[jira] [Updated] (SPARK-6443) Could not submit app in standalone cluster mode when HA is enabled

[ https://issues.apache.org/jira/browse/SPARK-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6443: Description: After digging some codes, I found user could not submit app in standalone cluster mode when

[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375583#comment-14375583 ] Littlestar commented on SPARK-1403: --- I want to reopen this bug, because I can reproduce

[jira] [Updated] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6464: Description: Nowadays, the transformation *coalesce* was always used to expand or reduce the

[jira] [Created] (SPARK-6466) Remove unnecessary attributes when resolving GroupingSets

Liang-Chi Hsieh created SPARK-6466: -- Summary: Remove unnecessary attributes when resolving GroupingSets Key: SPARK-6466 URL: https://issues.apache.org/jira/browse/SPARK-6466 Project: Spark

[jira] [Updated] (SPARK-6397) Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Affects Version/s: 1.3.0 Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[jira] [Updated] (SPARK-6397) Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6397: -- Assignee: Yadong Qi Override QueryPlan.missingInput when necessary and rely on CheckAnalysis

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

fetcher.cpp:109] HDFS copyToLocal failed: hadoop fs -copyToLocal 'hdfs://192.168.1.9:54310/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050-3453-S3/frameworks/20150323-133400-1214949568-5050-15440-0007/executors/20150323-100710-1214949568-5050

[jira] [Created] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

SaintBacchus created SPARK-6464: --- Summary: Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd Key: SPARK-6464 URL:

[jira] [Updated] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6464: Description: Nowadays, the transformation *coalesce* was always used to expand or reduce the

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

spark.executorEnv.PATH spark.executorEnv.HADOOP_HOME spark.executorEnv.JAVA_HOME E0323 14:24:36.400635 11355 fetcher.cpp:109] HDFS copyToLocal failed: hadoop fs -copyToLocal 'hdfs://192.168.1.9:54310/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568-5050

[jira] [Commented] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375680#comment-14375680 ] Cheng Lian commented on SPARK-6397: --- Hey [~smolav], after some discussion with

[jira] [Resolved] (SPARK-6397) Exclude virtual columns from QueryPlan.missingInput

[ https://issues.apache.org/jira/browse/SPARK-6397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6397. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6456: -- Description: Spark connects with Hive Metastore. I am able to run simple queries like show table and

[jira] [Commented] (SPARK-6456) Spark Sql throwing exception on large partitioned data

[ https://issues.apache.org/jira/browse/SPARK-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375481#comment-14375481 ] Cheng Lian commented on SPARK-6456: --- How many partitions are there? Spark Sql throwing

[jira] [Updated] (SPARK-5320) Joins on simple table created using select gives error

[ https://issues.apache.org/jira/browse/SPARK-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-5320: Assignee: Yuri Saito Joins on simple table created using select gives error

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

spark.executorEnv.PATH spark.executorEnv.HADOOP_HOME spark.executorEnv.JAVA_HOME E0323 14:24:36.400635 11355 fetcher.cpp:109] HDFS copyToLocal failed: hadoop fs -copyToLocal 'hdfs://192.168.1.9:54310/home/test/spark-1.3.0-bin-2.4.0.tar.gz' '/home/mesos/work_dir/slaves/20150323-100710-1214949568

  1   2   3   >