[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642225#comment-14642225 ] Nathan McCarthy commented on SPARK-5928: We are seeing the same issues, especially

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8475: --- Description: Spark Submit adds maven central spark bintray to the ChainResolver before it

[jira] [Created] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load when no internet access

Nathan McCarthy created SPARK-8475: -- Summary: SparkSubmit with Ivy jars is very slow to load when no internet access Key: SPARK-8475 URL: https://issues.apache.org/jira/browse/SPARK-8475 Project:

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8475: --- Summary: SparkSubmit with Ivy jars is very slow to load with no internet access (was:

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8475: --- Description: Spark Submit adds maven central spark bintray to the ChainResolver before it

[jira] [Updated] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8428: --- Description: Running an SQL query that has a sub query and multiple left joins fails when

[jira] [Updated] (SPARK-8421) Spark SQL DATE_ADD function - Spark 1.3.1 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-8421: --- Description: Running with a parquet backed table in hive ‘dim_promo_date_curr_p' which has

[jira] [Comment Edited] (SPARK-6009) IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND ()

[ https://issues.apache.org/jira/browse/SPARK-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591245#comment-14591245 ] Nathan McCarthy edited comment on SPARK-6009 at 6/18/15 4:48 AM:

[jira] [Commented] (SPARK-6009) IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND ()

[ https://issues.apache.org/jira/browse/SPARK-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591245#comment-14591245 ] Nathan McCarthy commented on SPARK-6009: Doesnt seem to just affect ORDER BY

[jira] [Created] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

Nathan McCarthy created SPARK-8428: -- Summary: TimSort Comparison method violates its general contract with CLUSTER BY Key: SPARK-8428 URL: https://issues.apache.org/jira/browse/SPARK-8428 Project:

[jira] [Created] (SPARK-8421) Spark SQL DATE_ADD function - Spark 1.3.1 1.4.0

Nathan McCarthy created SPARK-8421: -- Summary: Spark SQL DATE_ADD function - Spark 1.3.1 1.4.0 Key: SPARK-8421 URL: https://issues.apache.org/jira/browse/SPARK-8421 Project: Spark Issue

[jira] [Commented] (SPARK-8406) Race condition when writing Parquet files

[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589498#comment-14589498 ] Nathan McCarthy commented on SPARK-8406: This is hitting us hard. Let me know if

[jira] [Commented] (SPARK-6009) IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND ()

[ https://issues.apache.org/jira/browse/SPARK-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589345#comment-14589345 ] Nathan McCarthy commented on SPARK-6009: Disregard the above. Looks like it was

[jira] [Commented] (SPARK-6009) IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND ()

[ https://issues.apache.org/jira/browse/SPARK-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589341#comment-14589341 ] Nathan McCarthy commented on SPARK-6009: Just test with 1.4 and the issue

[jira] [Updated] (SPARK-6009) IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND ()

[ https://issues.apache.org/jira/browse/SPARK-6009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-6009: --- Affects Version/s: 1.4.0 IllegalArgumentException thrown by TimSort when SQL ORDER BY RAND

[jira] [Commented] (SPARK-4644) Implement skewed join

[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586076#comment-14586076 ] Nathan McCarthy commented on SPARK-4644: Something like this to make working with

[jira] [Comment Edited] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581311#comment-14581311 ] Nathan McCarthy edited comment on SPARK-7550 at 6/11/15 1:08 AM:

[jira] [Commented] (SPARK-7550) Support setting the right schema serde when writing to Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581311#comment-14581311 ] Nathan McCarthy commented on SPARK-7550: This is a major blocker for us as we use

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573929#comment-14573929 ] Nathan McCarthy commented on SPARK-7819: @Yin - looks like might build was just a

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572235#comment-14572235 ] Nathan McCarthy commented on SPARK-7819: Building of spark 1.4 branch, built 2

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572226#comment-14572226 ] Nathan McCarthy commented on SPARK-7819: Has anyone tried this with spark-submit?

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537702#comment-14537702 ] Nathan McCarthy commented on SPARK-5707: +1 seeing this as well. Is there a

[jira] [Updated] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-5707: --- Affects Version/s: 1.3.1 Enabling spark.sql.codegen throws ClassNotFound exception

[jira] [Commented] (SPARK-5707) Enabling spark.sql.codegen throws ClassNotFound exception

[ https://issues.apache.org/jira/browse/SPARK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538926#comment-14538926 ] Nathan McCarthy commented on SPARK-5707: Also throws and error when switching to

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362820#comment-14362820 ] Nathan McCarthy commented on SPARK-6313: Thanks for the feedback guys. The config

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362605#comment-14362605 ] Nathan McCarthy commented on SPARK-6313: Stacktrace; 14/12/12 18:18:24 WARN

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359964#comment-14359964 ] Nathan McCarthy commented on SPARK-6313: Suggestion along the lines of;

[jira] [Created] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

Nathan McCarthy created SPARK-6313: -- Summary: Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount Key: SPARK-6313 URL: https://issues.apache.org/jira/browse/SPARK-6313

[jira] [Updated] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-6313: --- Affects Version/s: 1.2.0 1.2.1 Fetch File Lock file creation doesnt

[jira] [Comment Edited] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359972#comment-14359972 ] Nathan McCarthy edited comment on SPARK-6313 at 3/13/15 5:38 AM:

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359972#comment-14359972 ] Nathan McCarthy commented on SPARK-6313: Since the `val lockFileName =

[jira] [Commented] (SPARK-5557) spark-shell failed to start

[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14303332#comment-14303332 ] Nathan McCarthy commented on SPARK-5557: I am seeing similar when trying to launch