[jira] [Commented] (SPARK-22564) csv reader no longer logs errors

[ https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260428#comment-16260428 ] Adrian Bridgett commented on SPARK-22564: - I guess this should be closed as won't fix. Maybe a

[jira] [Commented] (SPARK-22564) csv reader no longer logs errors

[ https://issues.apache.org/jira/browse/SPARK-22564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260424#comment-16260424 ] Adrian Bridgett commented on SPARK-22564: - Ah, I had an old copy of CSVRelation.scala from before

[jira] [Created] (SPARK-22564) csv reader no longer logs errors

Adrian Bridgett created SPARK-22564: --- Summary: csv reader no longer logs errors Key: SPARK-22564 URL: https://issues.apache.org/jira/browse/SPARK-22564 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22437) jdbc write fails to set default mode

[ https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237733#comment-16237733 ] Adrian Bridgett commented on SPARK-22437: - good grief that was fast! > jdbc write fails to set

[jira] [Created] (SPARK-22437) jdbc write fails to set default mode

Adrian Bridgett created SPARK-22437: --- Summary: jdbc write fails to set default mode Key: SPARK-22437 URL: https://issues.apache.org/jira/browse/SPARK-22437 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-22006) date/datetime comparisons should avoid casting

Adrian Bridgett created SPARK-22006: --- Summary: date/datetime comparisons should avoid casting Key: SPARK-22006 URL: https://issues.apache.org/jira/browse/SPARK-22006 Project: Spark Issue

[jira] [Commented] (SPARK-21521) History service requires user is in any group

[ https://issues.apache.org/jira/browse/SPARK-21521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099111#comment-16099111 ] Adrian Bridgett commented on SPARK-21521: - Thanks Marcelo - good idea regarding the setgid bit -

[jira] [Comment Edited] (SPARK-21521) History service requires user is in any group

[ https://issues.apache.org/jira/browse/SPARK-21521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099090#comment-16099090 ] Adrian Bridgett edited comment on SPARK-21521 at 7/24/17 8:40 PM: -- Hmm,

[jira] [Commented] (SPARK-21521) History service requires user is in any group

[ https://issues.apache.org/jira/browse/SPARK-21521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099090#comment-16099090 ] Adrian Bridgett commented on SPARK-21521: - Hmm, I didn't check that (it's actually just a local

[jira] [Created] (SPARK-21521) History service requires user is in any group

Adrian Bridgett created SPARK-21521: --- Summary: History service requires user is in any group Key: SPARK-21521 URL: https://issues.apache.org/jira/browse/SPARK-21521 Project: Spark Issue

[jira] [Created] (SPARK-21518) Warnings if spark.mesos.task.labels is unset

Adrian Bridgett created SPARK-21518: --- Summary: Warnings if spark.mesos.task.labels is unset Key: SPARK-21518 URL: https://issues.apache.org/jira/browse/SPARK-21518 Project: Spark Issue

[jira] [Commented] (SPARK-18579) spark-csv strips whitespace (pyspark)

[ https://issues.apache.org/jira/browse/SPARK-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889120#comment-15889120 ] Adrian Bridgett commented on SPARK-18579: - Yep, that's right. Sorry - not sure why I didn't reply

[jira] [Commented] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726148#comment-15726148 ] Adrian Bridgett commented on SPARK-18512: - Thanks Steve - just seen a "next few weeks" mentioned

[jira] [Commented] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725242#comment-15725242 ] Adrian Bridgett commented on SPARK-18512: - So currently, with Spark2 there's no sensible way to

[jira] [Commented] (SPARK-18611) mesos shuffle service on v2 isn't compatible with spark v1

[ https://issues.apache.org/jira/browse/SPARK-18611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702213#comment-15702213 ] Adrian Bridgett commented on SPARK-18611: - dragos spotted this problem in his comment on

[jira] [Created] (SPARK-18611) mesos shuffle service on v2 isn't compatible with spark v1

Adrian Bridgett created SPARK-18611: --- Summary: mesos shuffle service on v2 isn't compatible with spark v1 Key: SPARK-18611 URL: https://issues.apache.org/jira/browse/SPARK-18611 Project: Spark

[jira] [Updated] (SPARK-18611) mesos shuffle service on v2 isn't compatible with spark v1

[ https://issues.apache.org/jira/browse/SPARK-18611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Bridgett updated SPARK-18611: Affects Version/s: 1.6.3 > mesos shuffle service on v2 isn't compatible with spark v1 >

[jira] [Created] (SPARK-18579) spark-csv strips whitespace (pyspark)

Adrian Bridgett created SPARK-18579: --- Summary: spark-csv strips whitespace (pyspark) Key: SPARK-18579 URL: https://issues.apache.org/jira/browse/SPARK-18579 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692768#comment-15692768 ] Adrian Bridgett commented on SPARK-18571: - FYI I'm now setting LANG=en_US.UTF-8 in spark-env.sh

[jira] [Updated] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Bridgett updated SPARK-18571: Description: Sample code attached, code run with hadoop 2.7.3, python3.5 If I run this

[jira] [Updated] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Bridgett updated SPARK-18571: Attachment: unicode.py > pyspark: UTF-8 not written correctly (as CSV) when locale is not

[jira] [Commented] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

[ https://issues.apache.org/jira/browse/SPARK-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691299#comment-15691299 ] Adrian Bridgett commented on SPARK-18571: - Note that without the leading integer column I see a

[jira] [Created] (SPARK-18571) pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8

Adrian Bridgett created SPARK-18571: --- Summary: pyspark: UTF-8 not written correctly (as CSV) when locale is not UTF-8 Key: SPARK-18571 URL: https://issues.apache.org/jira/browse/SPARK-18571

[jira] [Commented] (SPARK-12583) spark shuffle fails with mesos after 2mins

[ https://issues.apache.org/jira/browse/SPARK-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144624#comment-15144624 ] Adrian Bridgett commented on SPARK-12583: - Phew - thought maybe it was a bit odd no-one else had

[jira] [Created] (SPARK-13286) JDBC driver doesn't report full exception

Adrian Bridgett created SPARK-13286: --- Summary: JDBC driver doesn't report full exception Key: SPARK-13286 URL: https://issues.apache.org/jira/browse/SPARK-13286 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091792#comment-15091792 ] Adrian Bridgett commented on SPARK-12622: - Hi Ajesh - I'm not sure what more I can add that's not

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087159#comment-15087159 ] Adrian Bridgett commented on SPARK-12622: - Hi Ajesh - I think it's in the mesos-specific Spark

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082653#comment-15082653 ] Adrian Bridgett commented on SPARK-12622: - Ajesh - that'd be a good improvement (I raised the

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082875#comment-15082875 ] Adrian Bridgett commented on SPARK-12622: - Damn - sorry, that's my obfuscation error, so sorry

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082855#comment-15082855 ] Adrian Bridgett commented on SPARK-12622: - The job fails with the ClassNotFound exception, if I

[jira] [Created] (SPARK-12622) spark-submit fails on executors when jar has a space in it

Adrian Bridgett created SPARK-12622: --- Summary: spark-submit fails on executors when jar has a space in it Key: SPARK-12622 URL: https://issues.apache.org/jira/browse/SPARK-12622 Project: Spark

[jira] [Created] (SPARK-12583) spark shuffle fails with mesos after 2mins

Adrian Bridgett created SPARK-12583: --- Summary: spark shuffle fails with mesos after 2mins Key: SPARK-12583 URL: https://issues.apache.org/jira/browse/SPARK-12583 Project: Spark Issue Type:

[jira] [Created] (SPARK-12499) make_distribution should not override MAVEN_OPTS

Adrian Bridgett created SPARK-12499: --- Summary: make_distribution should not override MAVEN_OPTS Key: SPARK-12499 URL: https://issues.apache.org/jira/browse/SPARK-12499 Project: Spark Issue

[jira] [Commented] (SPARK-12499) make_distribution should not override MAVEN_OPTS

[ https://issues.apache.org/jira/browse/SPARK-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15069777#comment-15069777 ] Adrian Bridgett commented on SPARK-12499: - https://github.com/apache/spark/pull/10448 is the

[jira] [Created] (SPARK-12501) spark fails to build with mesos-0.26.0 (secret)

Adrian Bridgett created SPARK-12501: --- Summary: spark fails to build with mesos-0.26.0 (secret) Key: SPARK-12501 URL: https://issues.apache.org/jira/browse/SPARK-12501 Project: Spark Issue

[jira] [Commented] (SPARK-12501) spark fails to build with mesos-0.26.0 (secret)

[ https://issues.apache.org/jira/browse/SPARK-12501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070117#comment-15070117 ] Adrian Bridgett commented on SPARK-12501: - Indeed - I'm not a Scala (or Java) developer so I'm

[jira] [Created] (SPARK-11653) Would be very useful if spark-daemon.sh supported foreground operations

Adrian Bridgett created SPARK-11653: --- Summary: Would be very useful if spark-daemon.sh supported foreground operations Key: SPARK-11653 URL: https://issues.apache.org/jira/browse/SPARK-11653

[jira] [Commented] (SPARK-11653) Would be very useful if spark-daemon.sh supported foreground operations

[ https://issues.apache.org/jira/browse/SPARK-11653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000390#comment-15000390 ] Adrian Bridgett commented on SPARK-11653: - Thanks Sean, I took a slightly different approach -