[jira] [Commented] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051878#comment-16051878 ] Adam Roberts commented on SPARK-20984: -- For the Spark binary package we ship in IBM, we use

[jira] [Updated] (SPARK-19552) Upgrade Netty version to 4.1.8 final

[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-19552: - Description: Netty 4.1.8 was recently released but isn't API compatible with previous major

[jira] [Updated] (SPARK-19552) Upgrade Netty version to 4.1.8 final

[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-19552: - Description: Netty 4.1.8 was recently released but isn't API compatible with previous major

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861494#comment-15861494 ] Adam Roberts commented on SPARK-19552: -- [~srowen] interested in your thoughts and noticed your work

[jira] [Created] (SPARK-19552) Upgrade Netty version to 4.1.8 final

Adam Roberts created SPARK-19552: Summary: Upgrade Netty version to 4.1.8 final Key: SPARK-19552 URL: https://issues.apache.org/jira/browse/SPARK-19552 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18782) Bump Hadoop 2.6 version to use Hadoop 2.6.5

Adam Roberts created SPARK-18782: Summary: Bump Hadoop 2.6 version to use Hadoop 2.6.5 Key: SPARK-18782 URL: https://issues.apache.org/jira/browse/SPARK-18782 Project: Spark Issue Type:

[jira] [Created] (SPARK-18231) Optimise SizeEstimator implementation

Adam Roberts created SPARK-18231: Summary: Optimise SizeEstimator implementation Key: SPARK-18231 URL: https://issues.apache.org/jira/browse/SPARK-18231 Project: Spark Issue Type:

[jira] [Created] (SPARK-18224) Optimise PartitionedPairBuffer implementation

Adam Roberts created SPARK-18224: Summary: Optimise PartitionedPairBuffer implementation Key: SPARK-18224 URL: https://issues.apache.org/jira/browse/SPARK-18224 Project: Spark Issue Type:

[jira] [Created] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

Adam Roberts created SPARK-18223: Summary: Optimise PartitionedAppendOnlyMap implementation Key: SPARK-18223 URL: https://issues.apache.org/jira/browse/SPARK-18223 Project: Spark Issue Type:

[jira] [Created] (SPARK-18197) Optimise AppendOnlyMap implementation

Adam Roberts created SPARK-18197: Summary: Optimise AppendOnlyMap implementation Key: SPARK-18197 URL: https://issues.apache.org/jira/browse/SPARK-18197 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18196) Optimise CompactBuffer implementation

[ https://issues.apache.org/jira/browse/SPARK-18196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-18196: - Component/s: Spark Core > Optimise CompactBuffer implementation >

[jira] [Created] (SPARK-18196) Optimise CompactBuffer implementation

Adam Roberts created SPARK-18196: Summary: Optimise CompactBuffer implementation Key: SPARK-18196 URL: https://issues.apache.org/jira/browse/SPARK-18196 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17624) Flaky test? StateStoreSuite maintenance

[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575683#comment-15575683 ] Adam Roberts commented on SPARK-17624: -- Having another look at this now as it still fails

[jira] [Updated] (SPARK-17624) Flaky test? StateStoreSuite maintenance

[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17624: - Affects Version/s: 2.1.0 > Flaky test? StateStoreSuite maintenance >

[jira] [Created] (SPARK-17828) Changes file missing in Spark 2

Adam Roberts created SPARK-17828: Summary: Changes file missing in Spark 2 Key: SPARK-17828 URL: https://issues.apache.org/jira/browse/SPARK-17828 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-17624) Flaky test? StateStoreSuite maintenance

Adam Roberts created SPARK-17624: Summary: Flaky test? StateStoreSuite maintenance Key: SPARK-17624 URL: https://issues.apache.org/jira/browse/SPARK-17624 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15496699#comment-15496699 ] Adam Roberts commented on SPARK-17564: -- callback1.failure is sometimes null and due to this failing

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Description: Could be related to [SPARK-10680] This is the test and one fix would be to

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Description: Could be related to [SPARK-10680] This is the test and one fix would be to

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Description: Could be related to [SPARK-10680] This is the test and one fix would be to

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Component/s: Tests > Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay >

[jira] [Created] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

Adam Roberts created SPARK-17564: Summary: Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay Key: SPARK-17564 URL: https://issues.apache.org/jira/browse/SPARK-17564 Project: Spark

[jira] [Created] (SPARK-17534) Increase timeouts for DirectKafkaStreamSuite tests

Adam Roberts created SPARK-17534: Summary: Increase timeouts for DirectKafkaStreamSuite tests Key: SPARK-17534 URL: https://issues.apache.org/jira/browse/SPARK-17534 Project: Spark Issue

[jira] [Created] (SPARK-17524) RowBasedKeyValueBatchSuite always uses 64 mb page size

Adam Roberts created SPARK-17524: Summary: RowBasedKeyValueBatchSuite always uses 64 mb page size Key: SPARK-17524 URL: https://issues.apache.org/jira/browse/SPARK-17524 Project: Spark Issue

[jira] [Commented] (SPARK-4633) Support gzip in spark.compression.io.codec

[ https://issues.apache.org/jira/browse/SPARK-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15484488#comment-15484488 ] Adam Roberts commented on SPARK-4633: - Very interested in this and I know Nasser Ebrahim is also (full

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464925#comment-15464925 ] Adam Roberts commented on SPARK-17379: -- Thanks Artur, useful to know, no new tests fail with

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Affects Version/s: 1.6.2 Component/s: Build > Upgrade netty-all to 4.0.41.Final

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464539#comment-15464539 ] Adam Roberts commented on SPARK-17379: -- Title modified to at least mention 4.1.5, no new test

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Summary: Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible) (was: Upgrade netty-all

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Priority: Trivial (was: Minor) > Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[jira] [Updated] (SPARK-17378) Upgrade snappy-java to 1.1.2.6

[ https://issues.apache.org/jira/browse/SPARK-17378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17378: - Description: We should upgrade the snappy-java version to pick up the following fix we see at

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458861#comment-15458861 ] Adam Roberts commented on SPARK-17379: -- Sounds good, testing it out now and then I'll either get the

[jira] [Comment Edited] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458656#comment-15458656 ] Adam Roberts edited comment on SPARK-17379 at 9/2/16 2:18 PM: -- Good point

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458656#comment-15458656 ] Adam Roberts commented on SPARK-17379: -- Good point about the 1.6 stream, this change isn't as

[jira] [Created] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

Adam Roberts created SPARK-17379: Summary: Upgrade netty-all to 4.1.5.Final Key: SPARK-17379 URL: https://issues.apache.org/jira/browse/SPARK-17379 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-17378) Upgrade snappy-java to 1.1.2.6

Adam Roberts created SPARK-17378: Summary: Upgrade snappy-java to 1.1.2.6 Key: SPARK-17378 URL: https://issues.apache.org/jira/browse/SPARK-17378 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399394#comment-15399394 ] Adam Roberts commented on SPARK-16769: -- Btw, thanks for verifying that Spark doesn't actually use

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399388#comment-15399388 ] Adam Roberts commented on SPARK-16769: -- I was aiming to to build and provide a patched

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399089#comment-15399089 ] Adam Roberts commented on SPARK-16769: -- I can do that, cautious that Hive might be a problem here

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398018#comment-15398018 ] Adam Roberts commented on SPARK-16769: -- Thanks, looking on Maven central I see the latest jets3t

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397889#comment-15397889 ] Adam Roberts commented on SPARK-16769: -- [~rxin] [~srowen] Reynold and Sean, interested in what you

[jira] [Created] (SPARK-16769) httpclient classic dependency - potentially a patch required?

Adam Roberts created SPARK-16769: Summary: httpclient classic dependency - potentially a patch required? Key: SPARK-16769 URL: https://issues.apache.org/jira/browse/SPARK-16769 Project: Spark

[jira] [Commented] (SPARK-16751) Upgrade derby to 10.12.1.1 from 10.11.1.1

[ https://issues.apache.org/jira/browse/SPARK-16751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397181#comment-15397181 ] Adam Roberts commented on SPARK-16751: -- But they do download the jar which contains a CVE, so by

[jira] [Updated] (SPARK-16751) Upgrade derby to 10.12.1.1 from 10.11.1.1

[ https://issues.apache.org/jira/browse/SPARK-16751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-16751: - Description: This JIRA is to upgrade the derby version from 10.11.1.1 to 10.12.1.1 Sean and I

[jira] [Created] (SPARK-16751) Upgrade derby to 10.12.1.1 from 10.11.1.1

Adam Roberts created SPARK-16751: Summary: Upgrade derby to 10.12.1.1 from 10.11.1.1 Key: SPARK-16751 URL: https://issues.apache.org/jira/browse/SPARK-16751 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325465#comment-15325465 ] Adam Roberts commented on SPARK-15822: -- I added a link above to the dataset, it's 658mb when

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324475#comment-15324475 ] Adam Roberts edited comment on SPARK-15822 at 6/10/16 9:39 PM: --- Herman,

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324475#comment-15324475 ] Adam Roberts commented on SPARK-15822: -- Herman, here's the application, note my HashedRelation

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324352#comment-15324352 ] Adam Roberts edited comment on SPARK-15822 at 6/10/16 12:16 PM: The

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324352#comment-15324352 ] Adam Roberts commented on SPARK-15822: -- The comment for baseOffset which has the corrupt value

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324341#comment-15324341 ] Adam Roberts commented on SPARK-15822: -- Note that this segv happens regardless of

[jira] [Commented] (SPARK-15821) Should we use mvn -T for multithreaded Spark builds?

[ https://issues.apache.org/jira/browse/SPARK-15821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320614#comment-15320614 ] Adam Roberts commented on SPARK-15821: -- Agreed with your comment on tests, the above pull request is

[jira] [Created] (SPARK-15821) Should we use mvn -T for multithreaded Spark builds?

Adam Roberts created SPARK-15821: Summary: Should we use mvn -T for multithreaded Spark builds? Key: SPARK-15821 URL: https://issues.apache.org/jira/browse/SPARK-15821 Project: Spark Issue

[jira] [Created] (SPARK-15818) Upgrade to Hadoop 2.7.2

Adam Roberts created SPARK-15818: Summary: Upgrade to Hadoop 2.7.2 Key: SPARK-15818 URL: https://issues.apache.org/jira/browse/SPARK-15818 Project: Spark Issue Type: Dependency upgrade

[jira] [Commented] (SPARK-12319) ExchangeCoordinatorSuite fails on big-endian platforms

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312233#comment-15312233 ] Adam Roberts commented on SPARK-12319: -- Lowered priority, this also impacts Spark 2.0.0 but it's of

[jira] [Updated] (SPARK-12319) ExchangeCoordinatorSuite fails on big-endian platforms

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Priority: Minor (was: Critical) > ExchangeCoordinatorSuite fails on big-endian platforms >

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175383#comment-15175383 ] Adam Roberts commented on SPARK-13552: -- Done, both "value" and "row" return the correct result for

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173931#comment-15173931 ] Adam Roberts commented on SPARK-13552: -- Thanks for the suggestion, both JDK vendors use the

[jira] [Issue Comment Deleted] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Comment: was deleted (was: Shows an interesting result with IBM Java with a Long.MinValue test

[jira] [Issue Comment Deleted] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Comment: was deleted (was: Shows the incorrect test result on IBM Java with Long.MinValue) >

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171838#comment-15171838 ] Adam Roberts commented on SPARK-13552: -- Thanks for the quick reply Herman, yep Long.MinValue is the

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Attachment: (was: DefectBadMinValueLong.jpg) > Incorrect data for Long.minValue in

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Attachment: DefectBadMinValueLongResized.jpg Shows the incorrect test result on IBM Java with

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Attachment: DefectBadMinValueLong.jpg Shows an interesting result with IBM Java with a

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer

[jira] [Created] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

Adam Roberts created SPARK-13552: Summary: Incorrect data for Long.minValue in SQLQuerySuite on IBM Java Key: SPARK-13552 URL: https://issues.apache.org/jira/browse/SPARK-13552 Project: Spark

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems apparent on BE, LE could be impacted too (was: Problems are evident on

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems are evident on BE (was: BE platforms) > Address endian specific problems

[jira] [Created] (SPARK-12319) Address endian specific problems surfaced in 1.6

Adam Roberts created SPARK-12319: Summary: Address endian specific problems surfaced in 1.6 Key: SPARK-12319 URL: https://issues.apache.org/jira/browse/SPARK-12319 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Description: JIRA to cover endian specific problems - since testing 1.6 I've noticed problems

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056040#comment-15056040 ] Adam Roberts commented on SPARK-12319: -- Hi Sean, here are the failures ExchangeCoordinatorSuite: -

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052603#comment-15052603 ] Adam Roberts commented on SPARK-9858: - Modifying the UnsafeRowSerializer to always write/read in LE

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048636#comment-15048636 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 1:07 PM: -- Thanks for the

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048636#comment-15048636 ] Adam Roberts commented on SPARK-9858: - Thanks for the prompt reply, rowBuffer is a variable in

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048636#comment-15048636 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 2:35 PM: -- Thanks for the

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049284#comment-15049284 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 10:24 PM: --- Yep, I added

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049284#comment-15049284 ] Adam Roberts commented on SPARK-9858: - Yep, I added System.identityHashCode(serializer) prints in both

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049284#comment-15049284 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 7:53 PM: -- Yep, I added

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049284#comment-15049284 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 7:53 PM: -- Yep, I added

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047194#comment-15047194 ] Adam Roberts edited comment on SPARK-9858 at 12/8/15 6:33 PM: -- Several

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047194#comment-15047194 ] Adam Roberts commented on SPARK-9858: - Several potential issues here, may well not be with this code

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047194#comment-15047194 ] Adam Roberts edited comment on SPARK-9858 at 12/8/15 6:28 PM: -- Several

[jira] [Created] (SPARK-8289) Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests

Adam Roberts created SPARK-8289: --- Summary: Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests Key: SPARK-8289 URL: