[jira] [Commented] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

2017-06-16 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051878#comment-16051878 ] Adam Roberts commented on SPARK-20984: -- For the Spark binary package we ship in IBM,

[jira] [Updated] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-13 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-19552: - Description: Netty 4.1.8 was recently released but isn't API compatible with previous major vers

[jira] [Updated] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-13 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-19552: - Description: Netty 4.1.8 was recently released but isn't API compatible with previous major vers

[jira] [Commented] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861494#comment-15861494 ] Adam Roberts commented on SPARK-19552: -- [~srowen] interested in your thoughts and no

[jira] [Created] (SPARK-19552) Upgrade Netty version to 4.1.8 final

2017-02-10 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-19552: Summary: Upgrade Netty version to 4.1.8 final Key: SPARK-19552 URL: https://issues.apache.org/jira/browse/SPARK-19552 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18782) Bump Hadoop 2.6 version to use Hadoop 2.6.5

2016-12-08 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-18782: Summary: Bump Hadoop 2.6 version to use Hadoop 2.6.5 Key: SPARK-18782 URL: https://issues.apache.org/jira/browse/SPARK-18782 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-18231) Optimise SizeEstimator implementation

2016-11-02 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-18231: Summary: Optimise SizeEstimator implementation Key: SPARK-18231 URL: https://issues.apache.org/jira/browse/SPARK-18231 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18224) Optimise PartitionedPairBuffer implementation

2016-11-02 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-18224: Summary: Optimise PartitionedPairBuffer implementation Key: SPARK-18224 URL: https://issues.apache.org/jira/browse/SPARK-18224 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-18223) Optimise PartitionedAppendOnlyMap implementation

2016-11-02 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-18223: Summary: Optimise PartitionedAppendOnlyMap implementation Key: SPARK-18223 URL: https://issues.apache.org/jira/browse/SPARK-18223 Project: Spark Issue Type:

[jira] [Created] (SPARK-18197) Optimise AppendOnlyMap implementation

2016-11-01 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-18197: Summary: Optimise AppendOnlyMap implementation Key: SPARK-18197 URL: https://issues.apache.org/jira/browse/SPARK-18197 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-18196) Optimise CompactBuffer implementation

2016-11-01 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-18196: - Component/s: Spark Core > Optimise CompactBuffer implementation > ---

[jira] [Created] (SPARK-18196) Optimise CompactBuffer implementation

2016-11-01 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-18196: Summary: Optimise CompactBuffer implementation Key: SPARK-18196 URL: https://issues.apache.org/jira/browse/SPARK-18196 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-17624) Flaky test? StateStoreSuite maintenance

2016-10-14 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15575683#comment-15575683 ] Adam Roberts commented on SPARK-17624: -- Having another look at this now as it still

[jira] [Updated] (SPARK-17624) Flaky test? StateStoreSuite maintenance

2016-10-14 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17624: - Affects Version/s: 2.1.0 > Flaky test? StateStoreSuite maintenance >

[jira] [Created] (SPARK-17828) Changes file missing in Spark 2

2016-10-07 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17828: Summary: Changes file missing in Spark 2 Key: SPARK-17828 URL: https://issues.apache.org/jira/browse/SPARK-17828 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-17624) Flaky test? StateStoreSuite maintenance

2016-09-21 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17624: Summary: Flaky test? StateStoreSuite maintenance Key: SPARK-17624 URL: https://issues.apache.org/jira/browse/SPARK-17624 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2016-09-16 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15496699#comment-15496699 ] Adam Roberts commented on SPARK-17564: -- callback1.failure is sometimes null and due

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2016-09-16 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Description: Could be related to [SPARK-10680] This is the test and one fix would be to increase

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2016-09-16 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Description: Could be related to [SPARK-10680] This is the test and one fix would be to increase

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2016-09-16 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Description: Could be related to [SPARK-10680] This is the test and one fix would be to increase

[jira] [Updated] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2016-09-16 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17564: - Component/s: Tests > Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay > ---

[jira] [Created] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2016-09-16 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17564: Summary: Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay Key: SPARK-17564 URL: https://issues.apache.org/jira/browse/SPARK-17564 Project: Spark Is

[jira] [Created] (SPARK-17534) Increase timeouts for DirectKafkaStreamSuite tests

2016-09-14 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17534: Summary: Increase timeouts for DirectKafkaStreamSuite tests Key: SPARK-17534 URL: https://issues.apache.org/jira/browse/SPARK-17534 Project: Spark Issue Type

[jira] [Created] (SPARK-17524) RowBasedKeyValueBatchSuite always uses 64 mb page size

2016-09-13 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17524: Summary: RowBasedKeyValueBatchSuite always uses 64 mb page size Key: SPARK-17524 URL: https://issues.apache.org/jira/browse/SPARK-17524 Project: Spark Issue

[jira] [Commented] (SPARK-4633) Support gzip in spark.compression.io.codec

2016-09-12 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15484488#comment-15484488 ] Adam Roberts commented on SPARK-4633: - Very interested in this and I know Nasser Ebrah

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464925#comment-15464925 ] Adam Roberts commented on SPARK-17379: -- Thanks Artur, useful to know, no new tests f

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Affects Version/s: 1.6.2 Component/s: Build > Upgrade netty-all to 4.0.41.Final (4.1.5-

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15464539#comment-15464539 ] Adam Roberts commented on SPARK-17379: -- Title modified to at least mention 4.1.5, no

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Summary: Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible) (was: Upgrade netty-all

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

2016-09-05 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Priority: Trivial (was: Minor) > Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[jira] [Updated] (SPARK-17378) Upgrade snappy-java to 1.1.2.6

2016-09-05 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17378: - Description: We should upgrade the snappy-java version to pick up the following fix we see at ht

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

2016-09-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458861#comment-15458861 ] Adam Roberts commented on SPARK-17379: -- Sounds good, testing it out now and then I'l

[jira] [Comment Edited] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

2016-09-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458656#comment-15458656 ] Adam Roberts edited comment on SPARK-17379 at 9/2/16 2:18 PM: -

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

2016-09-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458656#comment-15458656 ] Adam Roberts commented on SPARK-17379: -- Good point about the 1.6 stream, this change

[jira] [Created] (SPARK-17379) Upgrade netty-all to 4.1.5.Final

2016-09-02 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17379: Summary: Upgrade netty-all to 4.1.5.Final Key: SPARK-17379 URL: https://issues.apache.org/jira/browse/SPARK-17379 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-17378) Upgrade snappy-java to 1.1.2.6

2016-09-02 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-17378: Summary: Upgrade snappy-java to 1.1.2.6 Key: SPARK-17378 URL: https://issues.apache.org/jira/browse/SPARK-17378 Project: Spark Issue Type: Improvement Af

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-07-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399394#comment-15399394 ] Adam Roberts commented on SPARK-16769: -- Btw, thanks for verifying that Spark doesn't

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-07-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399388#comment-15399388 ] Adam Roberts commented on SPARK-16769: -- I was aiming to to build and provide a patch

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-07-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399089#comment-15399089 ] Adam Roberts commented on SPARK-16769: -- I can do that, cautious that Hive might be a

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-07-28 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15398018#comment-15398018 ] Adam Roberts commented on SPARK-16769: -- Thanks, looking on Maven central I see the l

[jira] [Commented] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-07-28 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397889#comment-15397889 ] Adam Roberts commented on SPARK-16769: -- [~rxin] [~srowen] Reynold and Sean, interest

[jira] [Created] (SPARK-16769) httpclient classic dependency - potentially a patch required?

2016-07-28 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-16769: Summary: httpclient classic dependency - potentially a patch required? Key: SPARK-16769 URL: https://issues.apache.org/jira/browse/SPARK-16769 Project: Spark

[jira] [Commented] (SPARK-16751) Upgrade derby to 10.12.1.1 from 10.11.1.1

2016-07-28 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397181#comment-15397181 ] Adam Roberts commented on SPARK-16751: -- But they do download the jar which contains

[jira] [Updated] (SPARK-16751) Upgrade derby to 10.12.1.1 from 10.11.1.1

2016-07-27 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-16751: - Description: This JIRA is to upgrade the derby version from 10.11.1.1 to 10.12.1.1 Sean and I fi

[jira] [Created] (SPARK-16751) Upgrade derby to 10.12.1.1 from 10.11.1.1

2016-07-27 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-16751: Summary: Upgrade derby to 10.12.1.1 from 10.11.1.1 Key: SPARK-16751 URL: https://issues.apache.org/jira/browse/SPARK-16751 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325465#comment-15325465 ] Adam Roberts commented on SPARK-15822: -- I added a link above to the dataset, it's 65

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324475#comment-15324475 ] Adam Roberts edited comment on SPARK-15822 at 6/10/16 9:39 PM:

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324475#comment-15324475 ] Adam Roberts commented on SPARK-15822: -- Herman, here's the application, note my Hash

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

2016-06-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324352#comment-15324352 ] Adam Roberts edited comment on SPARK-15822 at 6/10/16 12:16 PM: ---

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

2016-06-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324352#comment-15324352 ] Adam Roberts commented on SPARK-15822: -- The comment for baseOffset which has the cor

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

2016-06-10 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324341#comment-15324341 ] Adam Roberts commented on SPARK-15822: -- Note that this segv happens regardless of sp

[jira] [Commented] (SPARK-15821) Should we use mvn -T for multithreaded Spark builds?

2016-06-08 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320614#comment-15320614 ] Adam Roberts commented on SPARK-15821: -- Agreed with your comment on tests, the above

[jira] [Created] (SPARK-15821) Should we use mvn -T for multithreaded Spark builds?

2016-06-08 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-15821: Summary: Should we use mvn -T for multithreaded Spark builds? Key: SPARK-15821 URL: https://issues.apache.org/jira/browse/SPARK-15821 Project: Spark Issue Ty

[jira] [Created] (SPARK-15818) Upgrade to Hadoop 2.7.2

2016-06-08 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-15818: Summary: Upgrade to Hadoop 2.7.2 Key: SPARK-15818 URL: https://issues.apache.org/jira/browse/SPARK-15818 Project: Spark Issue Type: Dependency upgrade

[jira] [Commented] (SPARK-12319) ExchangeCoordinatorSuite fails on big-endian platforms

2016-06-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312233#comment-15312233 ] Adam Roberts commented on SPARK-12319: -- Lowered priority, this also impacts Spark 2.

[jira] [Updated] (SPARK-12319) ExchangeCoordinatorSuite fails on big-endian platforms

2016-06-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Priority: Minor (was: Critical) > ExchangeCoordinatorSuite fails on big-endian platforms > -

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-03-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer w

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-03-02 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15175383#comment-15175383 ] Adam Roberts commented on SPARK-13552: -- Done, both "value" and "row" return the corr

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-03-01 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15173931#comment-15173931 ] Adam Roberts commented on SPARK-13552: -- Thanks for the suggestion, both JDK vendors

[jira] [Issue Comment Deleted] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Comment: was deleted (was: Shows an interesting result with IBM Java with a Long.MinValue test in

[jira] [Issue Comment Deleted] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Comment: was deleted (was: Shows the incorrect test result on IBM Java with Long.MinValue) > Inc

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171838#comment-15171838 ] Adam Roberts commented on SPARK-13552: -- Thanks for the quick reply Herman, yep Long.

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Attachment: (was: DefectBadMinValueLong.jpg) > Incorrect data for Long.minValue in SQLQuerySu

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Attachment: DefectBadMinValueLongResized.jpg Shows the incorrect test result on IBM Java with Lon

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Attachment: DefectBadMinValueLong.jpg Shows an interesting result with IBM Java with a Long.MinVa

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer w

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer w

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer w

[jira] [Updated] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-13552: - Description: The Long.minValue test fails on IBM Java 8, we get the following incorrect answer w

[jira] [Created] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-02-29 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-13552: Summary: Incorrect data for Long.minValue in SQLQuerySuite on IBM Java Key: SPARK-13552 URL: https://issues.apache.org/jira/browse/SPARK-13552 Project: Spark

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-18 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems apparent on BE, LE could be impacted too (was: Problems are evident on BE)

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-18 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Environment: Problems are evident on BE (was: BE platforms) > Address endian specific problems s

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-14 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056040#comment-15056040 ] Adam Roberts commented on SPARK-12319: -- Hi Sean, here are the failures ExchangeCoor

[jira] [Updated] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-14 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-12319: - Description: JIRA to cover endian specific problems - since testing 1.6 I've noticed problems wi

[jira] [Created] (SPARK-12319) Address endian specific problems surfaced in 1.6

2015-12-14 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-12319: Summary: Address endian specific problems surfaced in 1.6 Key: SPARK-12319 URL: https://issues.apache.org/jira/browse/SPARK-12319 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-11 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052603#comment-15052603 ] Adam Roberts commented on SPARK-9858: - Modifying the UnsafeRowSerializer to always wri

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049284#comment-15049284 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 10:24 PM: -

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049284#comment-15049284 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 7:53 PM: --

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049284#comment-15049284 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 7:53 PM: --

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049284#comment-15049284 ] Adam Roberts commented on SPARK-9858: - Yep, I added System.identityHashCode(serializer

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048636#comment-15048636 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 2:35 PM: --

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048636#comment-15048636 ] Adam Roberts edited comment on SPARK-9858 at 12/9/15 1:07 PM: --

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-09 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048636#comment-15048636 ] Adam Roberts commented on SPARK-9858: - Thanks for the prompt reply, rowBuffer is a var

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-08 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047194#comment-15047194 ] Adam Roberts edited comment on SPARK-9858 at 12/8/15 6:33 PM: --

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-08 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047194#comment-15047194 ] Adam Roberts edited comment on SPARK-9858 at 12/8/15 6:28 PM: --

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-12-08 Thread Adam Roberts (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047194#comment-15047194 ] Adam Roberts commented on SPARK-9858: - Several potential issues here, may well not be

[jira] [Created] (SPARK-10949) Upgrade Snappy Java to 1.1.2

2015-10-06 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-10949: Summary: Upgrade Snappy Java to 1.1.2 Key: SPARK-10949 URL: https://issues.apache.org/jira/browse/SPARK-10949 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-8289) Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests

2015-06-10 Thread Adam Roberts (JIRA)
Adam Roberts created SPARK-8289: --- Summary: Provide a specific stack size with all Java implementations to prevent stack overflows with certain tests Key: SPARK-8289 URL: https://issues.apache.org/jira/browse/SPARK-8