[jira] [Created] (SPARK-19710) Test Failures in SQLQueryTests on big endian platforms

2017-02-23 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-19710: Summary: Test Failures in SQLQueryTests on big endian platforms Key: SPARK-19710 URL: https://issues.apache.org/jira/browse/SPARK-19710 Project: Spark Issue

[jira] [Created] (SPARK-18963) Test Failuire on big endian; o.a.s.unsafe.types.UTF8StringSuite.writeToOutputStreamIntArray

2016-12-21 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-18963: Summary: Test Failuire on big endian; o.a.s.unsafe.types.UTF8StringSuite.writeToOutputStreamIntArray Key: SPARK-18963 URL: https://issues.apache.org/jira/browse/SPARK-18963

[jira] [Commented] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-13 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571890#comment-15571890 ] Pete Robbins commented on SPARK-17827: -- I have a PR ready which I will submit as soo

[jira] [Commented] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-13 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571546#comment-15571546 ] Pete Robbins commented on SPARK-17827: -- right so in these two cases maxLength in A

[jira] [Comment Edited] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-13 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571348#comment-15571348 ] Pete Robbins edited comment on SPARK-17827 at 10/13/16 9:11 AM: ---

[jira] [Comment Edited] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-13 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571348#comment-15571348 ] Pete Robbins edited comment on SPARK-17827 at 10/13/16 9:10 AM: ---

[jira] [Commented] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-13 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571348#comment-15571348 ] Pete Robbins commented on SPARK-17827: -- In Statistics,scala case class StringColumn

[jira] [Commented] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-12 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569048#comment-15569048 ] Pete Robbins commented on SPARK-17827: -- So this looks like the max field is being wr

[jira] [Commented] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561849#comment-15561849 ] Pete Robbins commented on SPARK-17827: -- [~ZenWzh] Any ideas what code introduced tha

[jira] [Commented] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-07 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15554825#comment-15554825 ] Pete Robbins commented on SPARK-17827: -- I'm investigating this > StatisticsColumnSu

[jira] [Created] (SPARK-17827) StatisticsColumnSuite failures on big endian platforms

2016-10-07 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-17827: Summary: StatisticsColumnSuite failures on big endian platforms Key: SPARK-17827 URL: https://issues.apache.org/jira/browse/SPARK-17827 Project: Spark Issue

[jira] [Updated] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-16 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15822: - Component/s: SQL > segmentation violation in o.a.s.unsafe.types.UTF8String > ---

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-16 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333594#comment-15333594 ] Pete Robbins commented on SPARK-15822: -- Tracking where the memory is being allocated

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-16 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333594#comment-15333594 ] Pete Robbins edited comment on SPARK-15822 at 6/16/16 11:23 AM: ---

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-16 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333586#comment-15333586 ] Pete Robbins edited comment on SPARK-15822 at 6/16/16 11:18 AM: ---

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-16 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333586#comment-15333586 ] Pete Robbins commented on SPARK-15822: -- OK so I think I know what is happening! In

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-16 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333462#comment-15333462 ] Pete Robbins commented on SPARK-15822: -- Tracing through off heap memory allocation

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-15 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331580#comment-15331580 ] Pete Robbins commented on SPARK-15822: -- I can also recreate this issue on Oracle JDK

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-15 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331375#comment-15331375 ] Pete Robbins commented on SPARK-15822: -- and the plan: {noformat} == Parsed Logical

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-15 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331370#comment-15331370 ] Pete Robbins commented on SPARK-15822: -- Chatting with [~hvanhovell] here is the curr

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-15 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331371#comment-15331371 ] Pete Robbins commented on SPARK-15822: -- The generated code is: {code} Top Arrival C

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-14 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329474#comment-15329474 ] Pete Robbins commented on SPARK-15822: -- modified app to remove .cache()'s and still

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-13 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15327992#comment-15327992 ] Pete Robbins commented on SPARK-15822: -- So this does seem to cause the NPE or SEGV i

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-11 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325761#comment-15325761 ] Pete Robbins commented on SPARK-15822: -- has failed on latest Branch 2.0 and master.

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-11 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325759#comment-15325759 ] Pete Robbins commented on SPARK-15822: -- The stack trace is taken earlier when I dete

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325159#comment-15325159 ] Pete Robbins commented on SPARK-15822: -- I am forcing a system dump when I detect a c

[jira] [Comment Edited] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325093#comment-15325093 ] Pete Robbins edited comment on SPARK-15822 at 6/10/16 7:17 PM:

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325093#comment-15325093 ] Pete Robbins commented on SPARK-15822: -- How do I disable whole-stage codegen? > seg

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324506#comment-15324506 ] Pete Robbins commented on SPARK-15822: -- generated SMJ code from the stack: {code} p

[jira] [Updated] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15822: - Description: Executors fail with segmentation violation while running application with spark.memo

[jira] [Updated] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15822: - Summary: segmentation violation in o.a.s.unsafe.types.UTF8String (was: segmentation violation i

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

2016-06-10 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324331#comment-15324331 ] Pete Robbins commented on SPARK-15822: -- I'm still looking into this tracing back thr

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

2016-06-08 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320380#comment-15320380 ] Pete Robbins commented on SPARK-15822: -- I'm investigating this and will attach the a

[jira] [Created] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true

2016-06-08 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-15822: Summary: segmentation violation in o.a.s.unsafe.types.UTF8String with spark.memory.offHeap.enabled=true Key: SPARK-15822 URL: https://issues.apache.org/jira/browse/SPARK-15822

[jira] [Commented] (SPARK-15065) HiveSparkSubmitSuite's "set spark.sql.warehouse.dir" is flaky

2016-06-07 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15318492#comment-15318492 ] Pete Robbins commented on SPARK-15065: -- I think this may be related to https://issu

[jira] [Created] (SPARK-15606) Driver hang in o.a.s.DistributedSuite on 2 core machine

2016-05-27 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-15606: Summary: Driver hang in o.a.s.DistributedSuite on 2 core machine Key: SPARK-15606 URL: https://issues.apache.org/jira/browse/SPARK-15606 Project: Spark Issue

[jira] [Updated] (SPARK-15154) LongHashedRelation test fails on Big Endian platform

2016-05-09 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15154: - Priority: Minor (was: Major) Summary: LongHashedRelation test fails on Big Endian platform

[jira] [Commented] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-09 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276543#comment-15276543 ] Pete Robbins commented on SPARK-15154: -- I'm convinced the test is invalid. The creat

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 11:20 AM:

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 11:14 AM:

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273897#comment-15273897 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 11:13 AM:

[jira] [Commented] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273897#comment-15273897 ] Pete Robbins commented on SPARK-15154: -- Is this just a testcase issue where in Hashe

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:28 AM:

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:27 AM:

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:24 AM:

[jira] [Comment Edited] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:25 AM:

[jira] [Commented] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-06 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885 ] Pete Robbins commented on SPARK-15154: -- [~davies] as you are the author of this code

[jira] [Updated] (SPARK-15154) LongHashedRelation fails on Big Endian platform

2016-05-05 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15154: - Summary: LongHashedRelation fails on Big Endian platform (was: HashedRelation fails on Big Endia

[jira] [Updated] (SPARK-15154) HashedRelation fails on Big Endian platform

2016-05-05 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-15154: - Labels: big-endian (was: ) > HashedRelation fails on Big Endian platform > -

[jira] [Created] (SPARK-15154) HashedRelation fails on Big Endian platform

2016-05-05 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-15154: Summary: HashedRelation fails on Big Endian platform Key: SPARK-15154 URL: https://issues.apache.org/jira/browse/SPARK-15154 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15070) Data corruption when using Dataset.groupBy[K : Encoder](func: T => K) when data loaded from JSON file.

2016-05-03 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268500#comment-15268500 ] Pete Robbins commented on SPARK-15070: -- could this be related to https://issues.apac

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-05-02 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268232#comment-15268232 ] Pete Robbins commented on SPARK-13552: -- [~aroberts] This Jira can be closed as this

[jira] [Commented] (SPARK-13552) Incorrect data for Long.minValue in SQLQuerySuite on IBM Java

2016-04-28 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262482#comment-15262482 ] Pete Robbins commented on SPARK-13552: -- This is looking like an issue with the IBM i

[jira] [Updated] (SPARK-14848) DatasetSuite - Java encoder fails on Big Endian platforms

2016-04-22 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-14848: - Description: Since this PR https://github.com/apache/spark/pull/10703 for https://issues.apache.

[jira] [Commented] (SPARK-14848) DatasetSuite - Java encoder fails on Big Endian platforms

2016-04-22 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253816#comment-15253816 ] Pete Robbins commented on SPARK-14848: -- changing the Java encoder test to use toSet

[jira] [Created] (SPARK-14848) DatasetSuite - Java encoder fails on Big Endian platforms

2016-04-22 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-14848: Summary: DatasetSuite - Java encoder fails on Big Endian platforms Key: SPARK-14848 URL: https://issues.apache.org/jira/browse/SPARK-14848 Project: Spark Iss

[jira] [Commented] (SPARK-13745) Support columnar in memory representation on Big Endian platforms

2016-04-14 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240802#comment-15240802 ] Pete Robbins commented on SPARK-13745: -- I have started working on this. The changes

[jira] [Commented] (SPARK-14151) Propose to refactor and expose Metrics Sink and Source interface

2016-03-25 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211638#comment-15211638 ] Pete Robbins commented on SPARK-14151: -- Agreed that is the way to go. I was also wor

[jira] [Commented] (SPARK-14151) Propose to expose Metrics Sink and Source interface

2016-03-25 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211560#comment-15211560 ] Pete Robbins commented on SPARK-14151: -- In addition the constructor used by MetricsS

[jira] [Comment Edited] (SPARK-10610) Using AppName instead of AppId in the name of all metrics

2016-03-04 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179507#comment-15179507 ] Pete Robbins edited comment on SPARK-10610 at 3/4/16 8:01 AM: -

[jira] [Commented] (SPARK-10610) Using AppName instead of AppId in the name of all metrics

2016-03-03 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179507#comment-15179507 ] Pete Robbins commented on SPARK-10610: -- I think the appId is an important piece of i

[jira] [Comment Edited] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

2016-01-05 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082879#comment-15082879 ] Pete Robbins edited comment on SPARK-12647 at 1/5/16 11:30 AM:

[jira] [Commented] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

2016-01-05 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082879#comment-15082879 ] Pete Robbins commented on SPARK-12647: -- @sowen should I close this and move the PR?

[jira] [Created] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

2016-01-05 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-12647: Summary: 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator Key: SPARK-12647 URL: https://issues.apache.o

[jira] [Comment Edited] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

2015-12-22 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068693#comment-15068693 ] Pete Robbins edited comment on SPARK-12470 at 12/22/15 9:47 PM: ---

[jira] [Commented] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

2015-12-22 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068693#comment-15068693 ] Pete Robbins commented on SPARK-12470: -- I'm fairly sure the code in my PR is correct

[jira] [Updated] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

2015-12-21 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-12470: - Component/s: SQL Summary: Incorrect calculation of row size in o.a.s.sql.catalyst.express

[jira] [Created] (SPARK-12470) Incorrect calculation of row size in o.a.s.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

2015-12-21 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-12470: Summary: Incorrect calculation of row size in o.a.s.catalyst.expressions.codegen.GenerateUnsafeRowJoiner Key: SPARK-12470 URL: https://issues.apache.org/jira/browse/SPARK-12470

[jira] [Commented] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

2015-09-25 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907841#comment-14907841 ] Pete Robbins commented on SPARK-6873: - I no longer see these errors in my 1.5 branch J

[jira] [Commented] (SPARK-9710) RPackageUtilsSuite fails if R is not installed

2015-09-23 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904485#comment-14904485 ] Pete Robbins commented on SPARK-9710: - The Fix Version for this says 1.5.0 but the PR

[jira] [Commented] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

2015-09-04 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731377#comment-14731377 ] Pete Robbins commented on SPARK-10454: -- This is another case of not waiting for even

[jira] [Created] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

2015-09-04 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-10454: Summary: Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage Key: SPARK-10454 URL: https://issues.apa

[jira] [Commented] (SPARK-9869) InputStreamSuite.socket input stream is flaky in Jenkins

2015-09-03 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729030#comment-14729030 ] Pete Robbins commented on SPARK-9869: - should I add this change to the PR for Spark-10

[jira] [Commented] (SPARK-9869) InputStreamSuite.socket input stream is flaky in Jenkins

2015-09-03 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729024#comment-14729024 ] Pete Robbins commented on SPARK-9869: - My pull request build for https://issues.apache

[jira] [Created] (SPARK-10431) Intermittent test failure in InputOutputMetricsSuite

2015-09-03 Thread Pete Robbins (JIRA)
Pete Robbins created SPARK-10431: Summary: Intermittent test failure in InputOutputMetricsSuite Key: SPARK-10431 URL: https://issues.apache.org/jira/browse/SPARK-10431 Project: Spark Issue Ty

[jira] [Commented] (SPARK-9644) Support update DecimalType with precision > 18 in UnsafeRow

2015-08-19 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702705#comment-14702705 ] Pete Robbins commented on SPARK-9644: - Thanks. I think this needs to go in to 1.5 to m

[jira] [Commented] (SPARK-9644) Support update DecimalType with precision > 18 in UnsafeRow

2015-08-18 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701926#comment-14701926 ] Pete Robbins commented on SPARK-9644: - How much slower is the public API? We would onl

[jira] [Commented] (SPARK-9644) Support update DecimalType with precision > 18 in UnsafeRow

2015-08-18 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701202#comment-14701202 ] Pete Robbins commented on SPARK-9644: - This change makes assumptions about the impleme

[jira] [Commented] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

2015-07-30 Thread Pete Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647322#comment-14647322 ] Pete Robbins commented on SPARK-6873: - We've been trying to get a clean build/test usi