Pete Robbins created SPARK-19710:
Summary: Test Failures in SQLQueryTests on big endian platforms
Key: SPARK-19710
URL: https://issues.apache.org/jira/browse/SPARK-19710
Project: Spark
Issue
Pete Robbins created SPARK-18963:
Summary: Test Failuire on big endian;
o.a.s.unsafe.types.UTF8StringSuite.writeToOutputStreamIntArray
Key: SPARK-18963
URL: https://issues.apache.org/jira/browse/SPARK-18963
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571890#comment-15571890
]
Pete Robbins commented on SPARK-17827:
--
I have a PR ready which I will submit as soo
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571546#comment-15571546
]
Pete Robbins commented on SPARK-17827:
--
right so in these two cases maxLength in A
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571348#comment-15571348
]
Pete Robbins edited comment on SPARK-17827 at 10/13/16 9:11 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571348#comment-15571348
]
Pete Robbins edited comment on SPARK-17827 at 10/13/16 9:10 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571348#comment-15571348
]
Pete Robbins commented on SPARK-17827:
--
In Statistics,scala
case class StringColumn
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569048#comment-15569048
]
Pete Robbins commented on SPARK-17827:
--
So this looks like the max field is being wr
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561849#comment-15561849
]
Pete Robbins commented on SPARK-17827:
--
[~ZenWzh] Any ideas what code introduced tha
[
https://issues.apache.org/jira/browse/SPARK-17827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15554825#comment-15554825
]
Pete Robbins commented on SPARK-17827:
--
I'm investigating this
> StatisticsColumnSu
Pete Robbins created SPARK-17827:
Summary: StatisticsColumnSuite failures on big endian platforms
Key: SPARK-17827
URL: https://issues.apache.org/jira/browse/SPARK-17827
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-15822:
-
Component/s: SQL
> segmentation violation in o.a.s.unsafe.types.UTF8String
> ---
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333594#comment-15333594
]
Pete Robbins commented on SPARK-15822:
--
Tracking where the memory is being allocated
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333594#comment-15333594
]
Pete Robbins edited comment on SPARK-15822 at 6/16/16 11:23 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333586#comment-15333586
]
Pete Robbins edited comment on SPARK-15822 at 6/16/16 11:18 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333586#comment-15333586
]
Pete Robbins commented on SPARK-15822:
--
OK so I think I know what is happening!
In
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333462#comment-15333462
]
Pete Robbins commented on SPARK-15822:
--
Tracing through off heap memory allocation
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331580#comment-15331580
]
Pete Robbins commented on SPARK-15822:
--
I can also recreate this issue on Oracle JDK
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331375#comment-15331375
]
Pete Robbins commented on SPARK-15822:
--
and the plan:
{noformat}
== Parsed Logical
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331370#comment-15331370
]
Pete Robbins commented on SPARK-15822:
--
Chatting with [~hvanhovell] here is the curr
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331371#comment-15331371
]
Pete Robbins commented on SPARK-15822:
--
The generated code is:
{code}
Top Arrival C
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329474#comment-15329474
]
Pete Robbins commented on SPARK-15822:
--
modified app to remove .cache()'s and still
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15327992#comment-15327992
]
Pete Robbins commented on SPARK-15822:
--
So this does seem to cause the NPE or SEGV i
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325761#comment-15325761
]
Pete Robbins commented on SPARK-15822:
--
has failed on latest Branch 2.0 and master.
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325759#comment-15325759
]
Pete Robbins commented on SPARK-15822:
--
The stack trace is taken earlier when I dete
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325159#comment-15325159
]
Pete Robbins commented on SPARK-15822:
--
I am forcing a system dump when I detect a c
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325093#comment-15325093
]
Pete Robbins edited comment on SPARK-15822 at 6/10/16 7:17 PM:
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325093#comment-15325093
]
Pete Robbins commented on SPARK-15822:
--
How do I disable whole-stage codegen?
> seg
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324506#comment-15324506
]
Pete Robbins commented on SPARK-15822:
--
generated SMJ code from the stack:
{code}
p
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-15822:
-
Description:
Executors fail with segmentation violation while running application with
spark.memo
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-15822:
-
Summary: segmentation violation in o.a.s.unsafe.types.UTF8String (was:
segmentation violation i
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324331#comment-15324331
]
Pete Robbins commented on SPARK-15822:
--
I'm still looking into this tracing back thr
[
https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15320380#comment-15320380
]
Pete Robbins commented on SPARK-15822:
--
I'm investigating this and will attach the a
Pete Robbins created SPARK-15822:
Summary: segmentation violation in o.a.s.unsafe.types.UTF8String
with spark.memory.offHeap.enabled=true
Key: SPARK-15822
URL: https://issues.apache.org/jira/browse/SPARK-15822
[
https://issues.apache.org/jira/browse/SPARK-15065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15318492#comment-15318492
]
Pete Robbins commented on SPARK-15065:
--
I think this may be related to
https://issu
Pete Robbins created SPARK-15606:
Summary: Driver hang in o.a.s.DistributedSuite on 2 core machine
Key: SPARK-15606
URL: https://issues.apache.org/jira/browse/SPARK-15606
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-15154:
-
Priority: Minor (was: Major)
Summary: LongHashedRelation test fails on Big Endian platform
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276543#comment-15276543
]
Pete Robbins commented on SPARK-15154:
--
I'm convinced the test is invalid. The creat
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 11:20 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 11:14 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273897#comment-15273897
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 11:13 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273897#comment-15273897
]
Pete Robbins commented on SPARK-15154:
--
Is this just a testcase issue where in Hashe
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:28 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:27 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:24 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins edited comment on SPARK-15154 at 5/6/16 10:25 AM:
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273885#comment-15273885
]
Pete Robbins commented on SPARK-15154:
--
[~davies] as you are the author of this code
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-15154:
-
Summary: LongHashedRelation fails on Big Endian platform (was:
HashedRelation fails on Big Endia
[
https://issues.apache.org/jira/browse/SPARK-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-15154:
-
Labels: big-endian (was: )
> HashedRelation fails on Big Endian platform
> -
Pete Robbins created SPARK-15154:
Summary: HashedRelation fails on Big Endian platform
Key: SPARK-15154
URL: https://issues.apache.org/jira/browse/SPARK-15154
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268500#comment-15268500
]
Pete Robbins commented on SPARK-15070:
--
could this be related to https://issues.apac
[
https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268232#comment-15268232
]
Pete Robbins commented on SPARK-13552:
--
[~aroberts] This Jira can be closed as this
[
https://issues.apache.org/jira/browse/SPARK-13552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262482#comment-15262482
]
Pete Robbins commented on SPARK-13552:
--
This is looking like an issue with the IBM i
[
https://issues.apache.org/jira/browse/SPARK-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-14848:
-
Description:
Since this PR https://github.com/apache/spark/pull/10703 for
https://issues.apache.
[
https://issues.apache.org/jira/browse/SPARK-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253816#comment-15253816
]
Pete Robbins commented on SPARK-14848:
--
changing the Java encoder test to use toSet
Pete Robbins created SPARK-14848:
Summary: DatasetSuite - Java encoder fails on Big Endian platforms
Key: SPARK-14848
URL: https://issues.apache.org/jira/browse/SPARK-14848
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240802#comment-15240802
]
Pete Robbins commented on SPARK-13745:
--
I have started working on this. The changes
[
https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211638#comment-15211638
]
Pete Robbins commented on SPARK-14151:
--
Agreed that is the way to go. I was also wor
[
https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15211560#comment-15211560
]
Pete Robbins commented on SPARK-14151:
--
In addition the constructor used by MetricsS
[
https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179507#comment-15179507
]
Pete Robbins edited comment on SPARK-10610 at 3/4/16 8:01 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179507#comment-15179507
]
Pete Robbins commented on SPARK-10610:
--
I think the appId is an important piece of i
[
https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082879#comment-15082879
]
Pete Robbins edited comment on SPARK-12647 at 1/5/16 11:30 AM:
[
https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15082879#comment-15082879
]
Pete Robbins commented on SPARK-12647:
--
@sowen should I close this and move the PR?
Pete Robbins created SPARK-12647:
Summary: 1.6 branch test failure
o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of
reducers: aggregate operator
Key: SPARK-12647
URL: https://issues.apache.o
[
https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068693#comment-15068693
]
Pete Robbins edited comment on SPARK-12470 at 12/22/15 9:47 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068693#comment-15068693
]
Pete Robbins commented on SPARK-12470:
--
I'm fairly sure the code in my PR is correct
[
https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pete Robbins updated SPARK-12470:
-
Component/s: SQL
Summary: Incorrect calculation of row size in
o.a.s.sql.catalyst.express
Pete Robbins created SPARK-12470:
Summary: Incorrect calculation of row size in
o.a.s.catalyst.expressions.codegen.GenerateUnsafeRowJoiner
Key: SPARK-12470
URL: https://issues.apache.org/jira/browse/SPARK-12470
[
https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907841#comment-14907841
]
Pete Robbins commented on SPARK-6873:
-
I no longer see these errors in my 1.5 branch J
[
https://issues.apache.org/jira/browse/SPARK-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904485#comment-14904485
]
Pete Robbins commented on SPARK-9710:
-
The Fix Version for this says 1.5.0 but the PR
[
https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731377#comment-14731377
]
Pete Robbins commented on SPARK-10454:
--
This is another case of not waiting for even
Pete Robbins created SPARK-10454:
Summary: Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch
failures don't cause multiple concurrent attempts for the same map stage
Key: SPARK-10454
URL: https://issues.apa
[
https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729030#comment-14729030
]
Pete Robbins commented on SPARK-9869:
-
should I add this change to the PR for Spark-10
[
https://issues.apache.org/jira/browse/SPARK-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14729024#comment-14729024
]
Pete Robbins commented on SPARK-9869:
-
My pull request build for https://issues.apache
Pete Robbins created SPARK-10431:
Summary: Intermittent test failure in InputOutputMetricsSuite
Key: SPARK-10431
URL: https://issues.apache.org/jira/browse/SPARK-10431
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702705#comment-14702705
]
Pete Robbins commented on SPARK-9644:
-
Thanks. I think this needs to go in to 1.5 to m
[
https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701926#comment-14701926
]
Pete Robbins commented on SPARK-9644:
-
How much slower is the public API? We would onl
[
https://issues.apache.org/jira/browse/SPARK-9644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701202#comment-14701202
]
Pete Robbins commented on SPARK-9644:
-
This change makes assumptions about the impleme
[
https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647322#comment-14647322
]
Pete Robbins commented on SPARK-6873:
-
We've been trying to get a clean build/test usi
79 matches
Mail list logo