[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995276#comment-16995276 ] zhao bo commented on SPARK-29106: - Thank you very much, [~shaneknapp]. Sorry for our mistake. Just sent

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979114#comment-16979114 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], If you feel sparkR testing is good with a new job

[jira] [Updated] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo updated SPARK-29106: Attachment: SparkR-and-pyspark36-testing.txt > Add jenkins arm test for spark >

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979050#comment-16979050 ] zhao bo edited comment on SPARK-29106 at 11/21/19 9:08 AM: --- Hi [~shaneknapp],

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979050#comment-16979050 ] zhao bo edited comment on SPARK-29106 at 11/21/19 8:39 AM: --- Hi [~shaneknapp],

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979050#comment-16979050 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], I had success to build apache/arrow in the new ARM

[jira] [Resolved] (SPARK-29944) Spark testing on ARM

[ https://issues.apache.org/jira/browse/SPARK-29944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo resolved SPARK-29944. - Resolution: Invalid > Spark testing on ARM > > > Key: SPARK-29944

[jira] [Closed] (SPARK-29944) Spark testing on ARM

[ https://issues.apache.org/jira/browse/SPARK-29944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo closed SPARK-29944. --- duplicated Jira ISSUE > Spark testing on ARM > > > Key: SPARK-29944 >

[jira] [Commented] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977044#comment-16977044 ] zhao bo commented on SPARK-28467: - https://github.com/apache/spark/pull/25864 > Flaky test:

[jira] [Updated] (SPARK-29944) Spark testing on ARM

[ https://issues.apache.org/jira/browse/SPARK-29944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo updated SPARK-29944: Description: We plan to make spark testing on ARM, via ARM resources and human resources contribute in

[jira] [Commented] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976482#comment-16976482 ] zhao bo commented on SPARK-28467: - https://github.com/apache/spark/pull/25864 > Flaky test:

[jira] [Commented] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976483#comment-16976483 ] zhao bo commented on SPARK-29286: - https://github.com/apache/spark/pull/26021 > UnicodeDecodeError

[jira] [Commented] (SPARK-28433) Incorrect assertion in scala test for aarch64 platform

[ https://issues.apache.org/jira/browse/SPARK-28433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976481#comment-16976481 ] zhao bo commented on SPARK-28433: - https://github.com/apache/spark/pull/25186 > Incorrect assertion in

[jira] [Commented] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976480#comment-16976480 ] zhao bo commented on SPARK-28519: - https://github.com/apache/spark/pull/25279 > Tests failed on aarch64

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976478#comment-16976478 ] zhao bo commented on SPARK-28770: - https://github.com/apache/spark/pull/25673 > Flaky Tests: Test

[jira] [Created] (SPARK-29944) Spark testing on ARM

zhao bo created SPARK-29944: --- Summary: Spark testing on ARM Key: SPARK-29944 URL: https://issues.apache.org/jira/browse/SPARK-29944 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972184#comment-16972184 ] zhao bo commented on SPARK-29106: - And for the above several comments I left, we hope [~shaneknapp], you

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972019#comment-16972019 ] zhao bo commented on SPARK-29106: - The arm worker is back. Sorry for late. > Add jenkins arm test for

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971971#comment-16971971 ] zhao bo commented on SPARK-29106: - Er,, linaro seems in trouble. The VM can not online now. We will try

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971968#comment-16971968 ] zhao bo commented on SPARK-29106: - Thanks very much, [~shaneknapp] .  So apologize that the VM is down

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967673#comment-16967673 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], Sorry for late. We are trying the best to

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958651#comment-16958651 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], Thanks very much for sharing so much things to us.

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957603#comment-16957603 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp], Sorry for disturb. I have some questions about the

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957421#comment-16957421 ] zhao bo commented on SPARK-29106: - Shane, thanks for recheck the #9 build fail, let's see whether the

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955061#comment-16955061 ] zhao bo commented on SPARK-29106: - Thanks [~shaneknapp]. That's great that you will copy a full jenkins

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954879#comment-16954879 ] zhao bo commented on SPARK-29106: - And if possible and you are free, could you please help us to make

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954842#comment-16954842 ] zhao bo commented on SPARK-29106: - Thanks @shane. Correct, the test dependency of pyspark and spark R

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954447#comment-16954447 ] zhao bo commented on SPARK-29106: - The reason to introducing the shell script is that I found if we call

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954445#comment-16954445 ] zhao bo commented on SPARK-29106: - Hi,  I create a pretty simple shell script in 

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954182#comment-16954182 ] zhao bo commented on SPARK-29106: - Thanks [~shaneknapp] , I see it. I see the log show that , the

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953890#comment-16953890 ] zhao bo commented on SPARK-29106: - Thanks [~shaneknapp], yeah the time cost may be too long for the PULL

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953877#comment-16953877 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp] , We had updated the VM configuration like above,

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953858#comment-16953858 ] zhao bo edited comment on SPARK-29106 at 10/17/19 3:55 PM: --- Hi [~shaneknapp]

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953858#comment-16953858 ] zhao bo edited comment on SPARK-29106 at 10/17/19 3:46 PM: --- Hi [~shaneknapp]

[jira] [Comment Edited] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953858#comment-16953858 ] zhao bo edited comment on SPARK-29106 at 10/17/19 3:44 PM: --- Hi [~shaneknapp]

[jira] [Commented] (SPARK-29106) Add jenkins arm test for spark

[ https://issues.apache.org/jira/browse/SPARK-29106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953858#comment-16953858 ] zhao bo commented on SPARK-29106: - Hi [~shaneknapp] Shane, As the whole test take some times, so I can

[jira] [Created] (SPARK-29205) Pyspark tests failed for suspected performance problem on ARM

zhao bo created SPARK-29205: --- Summary: Pyspark tests failed for suspected performance problem on ARM Key: SPARK-29205 URL: https://issues.apache.org/jira/browse/SPARK-29205 Project: Spark Issue

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921224#comment-16921224 ] zhao bo commented on SPARK-28770: - Hi guys, Thank you very much for your concern. I had post an PR for

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920009#comment-16920009 ] zhao bo commented on SPARK-28770: - Thanks Lim, yeah, we also found that most test jobs will pass towards

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912821#comment-16912821 ] zhao bo commented on SPARK-28770: - Hi team, is there any update about this issue? > Flaky Tests: Test

[jira] [Commented] (SPARK-28770) Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911081#comment-16911081 ] zhao bo commented on SPARK-28770: - Hi Team, could you please to look this problem if you have times? We