[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions
[
https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764450#comment-17764450
]
BingKun Pan commented on SPARK-44580:
-
[https://github.com/apache/spark/pull/42862]
All errors occur in StreamingAggregationSuite
> RocksDB crashed when testing in GitHub Actions
> --
>
> Key: SPARK-44580
> URL: https://issues.apache.org/jira/browse/SPARK-44580
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
>Affects Versions: 3.5.0, 4.0.0
>Reporter: Yang Jie
>Priority: Major
> Attachments: image-2023-08-09-20-26-11-507.png,
> image-2023-08-10-09-44-19-341.png
>
>
> [https://github.com/LuciferYang/spark/actions/runs/5666554831/job/15395578871]
>
> {code:java}
> #
> 17177# A fatal error has been detected by the Java Runtime Environment:
> 17178#
> 17179# SIGSEGV (0xb) at pc=0x7f8a077d2743, pid=4403,
> tid=0x7f89cadff640
> 17180#
> 17181# JRE version: OpenJDK Runtime Environment (8.0_372-b07) (build
> 1.8.0_372-b07)
> 17182# Java VM: OpenJDK 64-Bit Server VM (25.372-b07 mixed mode linux-amd64
> compressed oops)
> 17183# Problematic frame:
> 17184# C [librocksdbjni886380103972770161.so+0x3d2743]
> rocksdb::DBImpl::FailIfCfHasTs(rocksdb::ColumnFamilyHandle const*) const+0x23
> 17185#
> 17186# Failed to write core dump. Core dumps have been disabled. To enable
> core dumping, try "ulimit -c unlimited" before starting Java again
> 17187#
> 17188# An error report file with more information is saved as:
> 17189# /home/runner/work/spark/spark/sql/core/hs_err_pid4403.log
> 17190#
> 17191# If you would like to submit a bug report, please visit:
> 17192# https://github.com/adoptium/adoptium-support/issues
> 17193# The crash happened outside the Java Virtual Machine in native code.
> 17194# See problematic frame for where to report the bug.
> 17195# {code}
>
> This is my first time encountering this problem, and I am unsure of the root
> cause now
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions
[
https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752572#comment-17752572
]
BingKun Pan commented on SPARK-44580:
-
I have observed the logs of the above cases, and there are logs similar to
!image-2023-08-10-09-44-19-341.png! before each crash
> RocksDB crashed when testing in GitHub Actions
> --
>
> Key: SPARK-44580
> URL: https://issues.apache.org/jira/browse/SPARK-44580
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
>Affects Versions: 3.5.0, 4.0.0
>Reporter: Yang Jie
>Priority: Major
> Attachments: image-2023-08-09-20-26-11-507.png,
> image-2023-08-10-09-44-19-341.png
>
>
> [https://github.com/LuciferYang/spark/actions/runs/5666554831/job/15395578871]
>
> {code:java}
> #
> 17177# A fatal error has been detected by the Java Runtime Environment:
> 17178#
> 17179# SIGSEGV (0xb) at pc=0x7f8a077d2743, pid=4403,
> tid=0x7f89cadff640
> 17180#
> 17181# JRE version: OpenJDK Runtime Environment (8.0_372-b07) (build
> 1.8.0_372-b07)
> 17182# Java VM: OpenJDK 64-Bit Server VM (25.372-b07 mixed mode linux-amd64
> compressed oops)
> 17183# Problematic frame:
> 17184# C [librocksdbjni886380103972770161.so+0x3d2743]
> rocksdb::DBImpl::FailIfCfHasTs(rocksdb::ColumnFamilyHandle const*) const+0x23
> 17185#
> 17186# Failed to write core dump. Core dumps have been disabled. To enable
> core dumping, try "ulimit -c unlimited" before starting Java again
> 17187#
> 17188# An error report file with more information is saved as:
> 17189# /home/runner/work/spark/spark/sql/core/hs_err_pid4403.log
> 17190#
> 17191# If you would like to submit a bug report, please visit:
> 17192# https://github.com/adoptium/adoptium-support/issues
> 17193# The crash happened outside the Java Virtual Machine in native code.
> 17194# See problematic frame for where to report the bug.
> 17195# {code}
>
> This is my first time encountering this problem, and I am unsure of the root
> cause now
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions
[
https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752564#comment-17752564
]
BingKun Pan commented on SPARK-44580:
-
>From this error, it seems that it is caused by the absence of `dfsRootDir`
> RocksDB crashed when testing in GitHub Actions
> --
>
> Key: SPARK-44580
> URL: https://issues.apache.org/jira/browse/SPARK-44580
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
>Affects Versions: 3.5.0, 4.0.0
>Reporter: Yang Jie
>Priority: Major
> Attachments: image-2023-08-09-20-26-11-507.png
>
>
> [https://github.com/LuciferYang/spark/actions/runs/5666554831/job/15395578871]
>
> {code:java}
> #
> 17177# A fatal error has been detected by the Java Runtime Environment:
> 17178#
> 17179# SIGSEGV (0xb) at pc=0x7f8a077d2743, pid=4403,
> tid=0x7f89cadff640
> 17180#
> 17181# JRE version: OpenJDK Runtime Environment (8.0_372-b07) (build
> 1.8.0_372-b07)
> 17182# Java VM: OpenJDK 64-Bit Server VM (25.372-b07 mixed mode linux-amd64
> compressed oops)
> 17183# Problematic frame:
> 17184# C [librocksdbjni886380103972770161.so+0x3d2743]
> rocksdb::DBImpl::FailIfCfHasTs(rocksdb::ColumnFamilyHandle const*) const+0x23
> 17185#
> 17186# Failed to write core dump. Core dumps have been disabled. To enable
> core dumping, try "ulimit -c unlimited" before starting Java again
> 17187#
> 17188# An error report file with more information is saved as:
> 17189# /home/runner/work/spark/spark/sql/core/hs_err_pid4403.log
> 17190#
> 17191# If you would like to submit a bug report, please visit:
> 17192# https://github.com/adoptium/adoptium-support/issues
> 17193# The crash happened outside the Java Virtual Machine in native code.
> 17194# See problematic frame for where to report the bug.
> 17195# {code}
>
> This is my first time encountering this problem, and I am unsure of the root
> cause now
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions
[
https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752402#comment-17752402
]
Yang Jie commented on SPARK-44580:
--
A new crash case
[https://github.com/yaooqinn/spark/actions/runs/5805477173/job/15736662791]
!image-2023-08-09-20-26-11-507.png!
> RocksDB crashed when testing in GitHub Actions
> --
>
> Key: SPARK-44580
> URL: https://issues.apache.org/jira/browse/SPARK-44580
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
>Affects Versions: 3.5.0, 4.0.0
>Reporter: Yang Jie
>Priority: Major
>
> [https://github.com/LuciferYang/spark/actions/runs/5666554831/job/15395578871]
>
> {code:java}
> #
> 17177# A fatal error has been detected by the Java Runtime Environment:
> 17178#
> 17179# SIGSEGV (0xb) at pc=0x7f8a077d2743, pid=4403,
> tid=0x7f89cadff640
> 17180#
> 17181# JRE version: OpenJDK Runtime Environment (8.0_372-b07) (build
> 1.8.0_372-b07)
> 17182# Java VM: OpenJDK 64-Bit Server VM (25.372-b07 mixed mode linux-amd64
> compressed oops)
> 17183# Problematic frame:
> 17184# C [librocksdbjni886380103972770161.so+0x3d2743]
> rocksdb::DBImpl::FailIfCfHasTs(rocksdb::ColumnFamilyHandle const*) const+0x23
> 17185#
> 17186# Failed to write core dump. Core dumps have been disabled. To enable
> core dumping, try "ulimit -c unlimited" before starting Java again
> 17187#
> 17188# An error report file with more information is saved as:
> 17189# /home/runner/work/spark/spark/sql/core/hs_err_pid4403.log
> 17190#
> 17191# If you would like to submit a bug report, please visit:
> 17192# https://github.com/adoptium/adoptium-support/issues
> 17193# The crash happened outside the Java Virtual Machine in native code.
> 17194# See problematic frame for where to report the bug.
> 17195# {code}
>
> This is my first time encountering this problem, and I am unsure of the root
> cause now
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions
[
https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751447#comment-17751447
]
Yang Jie commented on SPARK-44580:
--
A new crash case
[https://github.com/apache/spark/actions/runs/5776211318/job/15655092778]
{code:java}
#
18752# A fatal error has been detected by the Java Runtime Environment:
18753#
18754# SIGSEGV (0xb) at pc=0x7f738a9d2743, pid=4842, tid=0x7f739a9ff640
18755#
18756# JRE version: OpenJDK Runtime Environment (8.0_372-b07) (build
1.8.0_372-b07)
18757# Java VM: OpenJDK 64-Bit Server VM (25.372-b07 mixed mode linux-amd64
compressed oops)
18758# Problematic frame:
18759# C [librocksdbjni7743674876323810807.so+0x3d2743]
rocksdb::DBImpl::FailIfCfHasTs(rocksdb::ColumnFamilyHandle const*) const+0x23
18760#
18761# Failed to write core dump. Core dumps have been disabled. To enable core
dumping, try "ulimit -c unlimited" before starting Java again
18762#
18763# An error report file with more information is saved as:
18764# /home/runner/work/spark/spark/sql/core/hs_err_pid4842.log
18765#
18766# If you would like to submit a bug report, please visit:
18767# https://github.com/adoptium/adoptium-support/issues
18768# The crash happened outside the Java Virtual Machine in native code.
18769# See problematic frame for where to report the bug.
18770#
18771Warning: Unable to read from client, please check on client for further
details of the problem.
18772
18773Session terminated, killing shell... ...killed. {code}
> RocksDB crashed when testing in GitHub Actions
> --
>
> Key: SPARK-44580
> URL: https://issues.apache.org/jira/browse/SPARK-44580
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
>Affects Versions: 3.5.0, 4.0.0
>Reporter: Yang Jie
>Priority: Major
>
> [https://github.com/LuciferYang/spark/actions/runs/5666554831/job/15395578871]
>
> {code:java}
> #
> 17177# A fatal error has been detected by the Java Runtime Environment:
> 17178#
> 17179# SIGSEGV (0xb) at pc=0x7f8a077d2743, pid=4403,
> tid=0x7f89cadff640
> 17180#
> 17181# JRE version: OpenJDK Runtime Environment (8.0_372-b07) (build
> 1.8.0_372-b07)
> 17182# Java VM: OpenJDK 64-Bit Server VM (25.372-b07 mixed mode linux-amd64
> compressed oops)
> 17183# Problematic frame:
> 17184# C [librocksdbjni886380103972770161.so+0x3d2743]
> rocksdb::DBImpl::FailIfCfHasTs(rocksdb::ColumnFamilyHandle const*) const+0x23
> 17185#
> 17186# Failed to write core dump. Core dumps have been disabled. To enable
> core dumping, try "ulimit -c unlimited" before starting Java again
> 17187#
> 17188# An error report file with more information is saved as:
> 17189# /home/runner/work/spark/spark/sql/core/hs_err_pid4403.log
> 17190#
> 17191# If you would like to submit a bug report, please visit:
> 17192# https://github.com/adoptium/adoptium-support/issues
> 17193# The crash happened outside the Java Virtual Machine in native code.
> 17194# See problematic frame for where to report the bug.
> 17195# {code}
>
> This is my first time encountering this problem, and I am unsure of the root
> cause now
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
