Hi Sam,

I pulled the latest version. Tests are not failing anymore, but looking at
the .out, it seems that the Balsara0 test fails and stalls execution of the
entire testsuite.

I am attaching the .out for the test.

Best,
Gabriele

On Fri, Oct 20, 2023 at 2:32 PM Cupp, Samuel D. <scu...@my.apsu.edu> wrote:

> Hi Gabriele,
>    It looks like some of the failures are in GRHayLHD. I've been having
> trouble getting consistent output with nproc>1. The data doesn't change, it
> just gets rearranged in the datafile. I made changes to the tests this
> week, so could you rerun the GRHayLHD tests and tell me if they fail? If
> they do, I'll change the tests so that they only run for nproc=1.
>
> I don't know why it would take that long to run, however. Nothing in the
> ET CI suggests it should take that long, best I can tell. Do you have an
> idea of which test is taking so long?
>
>    Samuel Cupp
>    Postdoctoral Researcher
>    Department of Physics
>    University of Idaho
> ------------------------------
> *From:* Users <users-boun...@einsteintoolkit.org> on behalf of Gabriele
> Bozzola <bozzola.gabri...@gmail.com>
> *Sent:* Thursday, October 19, 2023 5:46 PM
> *To:* Steven R. Brandt <sbra...@cct.lsu.edu>
> *Cc:* users@einsteintoolkit.org <users@einsteintoolkit.org>
> *Subject:* Re: [Users] meeting minutes for 2023-10-19
>
> Hello,
>
> Is there a tested configuration for anvil?
>
> I compiled it one last weekend and ran the tests with the master branch. I
> found a few failures in the
> MPI runs, and the test suite does not complete even with a walltime of 6
> hours.
>
> I am attaching the output.
>
> Best,
> Gabriele
>
> On Thu, Oct 19, 2023 at 7:36 AM Steven R. Brandt <sbra...@cct.lsu.edu>
> wrote:
>
> Present: Steve, Peter, Sam, Zach, Leo
>
> Release
>      Gallery Examples
>      - TOV is Peter
>      - BBH is Steve
>      - Roland might have students for the other three?
>      Tests
>      - Need to be run
>      - Clusters:
>          Stampede2 isn't listed, and Delta and Anvil are added.
>      - Release name: Lise Meitner
> https://en.wikipedia.org/wiki/Lise_Meitner
>      - Autogenerated codes need to be regenerated, Leo will do it
>
> Mailing list moderation
>      - Remind Roland to send Peter the password
>
> Unanswered question on the mailing list
>      - Need answer for Enzo. Roland was going to answer?
>      - Ticket 2749: Leo says he fixed it.
>      - Ticket 2647: One of Zach's students is looking at that in Grail (sp)
>      - Ticket 2609: Steve thinks he approved PR for Roland
>
> _______________________________________________
> Users mailing list
> Users@einsteintoolkit.org
> http://lists.einsteintoolkit.org/mailman/listinfo/users
>
>
/anvil/scratch/x-bozzola/simulations/ettests_2proc_again/output-0000/TEST/sim/GRHayLHDX
Preparing:
+ set -e
+ cd output-0000-active
+ module list
++ /opt/lmod/lmod/libexec/lmod bash list

Currently Loaded Modules:
  1) xalt/2.10.45     (S)   7) gcc/11.2.0      13) boost/1.74.0
  2) modtree/cpu            8) numactl/2.0.14  14) papi/6.0.0.1
  3) libfabric/1.12.0       9) libszip/2.1.1   15) fftw/3.3.8
  4) gmp/6.2.1             10) openmpi/4.0.6   16) hdf5/1.10.7
  5) mpfr/4.0.2            11) gsl/2.4         17) openblas/0.3.17
  6) mpc/1.1.0             12) zlib/1.2.11     18) python/3.9.5

  Where:
   S:  Module is Sticky, requires --force to unload or purge

 

+ eval 'MODULEPATH=/opt/spack/cpu-20211007/openmpi/4.0.6-3navcwb/gcc/11.2.0:/opt/spack/cpu-20211007/gcc/11.2.0:/opt/spack/cpu/Core;' export 'MODULEPATH;' '_ModuleTable001_=X01vZHVsZVRhYmxlXyA9IHsKTVR2ZXJzaW9uID0gMywKY19yZWJ1aWxkVGltZSA9IGZhbHNlLApjX3Nob3J0VGltZSA9IGZhbHNlLApkZXB0aFQgPSB7fSwKZmFtaWx5ID0gewpjb21waWxlciA9ICJnY2MiLAptcGkgPSAib3Blbm1waSIsCnB5dGhvbiA9ICJweXRob24iLAp9LAptVCA9IHsKYm9vc3QgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L29wZW5tcGkvNC4wLjYtM25hdmN3Yi9nY2MvMTEuMi4wL2Jvb3N0LzEuNzQuMC5sdWEiLApmdWxsTmFtZSA9ICJib29zdC8xLjc0LjAiLApsb2FkT3JkZXIgPSAxMywKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJib29zdC8xLjc0LjAiLAp3ViA9ICJeMDAw;' export '_ModuleTable001_;' '_ModuleTable002_=MDAwMDEuMDAwMDAwMDc0Lip6ZmluYWwiLAp9LApmZnR3ID0gewpmbiA9ICIvb3B0L3NwYWNrL2NwdS0yMDIxMTAwNy9vcGVubXBpLzQuMC42LTNuYXZjd2IvZ2NjLzExLjIuMC9mZnR3LzMuMy44Lmx1YSIsCmZ1bGxOYW1lID0gImZmdHcvMy4zLjgiLApsb2FkT3JkZXIgPSAxNSwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJmZnR3LzMuMy44IiwKd1YgPSAiXjAwMDAwMDAzLjAwMDAwMDAwMy4wMDAwMDAwMDguKnpmaW5hbCIsCn0sCmdjYyA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9nY2MvMTEuMi4wLmx1YSIsCmZ1bGxOYW1lID0gImdjYy8xMS4yLjAiLApsb2FkT3JkZXIgPSA3LApwcm9wVCA9IHt9LApz;' export '_ModuleTable002_;' '_ModuleTable003_=dGFja0RlcHRoID0gMCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gImdjYy8xMS4yLjAiLAp3ViA9ICJeMDAwMDAwMTEuMDAwMDAwMDAyLip6ZmluYWwiLAp9LApnbXAgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvZ21wLzYuMi4xLmx1YSIsCmZ1bGxOYW1lID0gImdtcC82LjIuMSIsCmxvYWRPcmRlciA9IDQsCnByb3BUID0ge30sCnJlZl9jb3VudCA9IDMsCnN0YWNrRGVwdGggPSAxLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAiZ21wLzYuMi4xIiwKd1YgPSAiMDAwMDAwMDA2LjAwMDAwMDAwMi4wMDAwMDAwMDEuKnpmaW5hbCIsCn0sCmdzbCA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9nc2wvMi40Lmx1YSIs;' export '_ModuleTable003_;' '_ModuleTable004_=CmZ1bGxOYW1lID0gImdzbC8yLjQiLApsb2FkT3JkZXIgPSAxMSwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJnc2wvMi40IiwKd1YgPSAiMDAwMDAwMDAyLjAwMDAwMDAwNC4qemZpbmFsIiwKfSwKaGRmNSA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvb3Blbm1waS80LjAuNi0zbmF2Y3diL2djYy8xMS4yLjAvaGRmNS8xLjEwLjcubHVhIiwKZnVsbE5hbWUgPSAiaGRmNS8xLjEwLjciLApsb2FkT3JkZXIgPSAxNiwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJoZGY1LzEuMTAuNyIsCndWID0gIl4wMDAwMDAwMS4wMDAwMDAwMTAuMDAwMDAw;' export '_ModuleTable004_;' '_ModuleTable005_=MDA3Lip6ZmluYWwiLAp9LApsaWJmYWJyaWMgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1L0NvcmUvbGliZmFicmljLzEuMTIuMC5sdWEiLApmdWxsTmFtZSA9ICJsaWJmYWJyaWMvMS4xMi4wIiwKbG9hZE9yZGVyID0gMywKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJsaWJmYWJyaWMvMS4xMi4wIiwKd1YgPSAiMDAwMDAwMDAxLjAwMDAwMDAxMi4qemZpbmFsIiwKfSwKbGlic3ppcCA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMC9saWJzemlwLzIuMS4xLmx1YSIsCmZ1bGxOYW1lID0gImxpYnN6aXAvMi4xLjEiLApsb2FkT3JkZXIgPSA5LApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0g;' export '_ModuleTable005_;' '_ModuleTable006_=MCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gImxpYnN6aXAvMi4xLjEiLAp3ViA9ICIwMDAwMDAwMDIuMDAwMDAwMDAxLjAwMDAwMDAwMS4qemZpbmFsIiwKfSwKbW9kdHJlZSA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9tb2R0cmVlL2NwdS5sdWEiLApmdWxsTmFtZSA9ICJtb2R0cmVlL2NwdSIsCmxvYWRPcmRlciA9IDIsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAibW9kdHJlZS9jcHUiLAp3ViA9ICIqY3B1Lip6ZmluYWwiLAp9LAptcGMgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1L0NvcmUvbXBjLzEuMS4wLmx1YSIsCmZ1bGxOYW1lID0gIm1wYy8xLjEuMCIsCmxvYWRPcmRlciA9IDYsCnBy;' export '_ModuleTable006_;' '_ModuleTable007_=b3BUID0ge30sCnJlZl9jb3VudCA9IDEsCnN0YWNrRGVwdGggPSAxLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAibXBjLzEuMS4wIiwKd1YgPSAiMDAwMDAwMDAxLjAwMDAwMDAwMS4qemZpbmFsIiwKfSwKbXBmciA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMC9tcGZyLzQuMC4yLmx1YSIsCmZ1bGxOYW1lID0gIm1wZnIvNC4wLjIiLApsb2FkT3JkZXIgPSA1LApwcm9wVCA9IHt9LApyZWZfY291bnQgPSAyLApzdGFja0RlcHRoID0gMiwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gIm1wZnIvNC4wLjIiLAp3ViA9ICIwMDAwMDAwMDQuMDAwMDAwMDAwLjAwMDAwMDAwMi4qemZpbmFsIiwKfSwKbnVtYWN0bCA9IHsKZm4gPSAi;' export '_ModuleTable007_;' '_ModuleTable008_=L29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMC9udW1hY3RsLzIuMC4xNC5sdWEiLApmdWxsTmFtZSA9ICJudW1hY3RsLzIuMC4xNCIsCmxvYWRPcmRlciA9IDgsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAibnVtYWN0bC8yLjAuMTQiLAp3ViA9ICIwMDAwMDAwMDIuMDAwMDAwMDAwLjAwMDAwMDAxNC4qemZpbmFsIiwKfSwKb3BlbmJsYXMgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvb3BlbmJsYXMvMC4zLjE3Lmx1YSIsCmZ1bGxOYW1lID0gIm9wZW5ibGFzLzAuMy4xNyIsCmxvYWRPcmRlciA9IDE3LApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMCwKc3RhdHVzID0g;' export '_ModuleTable008_;' '_ModuleTable009_=ImFjdGl2ZSIsCnVzZXJOYW1lID0gIm9wZW5ibGFzLzAuMy4xNyIsCndWID0gIl4wMDAwMDAwMC4wMDAwMDAwMDMuMDAwMDAwMDE3Lip6ZmluYWwiLAp9LApvcGVubXBpID0gewpmbiA9ICIvb3B0L3NwYWNrL2NwdS0yMDIxMTAwNy9nY2MvMTEuMi4wL29wZW5tcGkvNC4wLjYubHVhIiwKZnVsbE5hbWUgPSAib3Blbm1waS80LjAuNiIsCmxvYWRPcmRlciA9IDEwLApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gIm9wZW5tcGkvNC4wLjYiLAp3ViA9ICJeMDAwMDAwMDQuMDAwMDAwMDAwLjAwMDAwMDAwNi4qemZpbmFsIiwKfSwKcGFwaSA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9wYXBpLzYuMC4wLjEubHVhIiwK;' export '_ModuleTable009_;' '_ModuleTable010_=ZnVsbE5hbWUgPSAicGFwaS82LjAuMC4xIiwKbG9hZE9yZGVyID0gMTQsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAicGFwaS82LjAuMC4xIiwKd1YgPSAiMDAwMDAwMDA2LjAwMDAwMDAwMC4wMDAwMDAwMDAuMDAwMDAwMDAxLip6ZmluYWwiLAp9LApweXRob24gPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvcHl0aG9uLzMuOS41Lmx1YSIsCmZ1bGxOYW1lID0gInB5dGhvbi8zLjkuNSIsCmxvYWRPcmRlciA9IDE4LApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gInB5dGhvbi8zLjkuNSIsCndWID0gIjAwMDAwMDAwMy4wMDAw;' export '_ModuleTable010_;' '_ModuleTable011_=MDAwMDkuMDAwMDAwMDA1Lip6ZmluYWwiLAp9LAp4YWx0ID0gewpmbiA9ICIvb3B0L3NwYWNrL2NwdS9Db3JlL3hhbHQvMi4xMC40NS5sdWEiLApmdWxsTmFtZSA9ICJ4YWx0LzIuMTAuNDUiLApsb2FkT3JkZXIgPSAxLApwcm9wVCA9IHsKbG1vZCA9IHsKc3RpY2t5ID0gMSwKfSwKfSwKc3RhY2tEZXB0aCA9IDEsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJ4YWx0IiwKd1YgPSAiMDAwMDAwMDAyLjAwMDAwMDAxMC4wMDAwMDAwNDUuKnpmaW5hbCIsCn0sCnpsaWIgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvemxpYi8xLjIuMTEubHVhIiwKZnVsbE5hbWUgPSAiemxpYi8xLjIuMTEiLApsb2FkT3JkZXIgPSAxMiwKcHJvcFQgPSB7;' export '_ModuleTable011_;' '_ModuleTable012_=fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJ6bGliLzEuMi4xMSIsCndWID0gIjAwMDAwMDAwMS4wMDAwMDAwMDIuMDAwMDAwMDExLip6ZmluYWwiLAp9LAp9LAptcGF0aEEgPSB7CiIvb3B0L3NwYWNrL2NwdS0yMDIxMTAwNy9vcGVubXBpLzQuMC42LTNuYXZjd2IvZ2NjLzExLjIuMCIKLCAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMCIsICIvb3B0L3NwYWNrL2NwdS9Db3JlIiwKfSwKc3lzdGVtQmFzZU1QQVRIID0gIi9vcHQvc3BhY2svY3B1L0NvcmUiLAp9Cg==;' export '_ModuleTable012_;' '_ModuleTable_Sz_=12;' export '_ModuleTable_Sz_;'
++ MODULEPATH=/opt/spack/cpu-20211007/openmpi/4.0.6-3navcwb/gcc/11.2.0:/opt/spack/cpu-20211007/gcc/11.2.0:/opt/spack/cpu/Core
++ export MODULEPATH
++ _ModuleTable001_=X01vZHVsZVRhYmxlXyA9IHsKTVR2ZXJzaW9uID0gMywKY19yZWJ1aWxkVGltZSA9IGZhbHNlLApjX3Nob3J0VGltZSA9IGZhbHNlLApkZXB0aFQgPSB7fSwKZmFtaWx5ID0gewpjb21waWxlciA9ICJnY2MiLAptcGkgPSAib3Blbm1waSIsCnB5dGhvbiA9ICJweXRob24iLAp9LAptVCA9IHsKYm9vc3QgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L29wZW5tcGkvNC4wLjYtM25hdmN3Yi9nY2MvMTEuMi4wL2Jvb3N0LzEuNzQuMC5sdWEiLApmdWxsTmFtZSA9ICJib29zdC8xLjc0LjAiLApsb2FkT3JkZXIgPSAxMywKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJib29zdC8xLjc0LjAiLAp3ViA9ICJeMDAw
++ export _ModuleTable001_
++ _ModuleTable002_=MDAwMDEuMDAwMDAwMDc0Lip6ZmluYWwiLAp9LApmZnR3ID0gewpmbiA9ICIvb3B0L3NwYWNrL2NwdS0yMDIxMTAwNy9vcGVubXBpLzQuMC42LTNuYXZjd2IvZ2NjLzExLjIuMC9mZnR3LzMuMy44Lmx1YSIsCmZ1bGxOYW1lID0gImZmdHcvMy4zLjgiLApsb2FkT3JkZXIgPSAxNSwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJmZnR3LzMuMy44IiwKd1YgPSAiXjAwMDAwMDAzLjAwMDAwMDAwMy4wMDAwMDAwMDguKnpmaW5hbCIsCn0sCmdjYyA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9nY2MvMTEuMi4wLmx1YSIsCmZ1bGxOYW1lID0gImdjYy8xMS4yLjAiLApsb2FkT3JkZXIgPSA3LApwcm9wVCA9IHt9LApz
++ export _ModuleTable002_
++ _ModuleTable003_=dGFja0RlcHRoID0gMCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gImdjYy8xMS4yLjAiLAp3ViA9ICJeMDAwMDAwMTEuMDAwMDAwMDAyLip6ZmluYWwiLAp9LApnbXAgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvZ21wLzYuMi4xLmx1YSIsCmZ1bGxOYW1lID0gImdtcC82LjIuMSIsCmxvYWRPcmRlciA9IDQsCnByb3BUID0ge30sCnJlZl9jb3VudCA9IDMsCnN0YWNrRGVwdGggPSAxLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAiZ21wLzYuMi4xIiwKd1YgPSAiMDAwMDAwMDA2LjAwMDAwMDAwMi4wMDAwMDAwMDEuKnpmaW5hbCIsCn0sCmdzbCA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9nc2wvMi40Lmx1YSIs
++ export _ModuleTable003_
++ _ModuleTable004_=CmZ1bGxOYW1lID0gImdzbC8yLjQiLApsb2FkT3JkZXIgPSAxMSwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJnc2wvMi40IiwKd1YgPSAiMDAwMDAwMDAyLjAwMDAwMDAwNC4qemZpbmFsIiwKfSwKaGRmNSA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvb3Blbm1waS80LjAuNi0zbmF2Y3diL2djYy8xMS4yLjAvaGRmNS8xLjEwLjcubHVhIiwKZnVsbE5hbWUgPSAiaGRmNS8xLjEwLjciLApsb2FkT3JkZXIgPSAxNiwKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJoZGY1LzEuMTAuNyIsCndWID0gIl4wMDAwMDAwMS4wMDAwMDAwMTAuMDAwMDAw
++ export _ModuleTable004_
++ _ModuleTable005_=MDA3Lip6ZmluYWwiLAp9LApsaWJmYWJyaWMgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1L0NvcmUvbGliZmFicmljLzEuMTIuMC5sdWEiLApmdWxsTmFtZSA9ICJsaWJmYWJyaWMvMS4xMi4wIiwKbG9hZE9yZGVyID0gMywKcHJvcFQgPSB7fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJsaWJmYWJyaWMvMS4xMi4wIiwKd1YgPSAiMDAwMDAwMDAxLjAwMDAwMDAxMi4qemZpbmFsIiwKfSwKbGlic3ppcCA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMC9saWJzemlwLzIuMS4xLmx1YSIsCmZ1bGxOYW1lID0gImxpYnN6aXAvMi4xLjEiLApsb2FkT3JkZXIgPSA5LApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0g
++ export _ModuleTable005_
++ _ModuleTable006_=MCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gImxpYnN6aXAvMi4xLjEiLAp3ViA9ICIwMDAwMDAwMDIuMDAwMDAwMDAxLjAwMDAwMDAwMS4qemZpbmFsIiwKfSwKbW9kdHJlZSA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9tb2R0cmVlL2NwdS5sdWEiLApmdWxsTmFtZSA9ICJtb2R0cmVlL2NwdSIsCmxvYWRPcmRlciA9IDIsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAibW9kdHJlZS9jcHUiLAp3ViA9ICIqY3B1Lip6ZmluYWwiLAp9LAptcGMgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1L0NvcmUvbXBjLzEuMS4wLmx1YSIsCmZ1bGxOYW1lID0gIm1wYy8xLjEuMCIsCmxvYWRPcmRlciA9IDYsCnBy
++ export _ModuleTable006_
++ _ModuleTable007_=b3BUID0ge30sCnJlZl9jb3VudCA9IDEsCnN0YWNrRGVwdGggPSAxLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAibXBjLzEuMS4wIiwKd1YgPSAiMDAwMDAwMDAxLjAwMDAwMDAwMS4qemZpbmFsIiwKfSwKbXBmciA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMC9tcGZyLzQuMC4yLmx1YSIsCmZ1bGxOYW1lID0gIm1wZnIvNC4wLjIiLApsb2FkT3JkZXIgPSA1LApwcm9wVCA9IHt9LApyZWZfY291bnQgPSAyLApzdGFja0RlcHRoID0gMiwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gIm1wZnIvNC4wLjIiLAp3ViA9ICIwMDAwMDAwMDQuMDAwMDAwMDAwLjAwMDAwMDAwMi4qemZpbmFsIiwKfSwKbnVtYWN0bCA9IHsKZm4gPSAi
++ export _ModuleTable007_
++ _ModuleTable008_=L29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMC9udW1hY3RsLzIuMC4xNC5sdWEiLApmdWxsTmFtZSA9ICJudW1hY3RsLzIuMC4xNCIsCmxvYWRPcmRlciA9IDgsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAibnVtYWN0bC8yLjAuMTQiLAp3ViA9ICIwMDAwMDAwMDIuMDAwMDAwMDAwLjAwMDAwMDAxNC4qemZpbmFsIiwKfSwKb3BlbmJsYXMgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvb3BlbmJsYXMvMC4zLjE3Lmx1YSIsCmZ1bGxOYW1lID0gIm9wZW5ibGFzLzAuMy4xNyIsCmxvYWRPcmRlciA9IDE3LApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMCwKc3RhdHVzID0g
++ export _ModuleTable008_
++ _ModuleTable009_=ImFjdGl2ZSIsCnVzZXJOYW1lID0gIm9wZW5ibGFzLzAuMy4xNyIsCndWID0gIl4wMDAwMDAwMC4wMDAwMDAwMDMuMDAwMDAwMDE3Lip6ZmluYWwiLAp9LApvcGVubXBpID0gewpmbiA9ICIvb3B0L3NwYWNrL2NwdS0yMDIxMTAwNy9nY2MvMTEuMi4wL29wZW5tcGkvNC4wLjYubHVhIiwKZnVsbE5hbWUgPSAib3Blbm1waS80LjAuNiIsCmxvYWRPcmRlciA9IDEwLApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gIm9wZW5tcGkvNC4wLjYiLAp3ViA9ICJeMDAwMDAwMDQuMDAwMDAwMDAwLjAwMDAwMDAwNi4qemZpbmFsIiwKfSwKcGFwaSA9IHsKZm4gPSAiL29wdC9zcGFjay9jcHUvQ29yZS9wYXBpLzYuMC4wLjEubHVhIiwK
++ export _ModuleTable009_
++ _ModuleTable010_=ZnVsbE5hbWUgPSAicGFwaS82LjAuMC4xIiwKbG9hZE9yZGVyID0gMTQsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAicGFwaS82LjAuMC4xIiwKd1YgPSAiMDAwMDAwMDA2LjAwMDAwMDAwMC4wMDAwMDAwMDAuMDAwMDAwMDAxLip6ZmluYWwiLAp9LApweXRob24gPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvcHl0aG9uLzMuOS41Lmx1YSIsCmZ1bGxOYW1lID0gInB5dGhvbi8zLjkuNSIsCmxvYWRPcmRlciA9IDE4LApwcm9wVCA9IHt9LApzdGFja0RlcHRoID0gMCwKc3RhdHVzID0gImFjdGl2ZSIsCnVzZXJOYW1lID0gInB5dGhvbi8zLjkuNSIsCndWID0gIjAwMDAwMDAwMy4wMDAw
++ export _ModuleTable010_
++ _ModuleTable011_=MDAwMDkuMDAwMDAwMDA1Lip6ZmluYWwiLAp9LAp4YWx0ID0gewpmbiA9ICIvb3B0L3NwYWNrL2NwdS9Db3JlL3hhbHQvMi4xMC40NS5sdWEiLApmdWxsTmFtZSA9ICJ4YWx0LzIuMTAuNDUiLApsb2FkT3JkZXIgPSAxLApwcm9wVCA9IHsKbG1vZCA9IHsKc3RpY2t5ID0gMSwKfSwKfSwKc3RhY2tEZXB0aCA9IDEsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJ4YWx0IiwKd1YgPSAiMDAwMDAwMDAyLjAwMDAwMDAxMC4wMDAwMDAwNDUuKnpmaW5hbCIsCn0sCnpsaWIgPSB7CmZuID0gIi9vcHQvc3BhY2svY3B1LTIwMjExMDA3L2djYy8xMS4yLjAvemxpYi8xLjIuMTEubHVhIiwKZnVsbE5hbWUgPSAiemxpYi8xLjIuMTEiLApsb2FkT3JkZXIgPSAxMiwKcHJvcFQgPSB7
++ export _ModuleTable011_
++ _ModuleTable012_=fSwKc3RhY2tEZXB0aCA9IDAsCnN0YXR1cyA9ICJhY3RpdmUiLAp1c2VyTmFtZSA9ICJ6bGliLzEuMi4xMSIsCndWID0gIjAwMDAwMDAwMS4wMDAwMDAwMDIuMDAwMDAwMDExLip6ZmluYWwiLAp9LAp9LAptcGF0aEEgPSB7CiIvb3B0L3NwYWNrL2NwdS0yMDIxMTAwNy9vcGVubXBpLzQuMC42LTNuYXZjd2IvZ2NjLzExLjIuMCIKLCAiL29wdC9zcGFjay9jcHUtMjAyMTEwMDcvZ2NjLzExLjIuMCIsICIvb3B0L3NwYWNrL2NwdS9Db3JlIiwKfSwKc3lzdGVtQmFzZU1QQVRIID0gIi9vcHQvc3BhY2svY3B1L0NvcmUiLAp9Cg==
++ export _ModuleTable012_
++ _ModuleTable_Sz_=12
++ export _ModuleTable_Sz_
++ : -s sh
+ eval
+ echo Checking:
Checking:
+ pwd
/anvil/scratch/x-bozzola/simulations/ettests_2proc_again/output-0000/TEST/sim/GRHayLHDX/output-0000-active
+ hostname
a974.anvil.rcac.purdue.edu
+ date
Tue Oct 24 10:16:52 EDT 2023
+ echo Environment:
Environment:
+ export CACTUS_NUM_PROCS=2
+ CACTUS_NUM_PROCS=2
+ export CACTUS_NUM_THREADS=64
+ CACTUS_NUM_THREADS=64
+ export CXX_MAX_TASKS=500
+ CXX_MAX_TASKS=500
+ export GMON_OUT_PREFIX=gmon.out
+ GMON_OUT_PREFIX=gmon.out
+ export OMP_MAX_TASKS=500
+ OMP_MAX_TASKS=500
+ export OMP_NUM_THREADS=64
+ OMP_NUM_THREADS=64
+ export OMP_STACKSIZE=8192
+ OMP_STACKSIZE=8192
+ export PTHREAD_MAX_TASKS=500
+ PTHREAD_MAX_TASKS=500
+ env
+ sort
+ echo a974
+ echo Starting:
Starting:
++ date +%s
+ export CACTUS_STARTTIME=1698157012
+ CACTUS_STARTTIME=1698157012
+ srun -n 2 /anvil/scratch/x-bozzola/simulations/ettests_2proc_again/SIMFACTORY/exe/cactus_sim -L 3 /anvil/scratch/x-bozzola/simulations/ettests_2proc_again/output-0000/arrangements/GRHayLET/GRHayLHDX/test/Balsara0.par
INFO (Cactus): Increased logging level from 0 to 3
--------------------------------------------------------------------------------

       10                                  
  1   0101       ************************  
  01  1010 10      The Cactus Code V4.14.0    
 1010 1101 011      www.cactuscode.org     
  1001 100101    ************************  
    00010101                               
     100011     (c) Copyright The Authors  
      0100      GNU Licensed. No Warranty  
      0101                                 
--------------------------------------------------------------------------------

Cactus version:    4.14.0
Compile date:      Oct 24 2023 (10:04:56)
Run date:          Oct 24 2023 (10:16:53-0400)
Run host:          a974.anvil.rcac.purdue.edu (pid=1895570)
Working directory: /anvil/scratch/x-bozzola/simulations/ettests_2proc_again/output-0000/TEST/sim/GRHayLHDX
Executable:        /anvil/scratch/x-bozzola/simulations/ettests_2proc_again/SIMFACTORY/exe/cactus_sim
Parameter file:    /anvil/scratch/x-bozzola/simulations/ettests_2proc_again/output-0000/arrangements/GRHayLET/GRHayLHDX/test/Balsara0.par
--------------------------------------------------------------------------------

Activating thorn Cactus...Success -> active implementation Cactus
Activation requested for 
--->CarpetX IOUtil ODESolvers ADMBaseX HydroBaseX TmunuBaseX GRHayLib GRHayLHDX GRHayLIDX<---
Thorn ADMBaseX requests automatic activation of Loop
Thorn CarpetX requests automatic activation of AMReX
Thorn CarpetX requests automatic activation of MPI
Thorn CarpetX requests automatic activation of yaml_cpp
Thorn CarpetX requests automatic activation of zlib
Thorn CarpetX requests automatic activation of Arith
Thorn CarpetX requests automatic activation of ADIOS2
Thorn CarpetX requests automatic activation of openPMD
Thorn CarpetX requests automatic activation of Silo
Thorn GRHayLHDX requests automatic activation of HDF5
Thorn Arith requests automatic activation of NSIMD
Thorn MPI requests automatic activation of hwloc
Activating thorn ADIOS2...Success -> active implementation ADIOS2
Activating thorn ADMBaseX...Success -> active implementation ADMBaseX
Activating thorn AMReX...Success -> active implementation AMReX
Activating thorn Arith...Success -> active implementation Arith
Activating thorn CarpetX...Success -> active implementation CarpetX
Activating thorn GRHayLHDX...Success -> active implementation GRHayLHDX
Activating thorn GRHayLib...Success -> active implementation GRHayLib
Activating thorn GRHayLIDX...Success -> active implementation GRHayLIDX
Activating thorn HDF5...Success -> active implementation HDF5
Activating thorn hwloc...Success -> active implementation hwloc
Activating thorn HydroBaseX...Success -> active implementation HydroBaseX
Activating thorn IOUtil...Success -> active implementation IO
Activating thorn Loop...Success -> active implementation Loop
Activating thorn MPI...Success -> active implementation MPI
Activating thorn NSIMD...Success -> active implementation NSIMD
Activating thorn ODESolvers...Success -> active implementation ODESolvers
Activating thorn openPMD...Success -> active implementation openPMD
Activating thorn Silo...Success -> active implementation Silo
Activating thorn TmunuBaseX...Success -> active implementation TmunuBaseX
Activating thorn yaml_cpp...Success -> active implementation yaml_cpp
Activating thorn zlib...Success -> active implementation zlib
--------------------------------------------------------------------------------
  if (recover initial data)
    Recover parameters
  endif

  Startup routines
    [CCTK_STARTUP]
      CarpetX::Driver_Startup: Start up the driver
      IOUtil::IOUtil_Startup: Startup routine
      GROUP hwloc_startup: hwloc startup group
        hwloc::hwloc_version: Output hwloc version

  Startup routines which need an existing grid hierarchy
    [CCTK_WRAGH]
      Arith::Test_smallvector: [meta] Test small vectors
      Arith::Test_spvect: [meta] Test sparse vectors
      GRHayLib::GRHayLib_initialize: [global] Set up the EOS struct and read the table for tabulated EOS.
  Parameter checking routines
    [CCTK_PARAMCHECK]

  Initialisation
    if (NOT (recover initial data AND recovery_mode is 'strict'))
      [CCTK_PREREGRIDINITIAL]
      Set up grid hierarchy
      [CCTK_POSTREGRIDINITIAL]
      [CCTK_BASEGRID]
        CarpetX::CarpetX_InitError: Initialize regridding error to zero
        GROUP ODESolvers_BaseGrid: Set up constants (e.g. coordinates) everywhere on the grid
      [CCTK_INITIAL]
        GROUP ADMBaseX_InitialData: Schedule group for calculating ADM initial data
          ADMBaseX::ADMBaseX_initial_data: Set up Cartesian Minkowski initial data
        GROUP ADMBaseX_InitialGauge: Schedule group for the ADM initial gauge condition
          ADMBaseX::ADMBaseX_initial_lapse: Set lapse to one
          ADMBaseX::ADMBaseX_initial_shift: Set shift to zero
        GROUP ADMBaseX_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise
        GROUP HydroBaseX_InitialData: Schedule group for calculating hydro initial data
          GRHayLIDX::GRHayLIDX_1D_tests_hydro_data: Set initial hydrodynamic data for 1D test
        GROUP HydroBaseX_PostInitial: Schedule group for modifying the hydro initial data, such as e.g. adding noise
          GROUP GRHayLHDX_Prim2Con2Prim: Translate ET-generated, HydroBaseX-compatible initial data and convert into variables used by GRHayLHDX
            GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers.
            GRHayLHDX::convert_HydroBase_to_GRHayLHDX: Convert HydroBaseX initial data (ID) to GRHayLHDX variables and enforce simulation limits on primitives.
            GRHayLHDX::GRHayLHDX_prims_to_conservs: Enforce simulation limits on primitives and compute conservatives
            GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder.
        GROUP ODESolvers_Initial: Set up initial conditions on interior of state vector
        GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
          TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
          GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
            GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
      [CCTK_POSTINITIAL]
        GROUP ODESolvers_PostStep: Apply boundary conditions to state vector, and project if necessary
          GROUP ADMBaseX_SetADMVars: Set ADM variables in this group
          GROUP ADMBaseX_SetADMRHS: Set ADM RHS variables in this group
          GROUP GRHayLHDX_Con2Prim: Compute the cell-centered spacetime quantities and solve for primitives
            GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers
            GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives
          GROUP HydroBaseX_SetHydroVars: Set hydro variables in this group, or before this group
          GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
            TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
            GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
              GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
        GROUP ODESolvers_RHS: Evaluate RHS for of state vector everywhere on the grid
          GROUP GRHayLHDX_RHS: Evaluate RHSs GRHD equations
            GRHayLHDX::GRHayLHDX_compute_ccc_centered_extrinsic_curvature: Interpolate extrinsic curvature to cell centers
            GRHayLHDX::GRHayLHDX_evaluate_sources_rhs: Initialize RHS variables to zero and evalute extrinsic curvature source term of tau_rhs
            GRHayLHDX::GRHayLHDX_evaluate_fluxes: Compute GRHD fluxes
            GRHayLHDX::GRHayLHDX_evaluate_fluxes_rhs: Evaluate RHSs of GRHD equations
        GROUP ODESolvers_EstimateError: Estimate discretization error (for regridding)
      Initialise finer grids recursively
      Restrict from finer grids
      [CCTK_POSTRESTRICTINITIAL]
      [CCTK_POSTPOSTINITIAL]
      [CCTK_POSTSTEP]
        GROUP ODESolvers_PostStep: Apply boundary conditions to state vector, and project if necessary
          GROUP ADMBaseX_SetADMVars: Set ADM variables in this group
          GROUP ADMBaseX_SetADMRHS: Set ADM RHS variables in this group
          GROUP GRHayLHDX_Con2Prim: Compute the cell-centered spacetime quantities and solve for primitives
            GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers
            GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives
          GROUP HydroBaseX_SetHydroVars: Set hydro variables in this group, or before this group
          GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
            TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
            GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
              GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
        GROUP ODESolvers_RHS: Evaluate the RHS for of state vector everywhere on the grid
          GROUP GRHayLHDX_RHS: Evaluate RHSs GRHD equations
            GRHayLHDX::GRHayLHDX_compute_ccc_centered_extrinsic_curvature: Interpolate extrinsic curvature to cell centers
            GRHayLHDX::GRHayLHDX_evaluate_sources_rhs: Initialize RHS variables to zero and evalute extrinsic curvature source term of tau_rhs
            GRHayLHDX::GRHayLHDX_evaluate_fluxes: Compute GRHD fluxes
            GRHayLHDX::GRHayLHDX_evaluate_fluxes_rhs: Evaluate RHSs of GRHD equations
        GROUP ODESolvers_EstimateError: Estimate discretization error (for regridding)
    endif
    if (recover initial data)
      [CCTK_BASEGRID]
        CarpetX::CarpetX_InitError: Initialize regridding error to zero
        GROUP ODESolvers_BaseGrid: Set up constants (e.g. coordinates) everywhere on the grid
      [CCTK_RECOVER_VARIABLES]
      [CCTK_POST_RECOVER_VARIABLES]
    endif
    if (checkpoint initial data)
      [CCTK_CPINITIAL]
        CarpetX::CarpetX_CheckpointInitial: [meta] Checkpoint initial conditions
    endif
    if (analysis)
      [CCTK_ANALYSIS]
        GROUP ODESolvers_Analysis: Calculate analysis quantities everywhere
  endif
  Output grid variables

  do loop over timesteps
    [CCTK_PREREGRID]
    Change grid hierarchy
    [CCTK_POSTREGRID]
      GROUP ODESolvers_PostStep: Apply boundary conditions to state vector, and project if necessary
        GROUP ADMBaseX_SetADMVars: Set ADM variables in this group
        GROUP ADMBaseX_SetADMRHS: Set ADM RHS variables in this group
        GROUP GRHayLHDX_Con2Prim: Compute the cell-centered spacetime quantities and solve for primitives
          GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers
          GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives
        GROUP HydroBaseX_SetHydroVars: Set hydro variables in this group, or before this group
        GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
          TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
          GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
            GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
    Rotate timelevels
    iteration = iteration+1
    t = t+dt
    [CCTK_PRESTEP]
    [CCTK_EVOL]
      ODESolvers::ODESolvers_Solve: [level] Solve ODEs
    Evolve finer grids recursively
    Restrict from finer grids
    [CCTK_POSTRESTRICT]
      GROUP ODESolvers_PostStep: Apply boundary conditions to state vector, and project if necessary
        GROUP ADMBaseX_SetADMVars: Set ADM variables in this group
        GROUP ADMBaseX_SetADMRHS: Set ADM RHS variables in this group
        GROUP GRHayLHDX_Con2Prim: Compute the cell-centered spacetime quantities and solve for primitives
          GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers
WARNING[L1,P0] (hwloc): library version 1.11.13, build-time API version 0x10b06, run-time API version 0x20500
          GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives
        GROUP HydroBaseX_SetHydroVars: Set hydro variables in this group, or before this group
        GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
          TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
          GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
            GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
    [CCTK_POSTSTEP]
      GROUP ODESolvers_PostStep: Apply boundary conditions to state vector, and project if necessary
        GROUP ADMBaseX_SetADMVars: Set ADM variables in this group
        GROUP ADMBaseX_SetADMRHS: Set ADM RHS variables in this group
        GROUP GRHayLHDX_Con2Prim: Compute the cell-centered spacetime quantities and solve for primitives
          GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers
          GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives
        GROUP HydroBaseX_SetHydroVars: Set hydro variables in this group, or before this group
        GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
          TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
          GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
            GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
      GROUP ODESolvers_RHS: Evaluate the RHS for of state vector everywhere on the grid
        GROUP GRHayLHDX_RHS: Evaluate RHSs GRHD equations
          GRHayLHDX::GRHayLHDX_compute_ccc_centered_extrinsic_curvature: Interpolate extrinsic curvature to cell centers
          GRHayLHDX::GRHayLHDX_evaluate_sources_rhs: Initialize RHS variables to zero and evalute extrinsic curvature source term of tau_rhs
          GRHayLHDX::GRHayLHDX_evaluate_fluxes: Compute GRHD fluxes
          GRHayLHDX::GRHayLHDX_evaluate_fluxes_rhs: Evaluate RHSs of GRHD equations
      GROUP ODESolvers_EstimateError: Estimate discretization error (for regridding)
    if (checkpoint)
      [CCTK_CHECKPOINT]
      CarpetX::CarpetX_Checkpoint: [meta] Checkpoint
    endif
    if (analysis)
      [CCTK_ANALYSIS]
      GROUP ODESolvers_Analysis: Calculate analysis quantities everywhere
    endif
    Output grid variables
    enddo

  Termination routines
    [CCTK_TERMINATE]
      CarpetX::CarpetX_CheckpointTerminate: [meta] Checkpoint before terminating
      GRHayLib::GRHayLib_terminate: [global] Free memory allocated for the EOS struct.

  Shutdown routines
    [CCTK_SHUTDOWN]
      CarpetX::Driver_Shutdown: [meta] Shut down the driver

  Routines run after changing the grid hierarchy:
    [CCTK_POSTREGRID]
      GROUP ODESolvers_PostStep: Apply boundary conditions to state vector, and project if necessary
        GROUP ADMBaseX_SetADMVars: Set ADM variables in this group
        GROUP ADMBaseX_SetADMRHS: Set ADM RHS variables in this group
        GROUP GRHayLHDX_Con2Prim: Compute the cell-centered spacetime quantities and solve for primitives
          GRHayLHDX::GRHayLHDX_compute_ccc_centered_spacetime_quantities: Interpolate spacetime quantities to cell centers
          GRHayLHDX::GRHayLHDX_conservs_to_prims: Compute primitive variables from conservatives
        GROUP HydroBaseX_SetHydroVars: Set hydro variables in this group, or before this group
        GROUP TmunuBaseX_SetTmunuVars: Schedule group for setting T_munu
          TmunuBaseX::TmunuBaseX_ZeroTmunu: Set T_munu to zero
          GROUP TmunuBaseX_AddToTmunu: Add to T_munu here
            GRHayLHDX::GRHayLHDX_compute_Tmunu: Interpolate stress-energy tensor to vertices
--------------------------------------------------------------------------------
WARNING[L1,P0] (hwloc): library version 1.11.13, build-time API version 0x10b06, run-time API version 0x20500
INFO (hwloc): library version 1.11.13, API version 0x10b06
--------------------------------------------------------------------------------

    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
  ──██────██────██────██────██────██────██────██────██──  
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    
  ──██──██████──██────██──██████──██────██──██████──██──  
    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
  ──██────██────██────██────██────██────██────██────██──  
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
    ▕▏    ▕▏    ▕▏  ██████████████████  ▕▏    ▕▏    ▕▏    
  ──██────██────██──██████████████████──██────██────██──  
    ▕▏    ▕▏    ▕▏  ██████████████████  ▕▏    ▕▏    ▕▏    
    ▕▏  ██████  ▕▏  ██████████████████  ▕▏  ██████  ▕▏    
  ──██──██████──██──██████████████████──██──██████──██──  
    ▕▏  ██████  ▕▏  ██████████████████  ▕▏  ██████  ▕▏    
    ▕▏    ▕▏    ▕▏  ██████████████████  ▕▏    ▕▏    ▕▏    
  ──██────██────██──██████████████████──██────██────██──  
    ▕▏    ▕▏    ▕▏  ██████████████████  ▕▏    ▕▏    ▕▏    
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
  ──██────██────██────██────██────██────██────██────██──  
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    
  ──██──██████──██────██──██████──██────██──██████──██──  
WARNING[L1,P1] (hwloc): library version 1.11.13, build-time API version 0x10b06, run-time API version 0x20500
    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    ▕▏  ██████  ▕▏    
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    
  ──██────██────██────██────██────██────██────██────██──  
    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    ▕▏    

AMR driver provided by CarpetX,
using AMReX 23.08 (MPI, OpenMP, no accelerators, debug)
--------------------------------------------------------------------------------

MPI initialized with 2 MPI processes
MPI initialized with thread support level 2
OMP initialized with 64 OMP threads
AMReX (23.08) initialized
(GRHayL) Warning in file: /anvil/projects/x-phy190020/Cactus/arrangements/GRHayL/GRHayLib/src/GRHayL_Core/initialize_eos.c, line: 68, function: ghl_initialize_simple_eos
(GRHayL) Warning message: Maximum density not provided. Disabling density ceiling (rho_max = 1e300)
(GRHayL) Warning in file: /anvil/projects/x-phy190020/Cactus/arrangements/GRHayL/GRHayLib/src/GRHayL_Core/initialize_eos.c, line: 75, function: ghl_initialize_simple_eos
(GRHayL) Warning message: Minimum pressure not provided. Disabling pressure floor (press_min = 0)
(GRHayL) Warning in file: /anvil/projects/x-phy190020/Cactus/arrangements/GRHayL/GRHayLib/src/GRHayL_Core/initialize_eos.c, line: 79, function: ghl_initialize_simple_eos
(GRHayL) Warning message: Maximum pressure not provided. Disabling pressure ceiling (press_max = 1e300)
(GRHayL) Warning in file: /anvil/projects/x-phy190020/Cactus/arrangements/GRHayL/GRHayLib/src/GRHayL_Core/initialize_eos.c, line: 68, function: ghl_initialize_simple_eos
(GRHayL) Warning message: Maximum density not provided. Disabling density ceiling (rho_max = 1e300)
(GRHayL) Warning in file: /anvil/projects/x-phy190020/Cactus/arrangements/GRHayL/GRHayLib/src/GRHayL_Core/initialize_eos.c, line: 75, function: ghl_initialize_simple_eos
(GRHayL) Warning message: Minimum pressure not provided. Disabling pressure floor (press_min = 0)
(GRHayL) Warning in file: /anvil/projects/x-phy190020/Cactus/arrangements/GRHayL/GRHayLib/src/GRHayL_Core/initialize_eos.c, line: 79, function: ghl_initialize_simple_eos
(GRHayL) Warning message: Maximum pressure not provided. Disabling pressure ceiling (press_max = 1e300)
INFO (CarpetX): 
Symmetries:
  lower x: none
  lower y: none
  lower z: none
  upper x: none
  upper y: none
  upper z: none
Default boundaries:
  lower x: linear_extrapolation
  lower y: linear_extrapolation
  lower z: linear_extrapolation
  upper x: linear_extrapolation
  upper y: linear_extrapolation
  upper z: linear_extrapolation
INFO (Arith): Test_smallvector
INFO (Arith): Test_spvect
INFO (CarpetX): Setting up initial conditions...
INFO (CarpetX): Iteration: 0   time: 0   delta_time: 0.00125
INFO (CarpetX): Patch 0:
INFO (CarpetX):   Grid extent:
INFO (CarpetX):     gsh=[407,15,15]
INFO (CarpetX):     blocking_factor=[1,1,1]
INFO (CarpetX):     max_grid_size=[32,32,32]
INFO (CarpetX):     max_tile_size=[1024000,16,32]
INFO (CarpetX):   Domain extent:
INFO (CarpetX):     xmin=[-0.5,-0.5,-0.5]
INFO (CarpetX):     xmax=[0.5,0.5,0.5]
INFO (CarpetX):     base dx=[0.0025000000000000001,0.125,0.125]
INFO (CarpetX): Initializing level 0...
INFO (CarpetX): Regridding...
INFO (CarpetX):   level 0: 13 boxes, 25600 cells (100%)
INFO (CarpetX): Initialized 1 levels
INFO (CarpetX): OutputGH: iteration 0, time 0.000000, run time 1 s
INFO (CarpetX): OutputADIOS2...
INFO (CarpetX): OutputGH done.
INFO (CarpetX): Starting evolution...
INFO (CarpetX): Regridding...
INFO (CarpetX):   old levels 1, new levels 1
INFO (CarpetX):   level 0: 13 boxes, 25600 cells (100%)
INFO (ODESolvers): Integrator is RK4
[a974:1895570:0:1895706] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x3588)
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
BFD: Dwarf Error: Can't find .debug_ranges section.
==== backtrace (tid:1895706) ====
 0 0x0000000000012cf0 __funlockfile()  :0
 1 0x00000000018b148d Loop::GridDescBase::loop_box<1, 1, 1, 1, 1, GRHayLHDX_evaluate_fluxes_rhs_dir<2>(_cGH*)::{
_______________________________________________
Users mailing list
Users@einsteintoolkit.org
http://lists.einsteintoolkit.org/mailman/listinfo/users

Reply via email to