Hi All,
Folks have told me the Save Mode errors we have seen before are all accounted
for.
Great, but just as documentation, below are the Save Mode test results (tests
marked as Save) of the latest (4/3) build. If you find Save Mode errors, go
ahead and document them. (even if we are unlikely to address them since code
freeze has past).
Below is an example how a Save mode test can fail
(1) You hit the blue Save button for a loaded script.
(2) This changes some of your commands so that if you now run the test, you
get different results. (An example of a failure we found recently is this. A
given test used a specific Mars atmospheric density file. Hitting the blue
Save button deleted this reference to an atmosphere file and changed the drag
model to some default setting thus changing the results)
Note that Deferred tests could still theoretically have Save mode failures.
(For example, a Save mode type failure could make the test Fail even more)
Thanks,
Steve
-----------------------------------------------------------------
Summary
-----------------------------------------------------------------
System configuration: Windows 10/MATLAB R2019a/TestBuild
Tested build: AllSaveMode_2020_04_05
Regression build: $prevbuild$
Total number of scripts: 1029 (+14 deferred)
Percent Passed: 97.67%
New issues: 0
Output changes: 0
New truth failures: 0
New crashes: 0
New script errors: 0
New comparator errors: 0
Fixed issues: 0
Total issues: 24
Test system warnings: 1
New deferred issues: 0
Fixed deferred issues: 0
Total deferred issues: 10
Run Time: 03 hours, 46 minutes, 50 seconds
-----------------------------------------------------------------
New Issues
-----------------------------------------------------------------
New truth failures:
None
Output changes (but still pass):
None
Output changes (but still fail):
None
New crashes/hangs/etc.:
None
New script errors:
None
New comparator errors:
None
-----------------------------------------------------------------
Fixed Issues
-----------------------------------------------------------------
Fixed truth failures:
None
Fixed crashes/hangs/etc.:
None
Fixed script errors:
None
Fixed comparator errors:
None
-----------------------------------------------------------------
All Known Issues
-----------------------------------------------------------------
Crashes/hangs/etc.:
None
Script errors:
GroundTrackPlot_Set_DataCollectionFrequency_Command: (save)
ERROR MESSAGE:
GroundTrackPlot_Set_RedrawPoint_Command: (save)
ERROR MESSAGE:
GroundTrackPlot_Set_UpdatePlotFrequency_Command: (save)
ERROR MESSAGE:
GroundTrackPlot_ShowOneofTwoPlots_Command: (save)
ERROR MESSAGE:
Comparator errors:
Ephem_GMAT_CCSDS_OEM_86400sec_IterativeProcess_Target_and_DynamicsChange:
(save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\Ephem_GMAT_CCSDS_OEM_86400sec_IterativeProcess_Target_and_DynamicsChange_rawdata.report.
No such file or directory.
EphemStressTests_Default_and_ABM_Integrator_CCSDS_60Sec_MultipleSCs_ForwardDirection:
(save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_Default_and_ABM_Integrator_CCSDS_60Sec_MultipleSCs_ForwardDirection.report.
No such file or directory.
EphemStressTests_Default_Prop_CCSDS_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection:
(save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_Default_Prop_CCSDS_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection_truth.rawdata.
No such file or directory.
EphemStressTests_Default_Prop_CCSDS_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect:
(save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_Default_Prop_CCSDS_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect_rawdata.report.
No such file or directory.
EphemStressTests_Default_Prop_CCSDS_60Sec_MixedStopTypes_LogicTypes_ForwardDirection:
(save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_Default_Prop_CCSDS_60Sec_MixedStopTypes_LogicTypes_ForwardDirection_rawdata.report.
No such file or directory.
EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection:
(save) (truth) [GMT-6090]
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection_truth.rawdata.
No such file or directory.
EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect:
(save) (truth) [GMT-6090]
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect_rawdata.report.
No such file or directory.
EphemStressTests_PD78_ABM_Prop_CCSDS_60Sec_Step_ForwardDirection: (save)
(truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_PD78_ABM_Prop_CCSDS_60Sec_Step_ForwardDirection.report.
No such file or directory.
EphemStressTests_PD78_ABM_Prop_CCSDS_60Sec_Step_ForwardDirection_New: (save)
(truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_PD78_ABM_Prop_CCSDS_60Sec_Step_ForwardDirection.report.
No such file or directory.
EphemStressTests_SPK_Integrator_CCSDS_60Sec_ForwardDirection:
(save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Resources\FRR-31_EphemerisFile\script\EphemStressTests_SPK_Integrator_CCSDS_60Sec_ForwardDirection.report.
No such file or directory.
GMAT_ToggleEphemeris_MiddleOff: (save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Commands\FRC-16_Toggle\script\ToggleEphemeris_MiddleOffThenOn_truth.report.
No such file or directory.
GMAT_ToggleEphemeris_StartOffToggleOn: (save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Commands\FRC-16_Toggle\script\ToggleEphemeris_StartOffTogglOn_truth.report.
No such file or directory.
GMAT_ToggleEphemeris_TwoEphemeris: (save) (truth)
ERROR MESSAGE: Comparator CcsdsInterpComparator failed: Error using
fileread (line 22)
Could not open file
C:\Users\gsfc580gmattest\Documents\ScriptTest\output\AllSaveMode_2020_04_05\Commands\FRC-16_Toggle\script\ToggleEphemeris_StartOff_truth.report.
No such file or directory.
OCPropTest_LEOJGM2_4x4: (save) (truth)
ERROR MESSAGE: Comparator OCPropComparator failed: Error using <frozen
importlib>_find_and_load_unlocked (line 965)
Python Error: ModuleNotFoundError: No module named 'OCHComparator'
OCPropTest_LEOJGM2_4x4_JR: (save) (truth)
ERROR MESSAGE: Comparator OCPropComparator failed: Error using <frozen
importlib>_find_and_load_unlocked (line 965)
Python Error: ModuleNotFoundError: No module named 'OCHComparator'
OCPropTest_LEOJGM2_4x4_JR_SRP: (save) (truth)
ERROR MESSAGE: Comparator OCPropComparator failed: Error using <frozen
importlib>_find_and_load_unlocked (line 965)
Python Error: ModuleNotFoundError: No module named 'OCHComparator'
OCPropTest_LEOJGM2_4x4_SRP: (save) (truth)
ERROR MESSAGE: Comparator OCPropComparator failed: Error using <frozen
importlib>_find_and_load_unlocked (line 965)
Python Error: ModuleNotFoundError: No module named 'OCHComparator'
OCPropTest_LEOJGM2_20x20: (save) (truth)
ERROR MESSAGE: Comparator OCPropComparator failed: Error using <frozen
importlib>_find_and_load_unlocked (line 965)
Python Error: ModuleNotFoundError: No module named 'OCHComparator'
OCPropTest_LEOPointMass: (save) (truth)
ERROR MESSAGE: Comparator OCPropComparator failed: Error using <frozen
importlib>_find_and_load_unlocked (line 965)
Python Error: ModuleNotFoundError: No module named 'OCHComparator'
Truth failures:
MatlabFunction_FunctionPath_Relative (save) [diff 0.141593,
tol 1e-13]
-----------------------------------------------------------------
New Issues (Deferred)
-----------------------------------------------------------------
New truth failures (deferred):
None
Output changes (but still pass) (deferred):
None
Output changes (but still fail) (deferred):
None
New crashes/hangs/etc. (deferred):
None
New script errors (deferred):
None
New comparator errors (deferred):
None
-----------------------------------------------------------------
Fixed Issues (Deferred)
-----------------------------------------------------------------
Fixed truth failures (deferred):
None
Fixed crashes/hangs/etc. (deferred):
None
Fixed script errors (deferred):
None
Fixed comparator errors (deferred):
None
-----------------------------------------------------------------
All Known Issues (Deferred)
-----------------------------------------------------------------
Crashes/hangs/etc. (deferred):
None
Script errors (deferred):
Python_IO_String (save) [5317]
THF_Sim_Accel_ConfigD_None_NA (save) [GMT-6451]
Comparator errors (deferred):
None
Truth failures (deferred):
EphemStressTests_Default_and_ABM_Integrator_Code500_60Sec_MultipleSCs_ForwardDirection
(save) [pos err 15.2508, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
(save) [pos err 9.57601, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
(save) [pos err 14.3834, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
(save) [pos err 0.000217107, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection (save) [pos
err 21.5632, tol 1e-12] [GMT-4112]
EphemStressTests_SPK_Integrator_Code500_60Sec_ForwardDirection
(save) [pos err 0.000427977, tol 1e-12] [GMT-4112]
Optimize_Yukon_Minimize_Height_on_circle_2 (save) [diff 497,
tol 0.001]
Optimize_Yukon_Minimize_Height_on_circle_4 (save) [diff 497,
tol 0.001]
-----------------------------------------------------------------
Test System Warnings
-----------------------------------------------------------------
Passing tests tagged with bugs:
(To fix, remove bug ID from Bugs key in .tc file)
EphemStressTests_Default_Prop_CCSDS_Forward_and_BackwardDirect
[GMT-6840]
Running FileReporter...
Running TestHelper...
_______________________________________________
Gmat-buildtest mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
