FYI – the matching Mac results I just saw:
RotationMatrixTest_MercuryMJ2000Ec [max diff 1.09735e-09 > tol
1e-12]
We also have this GmatFunctions failure on Mac (looks like a 0 = 360 thing?):
GMATFunction_EarthFixedPropFun_Periapsis [diff 360, tol 1e-05]
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Wendy C. Shoan 301.286.6263
NASA/GSFC/583 Greenbelt MD 20771
[email protected]<mailto:[email protected]>
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
From: Darrel Conway <[email protected]>
Date: Thursday, April 16, 2020 at 11:41 AM
To: "Cooley, D S. (GSFC-5950)" <[email protected]>,
"[email protected]" <[email protected]>
Subject: [EXTERNAL] Re: [Gmat-buildtest] Test results: 2020-04-15
(GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2017)
I took a bit of time checking the rotation matrix failure case yesterday. The
differences are a but larger than I like, so I filed a ticket for it
(GMT-7223). Here's some text from the ticket explaining what I think we are
seeing:
I think the difference comes because of the translation (Earth -> other body)
induced for the scripted calculation. To confirm that, I checked the reported
matrix differences with Earth origins (and got all zeroes, as I should have)
and at several other bodies. The matrix differences grow with distance from
the Earth, indicating that the error reported likely comes from the origin
shift.
Should we just relax the tolerances? I've been leaving this alone while
waiting for another set of eyes on it.
- DJC
On 4/16/20 8:02 AM, Cooley, D S. (GSFC-5950) via Gmat-buildtest wrote:
On Rerunning the failed tests, we only have:
Truth failures:
RotationMatrixTest_MercuryMJ2000Ec [max diff 1.09735e-09 > tol 1e-12]
Which I have been assuming is just a tolerance issue for a relatively newly
created test but correct me if I am wrong.
-----Original Message-----
From: [email protected]<mailto:[email protected]>
<[email protected]><mailto:[email protected]>
Sent: Thursday, April 16, 2020 5:33 AM
To: Cooley, D S. (GSFC-5950) <[email protected]><mailto:[email protected]>;
[email protected]<mailto:[email protected]>
Subject: Test results: 2020-04-15 (GS580W-GMAT-T6/Win7-64/GMAT-64/M2016a/VS2017)
-----------------------------------------------------------------
Summary
-----------------------------------------------------------------
System configuration: Windows 10/MATLAB R2017a/VS 2013 Tested build: 2020-04-15
Regression build: 2020-04-14
Total number of scripts: 14699 (+62 deferred) Percent Passed: 99.82% New
issues: 29
Output changes: 2
New truth failures: 12
New crashes: 0
New script errors: 15
New comparator errors: 0
Fixed issues: 0
Total issues: 28
Test system warnings: 43
New deferred issues: 11
Fixed deferred issues: 0
Total deferred issues: 56
Run Time: 16 hours, 31 minutes, 03 seconds
-----------------------------------------------------------------
New Issues
-----------------------------------------------------------------
New truth failures:
fmincon_Report [#3 failed]
fmincon_ShowProgress [#1 failed]
Optimize_fmincon_cvg_status []
Optimize_fmincon_cvg_status [#2 failed]
StopCond_GMAT_MultiProp_StopGroupings_FirstStep []
Vary_optimizer_fmincon__AdditiveScaleFactor_Variable [ptrn 1,2 failed]
Vary_optimizer_fmincon_Additive_and_Multiplicative_ScaleFactor_RealNumber
[ptrn 1,2 failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_ArrayElement [ptrn 1,2 failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_RealNumber [ptrn 1,2 failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_ArrayElement [ptrn 1,2
failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_RealNumber [ptrn 1,2 failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_Variable [ptrn 1,2 failed]
Output changes (but still pass):
Write_Spacecraft_ReportFile_Concise
Write_Spacecraft_ReportFile_Verbose
Output changes (but still fail):
None
New crashes/hangs/etc.:
None
New script errors:
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable_2
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable
Vary_optimizer_fmincon_Perturbation_ArrayElement
Vary_optimizer_fmincon_Perturbation_RealNumber
Vary_optimizer_fmincon_Perturbation_Variable
Vary_optimizer_fmincon_UpperBound_ArrayElement
Vary_optimizer_fmincon_UpperBound_Variable
Vary_optimizer_fmincon__InitialValue_Array
Vary_optimizer_fmincon__InitialValue_RealNumber
Vary_optimizer_fmincon__InitialValue_Variable
Vary_optimizer_fmincon__LowerBound_Array
Vary_optimizer_fmincon__LowerBound_RealNumber
Vary_optimizer_fmincon__LowerBound_Variable
completed_steps_1_thru_10_of_FRC_1_using_fmincon_Optimizer
fmincon_ConstraintTolerance
New comparator errors:
None
-----------------------------------------------------------------
Fixed Issues
-----------------------------------------------------------------
Fixed truth failures:
None
Fixed crashes/hangs/etc.:
None
Fixed script errors:
None
Fixed comparator errors:
None
-----------------------------------------------------------------
All Known Issues
-----------------------------------------------------------------
Crashes/hangs/etc.:
None
Script errors:
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable_2:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_InitialGuess_ForLoopVariable_2.report
does not exist
Vary_optimizer_fmincon_InitialGuess_ForLoopVariable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_InitialGuess_ForLoopVariable.report
does not exist
Vary_optimizer_fmincon_Perturbation_ArrayElement:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_Perturbation_ArrayElement.report
does not exist
Vary_optimizer_fmincon_Perturbation_RealNumber:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_Perturbation_RealNumber.report
does not exist
Vary_optimizer_fmincon_Perturbation_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_Perturbation_Variable.report
does not exist
Vary_optimizer_fmincon_UpperBound_ArrayElement:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_UpperBound_ArrayElement.report
does not exist
Vary_optimizer_fmincon_UpperBound_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon_UpperBound_Variable.report
does not exist
Vary_optimizer_fmincon__InitialValue_Array:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__InitialValue_Array.report
does not exist
Vary_optimizer_fmincon__InitialValue_RealNumber:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__InitialValue_RealNumber.report
does not exist
Vary_optimizer_fmincon__InitialValue_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__InitialValue_Variable.report
does not exist
Vary_optimizer_fmincon__LowerBound_Array:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__LowerBound_Array.report
does not exist
Vary_optimizer_fmincon__LowerBound_RealNumber:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__LowerBound_RealNumber.report
does not exist
Vary_optimizer_fmincon__LowerBound_Variable:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\Vary_optimizer_fmincon__LowerBound_Variable.report
does not exist
completed_steps_1_thru_10_of_FRC_1_using_fmincon_Optimizer:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\completed_steps_1_thru_10_of_FRC_1_using_fmincon_Optimizer.report
does not exist
fmincon_ConstraintTolerance:
ERROR MESSAGE: Output file
C:\Users\gsfc580gmattest\Documents\ScriptTest\gmat\output\fmincon_ConstraintTolerance.report
does not exist
Comparator errors:
None
Truth failures:
fmincon_Report [#3 failed]
fmincon_ShowProgress [#1 failed]
Optimize_fmincon_cvg_status/Optimize_fmincon_cvg_status_Report1.report []
Optimize_fmincon_cvg_status/Optimize_fmincon_cvg_status_Report2.report [#2
failed]
RotationMatrixTest_MercuryMJ2000Ec [max diff 1.09735e-09 > tol 1e-12]
StopCond_GMAT_MultiProp_StopGroupings_FirstStep []
Vary_optimizer_fmincon__AdditiveScaleFactor_Variable [ptrn 1,2 failed]
Vary_optimizer_fmincon_Additive_and_Multiplicative_ScaleFactor_RealNumber
[ptrn 1,2 failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_ArrayElement [ptrn 1,2 failed]
Vary_optimizer_fmincon_AdditiveScaleFactor_RealNumber [ptrn 1,2 failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_ArrayElement [ptrn 1,2
failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_RealNumber [ptrn 1,2 failed]
Vary_optimizer_fmincon_MultiplicativeScaleFactor_Variable [ptrn 1,2 failed]
-----------------------------------------------------------------
New Issues (Deferred)
-----------------------------------------------------------------
New truth failures (deferred):
None
Output changes (but still pass) (deferred):
Ephem_GMAT_Code500_InterpolationOrder [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize [GMT-4112]
Ephem_GMAT_Code500_StepSize [GMT-4112]
Output changes (but still fail) (deferred):
Ephem_GMAT_Code500_InterpolationOrder [pos err 0.0173914, tol 0.002]
[GMT-4075, GMT-4112]
Ephem_GMAT_Code500_InterpolationOrder [pos err 0.0463976, tol 0.002]
[GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize [pos err 305.165, tol 0.002] [GMT-4112]
EphemStressTests_Default_and_ABM_Integrator_Code500_60Sec_MultipleSCs_ForwardDirection
[pos err 15.2508, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[pos err 9.57601, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[pos err 14.3834, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
[pos err 0.000217107, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection [pos err
21.5632, tol 1e-12] [GMT-4112]
New crashes/hangs/etc. (deferred):
None
New script errors (deferred):
None
New comparator errors (deferred):
None
-----------------------------------------------------------------
Fixed Issues (Deferred)
-----------------------------------------------------------------
Fixed truth failures (deferred):
None
Fixed crashes/hangs/etc. (deferred):
None
Fixed script errors (deferred):
None
Fixed comparator errors (deferred):
None
-----------------------------------------------------------------
All Known Issues (Deferred)
-----------------------------------------------------------------
Crashes/hangs/etc. (deferred):
None
Script errors (deferred):
BatchEstimator_EstimationEpoch [GMT-5708]
Math_Shadowed_Builtins [GMT-3043]
OCPropTest_SPAD_Drag_1deg_Bicubic_LEO [GMT-7147]
OCPropTest_SPAD_Drag_SRP_1deg_Bicubic_LEO [GMT-7147]
Python_IO_String [5317]
ScriptLanguage_WhiteSpace_AfterArrayName [GMT-3522]
THF_Sim_Accel_ConfigD_None_NA_2 [GMT-6451]
THF_Sim_Accel_ConfigD_None_NA_3 [GMT-6451]
THF_Sim_Accel_ConfigD_None_NA_4 [GMT-6451]
THF_Sim_Accel_ConfigD_None_NA [GMT-6451]
THF_Sim_Thrust_CSF2_None_NA_ZeroTSF [GMT-6451]
ThrustHistoryFile_EstimateTSF_EpochBeforeBurn_RSSStep_Aqua [GMT-6451]
ThrustSegment_SolveFors_ThrustScaleFactor_Multiple_RSSStep [GMT-6451]
ThrustSegment_SolveFors_ThrustScaleFactor_RSSStep [GMT-6451]
TrkFile_SimEst_DSN_DS_Range_Solve_Bias_apriori [GMT-5709]
Comparator errors (deferred):
GroundStation_Iono_Range_Kband (truth) [GMT-5644]
GroundStation_Iono_RangeRate_Kband (truth) [GMT-5644]
GroundStation_TropoIono_Range_Kband (truth) [GMT-5644]
Truth failures (deferred):
AcceptFilter_Validation_RecordNumbers [#5 failed] [GMT-6034]
Achieve_Validation_LHS_Field [ptrn 1 failed] [GMT-3687]
Achieve_Validation_RHS_Field [no error or exception] [GMT-3687]
BatchEstimator_ReportFile_InitialState [#5 failed] [GMT-6412]
Ephem_GMAT_Code500_InterpolationOrder/Ephem_GMAT_Code500_InterpolationOrder_1.eph
[pos err 0.0173914, tol 0.002] [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_InterpolationOrder/Ephem_GMAT_Code500_InterpolationOrder_3.eph
[pos err 0.0463976, tol 0.002] [GMT-4075, GMT-4112]
Ephem_GMAT_Code500_StepSize/Ephem_GMAT_Code500_StepSize_1.eph [pos err
305.165, tol 0.002] [GMT-4112]
EphemStressTests_Default_and_ABM_Integrator_Code500_60Sec_MultipleSCs_ForwardDirection
[pos err 15.2508, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[pos err 9.57601, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[pos err 14.3834, tol 1e-12] [GMT-4077]
EphemStressTests_Default_Prop_Code500_60Sec_MixedStopTypes_LogicTypes_ForwardDirection
[pos err 0.000217107, tol 1e-12] [GMT-4112]
EphemStressTests_PD78_ABM_Prop_Code500_60Sec_Step_ForwardDirection [pos err
21.5632, tol 1e-12] [GMT-4112]
EphemStressTests_SPK_Integrator_Code500_60Sec_ForwardDirection [pos err
0.000427977, tol 1e-12] [GMT-4112]
Epoch_LeapSecond_G2MJD [max mjd diff 1.000259s > tol 0.001000s] [2561]
Epoch_LeapSecond_In [max greg. diff 1.000005s > tol 0.001000s] [2561]
Epoch_LeapSecond_Out [max mjd diff 1.000146s > tol 0.001000s] [2561]
Formation_Validation_MissingComma [no error or exception] [GMT-3672]
GMAT_ISS_Earth_JGM2_0_0_NutationUpdateInterval [pos err 0.00081496, tol
1e-06] [GMT-2567]
Math_Inf [GMAT: 53 lines, Truth: 69 lines] [GMT-3195]
Minimize_Validation_Field [no warn or err] [GMT-3687]
Nonlinear_Validation_LHS_Field [no warn or err] [GMT-3687]
Nonlinear_Validation_RHS_Field [no warn or err] [GMT-3687]
Optimize_Yukon_Minimize_Height_on_circle_2 [diff 497, tol 0.001]
Optimize_Yukon_Minimize_Height_on_circle_4 [diff 497, tol 0.001]
RejectFilter_Validation_RecordNumbers [#5 failed] [GMT-6034]
ScriptLanguage_Comments_AfterControlFlow [] [GMT-3332]
ScriptLanguage_LiteralArrays_String [] [GMT-3680]
ScriptLanguage_ReferenceArrays_ForceModel_7 [] [GMT-3541]
ScriptLanguage_Validation_Semicolons_1 [no error or exception] [GMT-3545]
Simulator_Validation_Propagator [#1 failed] [GMT-7059]
SpacecraftNavigation_Validation_Mode [#1 failed] [GMT-5841]
String_AssignNumericParam [] [GMT-2888]
TrkFile_SimEst_TDRS_range_Solve_Cr [] [GMT-5416]
Vary_Validation_RHS_Field [no error or exception] [GMT-3687]
Write_Multiple_ReportFile_Concise_2 [#24 failed] [GMT-5801]
Write_Multiple_ReportFile_Verbose [#24 failed]
Write_Multiple_ReportFile_Verbose_2 [#24 failed] [GMT-5801]
Write_Spacecraft_ReportFile_Script [] [GMT-6801]
-----------------------------------------------------------------
Test System Warnings
-----------------------------------------------------------------
Passing tests tagged with bugs:
(To fix, remove bug ID from Bugs key in .tc file)
Comet_Validation_OrientationEpoch_3 [GMT-3252]
CoordSysTest_Luna_MJ2000Eq_To_ICRF [GMT-3227]
CoordinateSystem_Validation_Axes_4 [GMT-3155]
EphemPropagator_Code500_CentralBody_Jupiter [GMT-5795]
EphemPropagator_Code500_CentralBody_Saturn [GMT-5795]
EphemPropagator_Code500_ForwardProp_Interp [GMT-5760]
EphemPropagator_SatAssigmentToNewSatThenProp [GMT-3434]
EphemStressTests_Default_Prop_CCSDS_Forward_and_BackwardDirect [GMT-6840]
EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_ForwardDirection
[GMT-6090]
EphemStressTests_Default_Prop_STK_60Sec_MixedStopTypes_LogicTypes_DiscontinuityTypes_SolverTypes_ForwardDirect
[GMT-6090]
Ephem_GMAT_SPK_60sec_backward [GMT-5286]
Ephem_GMAT_SPK_DefaultIntegrationStep_User_Defined_LagrangeOrder
[GMT-5286]
Ephem_GMAT_STK_60sec_IterativeProcess_Optimizer [GMT-6090]
Ephem_GMAT_STK_60sec_IterativeProcess_Optimizer_NoBoundaries [GMT-6090]
Events_ContactLocator_Ephemeris_DE405AllPlanets [GMT-5377]
Events_ContactLocator_Ephemeris_DE424AllPlanets [GMT-5377]
Events_ContactLocator_Heo2 [GMT-5302]
Events_ContactLocator_UseEntireInterval_False_MissionSequence [GMT-5292]
Ex_GmatFunction [GMT-3604]
FMParams_GMAT_UserAsteroid(OSIRIS)_HarmonicGravity_SRP_PointMasses
[GMT-6955]
ForceModel_SPAD_Drag_1deg_Bicubic_Mars [Linux, Mac]
ForceModel_SPAD_Drag_1deg_Bilinear_Mars [Linux, Mac]
Formation_Validation_PropFormSatInTwoProps [GMT-3581]
GMAT_GEO_EarthSunMoon_0_0_0_Relativity [3405]
GMAT_GEO_EarthSun_0_0_0_Relativity [3405]
GMAT_ISS_EarthSunMoon_0_0_0_Relativity [3405]
GMAT_ISS_EarthSunMoon_0_0_0_Relativity_Cmd [3405]
GMAT_ISS_EarthSun_0_0_0_Relativity [3405]
IntegratedFlyby_MarsFlyby [GMT-7169]
Math_Validation_Cross_WrongDim2 [GMT-5676]
Phase_EpochFormat_TAIGregorian [GMT-7168]
Phase_Type_Radau [GMT-7168]
ScriptLanguage_LineContinuation_BeginningOfLine [GMT-3756]
ScriptLanguage_Validation_DataTypes_ReferenceArray_Formation_5 [GMT-6064]
Simulator_Propagator_EarthPointMass_Drag [GMT-5417]
Simulator_Propagator_EarthPointMass_SRP_Drag [GMT-5417]
SpacePointParams_CelestialBody_EpochOutput [3939]
SpacecraftNavigation_CdSigma_Range_MSISE86 [GMT-6829 Linux only]
SpacecraftNavigation_SPADDragScaleFactorSigma_ConstrainInc [GMT-7078, Ubuntu
only]
SpacecraftNavigation_SPADDragScaleFactorSigma_GN_MSISE86 [GMT-6829 Linux only]
SpacecraftNavigation_SPADSRPScaleFactorSigma_ConstrainInc [GMT-7078, Linux
only]
SpacecraftNavigation_SolveFors_CartesianState_SPADDragScaleFactor_GN_MSISE86
[GMT-6829 Linux only]
Thruster_Finite_Burn_Permutations_Separate_Propagators_2 [GMT-3455]
_______________________________________________
Gmat-buildtest mailing list
[email protected]<mailto:[email protected]>
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest<https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_gmat-2Dbuildtest&d=DwMDaQ&c=ApwzowJNAKKw3xye91w7BE1XMRKi2LN9kiMk5Csz9Zk&r=No5yNyS2GuKj1lrNANHI2mBc5WteEWZEs9NqLJHeTUQ&m=V3u7KCAkKYbJMKZotWwL5SW8gf_UEr_UhhhvfoKxFf8&s=4F5egXxue3nmkg3XKsbWnvTsrm8CguiwMqi9viOVsHc&e=>
--
Darrel J. Conway, Ph.D. Thinking Systems, Inc.
Senior Scientist and CEO 437 W Thurber Road, Suite 6
Phone: (623) 298-4530 Tucson, AZ 85705
FAX: (520) 232-2533
www.thinksysinc.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.thinksysinc.com&d=DwMDaQ&c=ApwzowJNAKKw3xye91w7BE1XMRKi2LN9kiMk5Csz9Zk&r=No5yNyS2GuKj1lrNANHI2mBc5WteEWZEs9NqLJHeTUQ&m=V3u7KCAkKYbJMKZotWwL5SW8gf_UEr_UhhhvfoKxFf8&s=XTTNwV1n6fVgCshe4v9Z054Jhe-ctqnECjodbjCMSSE&e=>
Cell: (520) 425-3626
[email protected]<mailto:[email protected]>
_______________________________________________
Gmat-buildtest mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gmat-buildtest
