Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE] Weekly CI Tests Sunday Oct 29, 2023 #1995

Closed
wants to merge 1 commit into from
Closed

[DO NOT MERGE] Weekly CI Tests Sunday Oct 29, 2023 #1995

wants to merge 1 commit into from

Conversation

emcbot
Copy link

@emcbot emcbot commented Oct 29, 2023

[DO NOT MERGE] Weekly CI Tests Sunday Oct 29, 2023

@emcbot emcbot marked this pull request as draft October 29, 2023 21:44
@emcbot emcbot added CI/CD Issue related to CI/CD CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion CI-Hera-Ready **CM use only** PR is ready for CI testing on Hera CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Oct 29, 2023
@emcbot
Copy link
Author

emcbot commented Oct 29, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Sun Oct 29 16:48:18 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Sun Oct 29 16:49:28 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Sun Oct 29 17:16:07 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 17:16:16 CDT 2023 for experiment C384_atm3DVar_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 17:16:20 CDT 2023 for experiment C384C192_hybatmda_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 17:16:24 CDT 2023 for experiment C384_S2SWA_8da1f8ee

@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Oct 29, 2023
@emcbot
Copy link
Author

emcbot commented Oct 29, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Sun Oct 29 21:48:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Sun Oct 29 21:52:14 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Sun Oct 29 23:08:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:13 UTC 2023 for experiment C384C192_hybatmda_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:16 UTC 2023 for experiment C384_S2SWA_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:18 UTC 2023 for experiment C384_atm3DVar_8da1f8ee

@emcbot emcbot added CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Oct 30, 2023
@emcbot
Copy link
Author

emcbot commented Oct 30, 2023 •
edited by TerrenceMcGuinness-NOAA
Loading

Automated global-workflow Testing Results:

Machine: Orion
Start: Sun Oct 29 16:48:18 CDT 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Sun Oct 29 16:49:28 CDT 2023
Build:                         *SUCCESS*
Build: Completed at Sun Oct 29 17:16:07 CDT 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 17:16:16 CDT 2023 for experiment C384_atm3DVar_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 17:16:20 CDT 2023 for experiment C384C192_hybatmda_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 17:16:24 CDT 2023 for experiment C384_S2SWA_8da1f8ee
Experiment C384_atm3DVar_8da1f8ee Terminated: *FAILED*
Experiment C384_atm3DVar_8da1f8ee Terminated with 1 tasks failed at Sun Oct 29 19:16:07 CDT 2023
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/PR/1995/RUNTESTS/COMROT/C384_atm3DVar_8da1f8ee/logs/2023040200/gfsanal.log

Wall clock exceeded for gfsanal and gdasanal set at 40 and 50 minutes respectively.
Updating to hour and 30 minutes by hand in XML and let's observe the actual time.

@emcbot
Copy link
Author

emcbot commented Oct 30, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Sun Oct 29 21:48:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Sun Oct 29 21:52:14 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Sun Oct 29 23:08:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:13 UTC 2023 for experiment C384C192_hybatmda_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:16 UTC 2023 for experiment C384_S2SWA_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:18 UTC 2023 for experiment C384_atm3DVar_8da1f8ee
Experiment C384C192_hybatmda_8da1f8ee completed: *SUCCESS*
Experiment C384C192_hybatmda_8da1f8ee Completed at Mon Oct 30 01:51:17 UTC 2023
with 97 successfully completed jobs

@emcbot
Copy link
Author

emcbot commented Oct 30, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Sun Oct 29 21:48:26 UTC 2023 on hfe05
---------------------------------------------------
Checkout:                      *SUCCESS*
Checkout: Completed at Sun Oct 29 21:52:14 UTC 2023
Build:                         *SUCCESS*
Build: Completed at Sun Oct 29 23:08:08 UTC 2023
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:13 UTC 2023 for experiment C384C192_hybatmda_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:16 UTC 2023 for experiment C384_S2SWA_8da1f8ee
Created experiment:            *SUCCESS*
Case setup: Completed at Sun Oct 29 23:08:18 UTC 2023 for experiment C384_atm3DVar_8da1f8ee
Experiment C384C192_hybatmda_8da1f8ee completed: *SUCCESS*
Experiment C384C192_hybatmda_8da1f8ee Completed at Mon Oct 30 01:51:17 UTC 2023
with 97 successfully completed jobs
Experiment C384_atm3DVar_8da1f8ee completed: *SUCCESS*
Experiment C384_atm3DVar_8da1f8ee Completed at Mon Oct 30 02:12:20 UTC 2023
with 57 successfully completed jobs

@TerrenceMcGuinness-NOAA
Copy link
Collaborator

TerrenceMcGuinness-NOAA commented Oct 30, 2023 •
edited
Loading

C384_S2SW Looking for 20160701.000000.restart.glo_025 but only 20160701.000000.restart.gwes_30m is on disk on Hera.

(gfs_workflow) Terry.McGuinness (hfe12) C384_S2SWA_8da1f8ee $ rocotocheck -d C384_S2SWA_8da1f8ee.db -w C384_S2SWA_8da1f8ee.xml -c 201607010000 -t gfsstage_ic | grep "does not exist"
      /scratch1/NCEPDEV/global/glopara/data/ICSDIR/prototype_ICs/GEFSwave20210528v2_refactored/2016070100/wave/20160701.000000.restart.glo_025 does not exist
(gfs_workflow) Terry.McGuinness (hfe12) C384_S2SWA_8da1f8ee $ ls /scratch1/NCEPDEV/global/glopara/data/ICSDIR/prototype_ICs/GEFSwave20210528v2_refactored/2016070100/wave/20160701.000000.restart.*
/scratch1/NCEPDEV/global/glopara/data/ICSDIR/prototype_ICs/GEFSwave20210528v2_refactored/2016070100/wave/20160701.000000.restart.gwes_30m
(gfs_workflow) Terry.McGuinness (hfe12) C384_S2SWA_8da1f8ee $

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA Awaiting requested review from TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA will be requested when the pull request is marked ready for review TerrenceMcGuinness-NOAA is a code owner

@WalterKolczynski-NOAA WalterKolczynski-NOAA Awaiting requested review from WalterKolczynski-NOAA WalterKolczynski-NOAA will be requested when the pull request is marked ready for review WalterKolczynski-NOAA is a code owner

Assignees
No one assigned
Labels
CI/CD Issue related to CI/CD CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@emcbot @TerrenceMcGuinness-NOAA