Jobs refactor by davramov · Pull Request #139 · als-computing/splash_flows

Initial commit for adding NERSC IRI-API support alongside SFAPI for job submission

davramov

committed

Removed NERSCLoginMethod(Enum) from nersc.py. Created a temporary test flow for reconstruction to test job submission. In reconstruct(), replaced the SFAPI-specific job submission/polling code with…

davramov

committed

Updating pytests

davramov

committed

successfully ran reconstruction using the IRI-API

davramov

committed

removing token.py and moving the logic to get_globus_token.py

davramov

committed

moving get_globus_token.py to orchestration/globus/ to be used as a module

davramov

committed

Updating unit tests

davramov

committed

Rebasing and including segmentation flows as part of iri/sfapi abstraction

davramov

committed

Making IRIAPI the default login method for now

davramov

committed

Making the IRI job submission read sbatch settings

davramov

committed

Fixing IRIAPI bugs, also commenting out Globus transfers for now

davramov

committed

Updating logger comments

davramov

committed

connecting to AmSC MLflow service

davramov

committed

removing old commented code

davramov

committed

adjusting import in pytest to avoid error on github that did not occur locally

davramov

committed

Getting NERSC reservations working with IRI API

davramov

committed

fixing globus token race condition when jobs are launch simultaneously

davramov

committed

updating config with confab reservation

davramov

committed

moving nersc iri/sf-api resource definitions to config (no longer global variables)

davramov

committed

Updating nersc.py to pull iri/sf-api parameters from the config, rather than a global variable

davramov

committed

itial commit for a new orchestration/jobs/ structure

davramov

committed

Large refactoring of job submission code. Moving ALCF/NERSC generic job submission code up a level, and leaving bl832-level code in the orchestration/flow/bl832/ directory.

davramov

committed

Adding pytests mirroring the jobs/ directory structure

davramov

committed

renaming dummy/fake --> mock in unit tests

davramov

committed

polishing up post-rebase

davramov

committed

removing reservation from config

davramov

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Jobs refactor#139

Jobs refactor#139
davramov wants to merge 26 commits into
als-computing:mainfrom
davramov:jobs_refactor

Commits on May 27, 2026

Initial commit for adding NERSC IRI-API support alongside SFAPI for job submission

Removed NERSCLoginMethod(Enum) from nersc.py. Created a temporary test flow for reconstruction to test job submission. In reconstruct(), replaced the SFAPI-specific job submission/polling code with…

Updating pytests

successfully ran reconstruction using the IRI-API

removing token.py and moving the logic to get_globus_token.py

moving get_globus_token.py to orchestration/globus/ to be used as a module

Updating unit tests

Rebasing and including segmentation flows as part of iri/sfapi abstraction

Making IRIAPI the default login method for now

Making the IRI job submission read sbatch settings

Fixing IRIAPI bugs, also commenting out Globus transfers for now

Updating logger comments

connecting to AmSC MLflow service

removing old commented code

adjusting import in pytest to avoid error on github that did not occur locally

Getting NERSC reservations working with IRI API

fixing globus token race condition when jobs are launch simultaneously

updating config with confab reservation

moving nersc iri/sf-api resource definitions to config (no longer global variables)

Updating nersc.py to pull iri/sf-api parameters from the config, rather than a global variable

itial commit for a new orchestration/jobs/ structure

Large refactoring of job submission code. Moving ALCF/NERSC generic job submission code up a level, and leaving bl832-level code in the orchestration/flow/bl832/ directory.

Adding pytests mirroring the jobs/ directory structure

renaming dummy/fake --> mock in unit tests

polishing up post-rebase

removing reservation from config