Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add MLflow logs to evaluate job #220

Open
wants to merge 17 commits into
base: main
Choose a base branch
from
Open

Add MLflow logs to evaluate job #220

wants to merge 17 commits into from
+264 −57

Commits on Oct 29, 2024

  1. Define mlflow experiment and run name with reference to the trained m… 

    …odel
    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    4ce3b8b View commit details
    Browse the repository at this point in the history

  2. First draft bash script

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    4a72125 View commit details
    Browse the repository at this point in the history

  3. add script to select best model

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    6b68641 View commit details
    Browse the repository at this point in the history

  4. Add checkpoint path to evaluation run name

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    e110eb5 View commit details
    Browse the repository at this point in the history

  5. Fix ruff

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    b35f727 View commit details
    Browse the repository at this point in the history

  6. Remove select best model empty script

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    e6cfb6a View commit details
    Browse the repository at this point in the history

  7. Log dataset info and trained model info to mlflow

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    c4b4b33 View commit details
    Browse the repository at this point in the history

  8. Print MLflow details to screen

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    c91c65e View commit details
    Browse the repository at this point in the history

  9. Small edits to comments

    @sfmig
    sfmig committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    43f2fe9 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Rename output folder for evaluationr results

    @sfmig
    sfmig committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f255532 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Move run_name assignment to constructor and remove option of defining… 

    … it based on training job run name
    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    6bedbab View commit details
    Browse the repository at this point in the history

  2. Add name of checkpoint file to MLflow logs

    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    0f7117f View commit details
    Browse the repository at this point in the history

  3. Remove option to define run name from train job run name from evaluat… 

    …e utils
    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    9bd6763 View commit details
    Browse the repository at this point in the history

  4. Adapt test to generalise to other output directory names (still not f… 

    …ixed for batch size > 1, see PR 232
    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    3744021 View commit details
    Browse the repository at this point in the history

  5. Evaluate on the validation split by default, and optionally on the te… 

    …st split
    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    bcd46e6 View commit details
    Browse the repository at this point in the history

  6. Update readme to add --save_frames flag to evaluate section

    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    832a37b View commit details
    Browse the repository at this point in the history

  7. Simpify CLI help for experiment name

    @sfmig
    sfmig committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    ff30a86 View commit details
    Browse the repository at this point in the history