Skip to content
This repository has been archived by the owner on Jun 2, 2023. It is now read-only.

Normalize outputs segment by segment? #77

Open
jsadler2 opened this issue Oct 22, 2020 · 2 comments
Open

Normalize outputs segment by segment? #77

jsadler2 opened this issue Oct 22, 2020 · 2 comments

Comments

@jsadler2
Copy link
Collaborator

Currently we are standardizing outputs (and inputs) by subtracting the mean and dividing by the standard deviation of each variable. The result is that the distribution has, roughly, a mean of zero and a standard deviation of 1.

For the standardization, we are using the mean and SD of all the segments and all the days (for the record, the mean and SD values are coming from sntemp outputs). We then use those values in reverse to get our predictions.

I'm wondering if we should instead standardize each segment's outputs by that segment's mean and SD.

@jsadler2
Copy link
Collaborator Author

I think this might have a similar effect as training on logged flow - the smaller discharge streams would be modeled better.

@jsadler2
Copy link
Collaborator Author

This idea is similar to what Kratzert et. al do except they are doing it in the loss function (they don't standardize the outputs):
image
(https://onlinelibrary.wiley.com/doi/full/10.1002/hyp.1280)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant