Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tuning at end of King County example does not improve score #142

Open
ablaom opened this issue Sep 9, 2020 · 1 comment
Open

Tuning at end of King County example does not improve score #142

ablaom opened this issue Sep 9, 2020 · 1 comment

Comments

@ablaom
Copy link
Member

ablaom commented Sep 9, 2020

https://alan-turing-institute.github.io/DataScienceTutorials.jl/end-to-end/HouseKingCounty/

cc @vollmersj

@ablaom
Copy link
Member Author

ablaom commented Apr 12, 2024

I think we can just add a sentence like,

"Tuning does not improve our test score. It's possible the tuned model does not generalise any better, or that, by chance, we're just doing worse on this particular test set. As the difference is so small, further analysis will likely not settle the issue either way, and we're probably happy to use the simpler, untuned model, or the random forest model with similar performance (or try tuning the random forest model as well). "

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant