Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revisit: load experiment design table from DB #409

Open
ke4 opened this issue May 28, 2024 · 0 comments
Open

Revisit: load experiment design table from DB #409

ke4 opened this issue May 28, 2024 · 0 comments
Labels
improvement Improve/refactor existing code technical debt Technical debt

Comments

@ke4
Copy link
Contributor

ke4 commented May 28, 2024

We had an epic for rewriting the part of both Bulk and Single Cell Expression Atlas to read the data from the database and creating a table on the web page for experiment design. It suppose to replace the current design where we read this data from the experiment design file.
When we merged these changes to the web apps the application could not load the data to the cache. After a brief debugging it turned out that the modified code is using too much memory when loading the data into the cache and eventually we get an OutOfMemoryError.
These PRs were working in our local environment as we don't have lots of data locally, but they were failing in staging environment.
Now we also have test environment, although we still need to ask Data Prod Team to load the same datasets to test that we have in staging to be able to do the same tests in both environments.

Here is the list of the reverted PRs that we can investigate.

In this ticket I collected the reusable changes/commits from the above PRs: Loading experiments into the cache is failing

@ke4 ke4 added high priority Do this first, then the rest improvement Improve/refactor existing code labels May 28, 2024
@ke4 ke4 changed the title Revisit experiment design table changes in SCXA Revisit: load experiment design table from DB Jul 2, 2024
@ke4 ke4 added technical debt Technical debt improvement Improve/refactor existing code and removed improvement Improve/refactor existing code high priority Do this first, then the rest labels Oct 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improve/refactor existing code technical debt Technical debt
Projects
None yet
Development

No branches or pull requests

1 participant