Skip to content

Commit

Permalink
update(datajoint_pipeline): update README
Browse files Browse the repository at this point in the history
  • Loading branch information
ttngu207 committed Dec 3, 2024
1 parent 6ed933a commit 4f96b87
Showing 1 changed file with 10 additions and 5 deletions.
15 changes: 10 additions & 5 deletions aeon/dj_pipeline/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -89,20 +89,25 @@ animals, cameras, food patches setup, etc.
+ These information are either entered by hand, or parsed and inserted from configuration
yaml files.
+ For experiments these info can be inserted by running
+ [create_experiment_01](create_experiments/create_experiment_01.py)
+ [create_socialexperiment_0](create_experiments/create_socialexperiment_0.py)
+ [create_experiment_02](create_experiments/create_experiment_02.py)
+ [create_socialexperiment](create_experiments/create_socialexperiment.py)
(just need to do this once)

Tables in DataJoint are written with a `make()` function -
instruction to generate and insert new records to itself, based on data from upstream tables.
Triggering the auto ingestion and processing/computation routine is essentially
calling the `.populate()` method for all relevant tables.

These routines are prepared in this [auto-processing script](populate/process.py).
These routines are prepared in this [auto-processing script](populate/worker.py).
Essentially, turning on the auto-processing routine amounts to running the
following 2 commands (in different processing threads)
following 4 commands , either in sequence or in parallel (with different processing threads).
Data ingestion/populate with DataJoint is idempotent, so it is safe to run the same command multiple times.

aeon_ingest high
aeon_ingest pyrat_worker

aeon_ingest mid
aeon_ingest acquisition_worker

aeon_ingest streams_worker

aeon_ingest analysis_worker

0 comments on commit 4f96b87

Please sign in to comment.