Manuscript: Simple Behavioral Analysis (SimBA) as a platform for explainable machine learning in behavioral neuroscience Pre-print: Simple Behavioral Analysis (SimBA) – an open source toolkit for computer classification of complex social behaviors in experimental animals
To install SimBA via pip, use the following command:
pip install simba-uw-tf-devSee SimBA on readthedocs for API reference and example notebooks when you prefer to run methods available in SimBA through the command line over the GUI. If you find that notebook examples are lacking, please reach out to us Gitter or by opening an issue and let's chat about typing up further examples!
Although core methods remain, the SimBA code and documentation has sprawled significantly. If you are curious about the methods in the GUI, try clicking the header icons which should take you to the relevant documentation.
As always, reach out to us on Gitter chat or open an issue if you have questions, bug reports of feature requests!
We have released a significantly improved GUI for region-of-interest segmentation and analysis. Click here to go to the new ROI documentation page.
The SimBA region of interest (ROI) interface allows users to define and draw ROIs on videos. ROI data can be used to calculate basic descriptive statistics based on animals movements and locations such as:
- How much time the animals have spent in different ROIs.
- How many times the animals have entered different ROIs.
- The distance animals have moved in the different ROIs.
- Calculate how animals have engaged in different classified behaviors in each ROI. etc....
Furthermore, the ROI data can be used to build potentially valuable, additional, features for random forest predictive classifiers. Such features can be used to generate a machine model that classify behaviors that depend on the spatial location of body parts in relation to the ROIs. CAUTION: If spatial locations are irrelevant for the behaviour being classified, then such features should not be included in the machine model generation as they just only introduce noise.
It has been nearly a year since the first public iteration of SimBA was released! We would like to thank the open-source community who have supported us and provided invaluable feedback and motivation to continue developing and supporting SimBA to where it is now. We have recently passed well over 150,000 downloads via pip install across all branches, and average between ~5000 to 10,000 weekly downloads alongside a gitter community of >100 users. We have just passed 15 citations for the SimBA preprint, which was released ~8 months ago. This would not be possible without your support. Thank you.
The newest release of SimBA, v1.3, provides a significant jump in features, quality of life improvements, and bug fixes. Several are highlighted below.
Please update using pip install simba-uw-tf==1.3.7, this version has native deeplabcut and deepposekit GUI support disabled. Hence, tensorflow is not needed. Pose-estimation developers have created excellent GUIs for their pipelines, and we do a disservice to you by not supporting the most updated versions. SimBA now supports pose-estimation dataframe imports from Deeplabcut, DeepPoseKit, SLEAP, MARS and others. If you are developing a new pose-estimation method and would like it directly supported in SimBA, please let us know!
- Easy install of SimBA via
pip- Documentation - Install simba using anaconda - Documentation
- Introduction of SHAP for behavioral neuroscience classifier explainability and standarization- Documentation
- Plotly integration for immediate data visualization - Documentation
- Labelling/annotating behaviors with many third-party apps - Documentation
- Kleinberg Filter for smoothing - Documentation
- ROI Visualization update - Documentation
- User define features extraction - Documentation
- Quick line plot - Allow user to make line plots with selected bodypart and tracking data (located under Tools)
- Many, many, many, many bug-fixes
- Multi-animal DLC support - Documentation
- Multi-animal SLEAP support - Documentation
- SimBA 'pseudo-labelling' module - Documentation
- Easy install of SimBA via
pip- Documentation - Plenty of new quality-of-life features (e.g., time-bin analyzes / improved visualizations options) - Documentation
- Many, many, many, many bug-fixes
Please join our Gitter chat if you have any questions, or even if you would simply like to discuss potential applications for SimBA in your work. Please come by, stay inside, wash your hands, and check on your lab mates reguarly!
A pre-print SimBA manuscript on bioRxiv! The manuscript details the use of SimBA for generation of social predictive classifiers in rat and mouse resident-intruder protocols - please check it out using the link above. All data, pose-estimation models, and the final classifiers generated in the manuscript, can be accessed through our OSF repository and through the Resource menu further down this page.
- Region of Interest support (ROI Module) - Documentation
- DeepPoseKit support (DPK Module) - Documentation
- SimBA accepts user-defined pose-configurations (Flexible Annotation Module) - Documentation
- Interactive classifer discrimination thresholding - Documentation
- Individual discrimination thresholds for classifiers - Documentation
- Heatmap visualizations -Documentation
- Multi-crop tool - Documentation
- Post-classification validation method for false-positives - Documentation
- Many, many, many bug-fixes
Several excellent computational frameworks exist that enable high-throughput and consistent tracking of freely moving unmarked animals. Here we introduce and distribute a pipeline that enabled users to use these pose-estimation approaches in combination with behavioral annotation and generation of supervised machine-learning behavioral predictive classifiers. We have developed this pipeline for the analysis of complex social behaviors, but have included the flexibility for users to generate predictive classifiers across other behavioral modalities with minimal effort and no specialized computational background.
SimBA does not require computer science and programing experience, and SimBA is optimized for wide-ranging video acquisition parameters and quality. We may be able to provide support and advice for specific use instances, especially if it benefits multiple users and advances the scope of SimBA. Feel free to post issues and bugs here or contact us directly and we'll work on squashing them as they appear. We hope that users will contribute to the community!
- The SimBA pipeline requires no programing knowledge
- Specialized commercial or custom-made equipment is not required
- Extensive annotations are not required
- The pipeline is flexible and can be used to create and validate classifiers for different behaviors and environments
- Currently included behavioral classifiers have been validated in mice and rats
- SimBA is written on Windows/MacOS and compatible with Linux
SimBA provides several validated classifer libraries using videos filmed from above at 90° angle with pose-estimation data from 8 body parts per animal; please see our OSF repository for access to all files. SimBA now accepts any user-defined pose-estimation annotation schemes with the inclusion of the Flexible Annotation Module in v1.1. SimBA now supports maDLC and SLEAP for similar looking animals with the release of maDLC/SLEAP module in v1.2.
Installation note: SimBA can be installed either with TensorFlow compatability (for generating DeepLabCut, DeepPoseKit and SLEAP pose-estimation models), or without TensorFlow (for stand-alone use with classifiers and other functions). Please choose the appropriate branch for your needs, using pip install. More details are found in the Installation Documentation.
Listserv for release information: If you would like to receive notification for new releases of SimBA, please fill out this form and you will be added to the listserv.
Step 1: Pre-process videos
Step 3: Building classfier(s)
Step 4: Analysis/Visualization
To faciliate the initial use of SimBA, we provide several use scenarios. We have created these scenarios around a hypothetical experiment that take a user from initial use (completely new start) all the way through analyzing a complete experiment and then adding additional experimental datasets to an initial project.
Scenario 1: Building classifiers from scratch
Scenario 2: Using a classifier on new experimental data
- API 📘
- Process video using SimBA tools 🔨
- Batch pre-process video using SimBA 🏭
- Using DeepPoseKit in SimBA 📙
- Using DeepLabCut through SimBA 📗
- SimBA generic tutorial 📘
- SimBA friendly asked questions (FAQ) 📕
- SimBA behavioral annotation interface 🏷️
- SimBA Advanced behavioral annotation interface 🏷️
- Using third-party annotation tools in SimBA 🏷️
- Using user-defined ROIs in SimBA 🗺️
- Using multi-animal pose (maDLC/SLEAP/APT) in SimBA 🐭🐭
- Using the SimBA data analysis and export dashboard 📊
- Explainable machine classifications in SimBA (SHAP) 🧮
- Mutual exclusivity using heuristic rules in SimBA 📗
- Compute feature subsets in SimBA 📕
- Kleinberg markov chain classification smoothing in SimBA 🔗
- Cue-light analyses in SimBA💡💡
- Bounding boxes in SimBA📦
- Reversing the directionality of classifiers in SimBA ⏪
- Spike-time correlation coefficients in SimBA 📔
- Spontaneous alternation in SimBA🌽
- Analysing animal directions in SimBA 🧭
- Recommended hardware 🖥️
- Downloading compressed data from the SimBA OSF repository 💾
All data (classifiers etc.) is available on our Open Science Framework repository. For a schematic overview of the data respository folder structure (as of March-20-2020), click HERE.
Below is a link to download trained behavior classification models to apply it on your dataset
This project is licensed under the GPLv3. Note that the software is provided 'as is', without warranty of any kind, express or implied.
If you find any part of the code or data useful for your own work, please cite us. You can view and download the citation file by clicking the Cite this repository button at the top right of this page. Thank you 🙏!
@article{Nilsson2020.04.19.049452,
author = {Nilsson, Simon RO and Goodwin, Nastacia L. and Choong, Jia Jie and Hwang, Sophia and Wright, Hayden R and Norville, Zane C and Tong, Xiaoyu and Lin, Dayu and Bentzley, Brandon S. and Eshel, Neir and McLaughlin, Ryan J and Golden, Sam A.},
title = {Simple Behavioral Analysis (SimBA) {\textendash} an open source toolkit for computer classification of complex social behaviors in experimental animals},
elocation-id = {2020.04.19.049452},
year = {2020},
doi = {10.1101/2020.04.19.049452},
publisher = {Cold Spring Harbor Laboratory},
URL = {https://www.biorxiv.org/content/early/2020/04/21/2020.04.19.049452},
eprint = {https://www.biorxiv.org/content/early/2020/04/21/2020.04.19.049452.full.pdf},
journal = {bioRxiv}
}
