Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generalizing the low-level data API for ephys data #371

Open
glopesdev opened this issue Jun 26, 2024 · 0 comments
Open

Generalizing the low-level data API for ephys data #371

glopesdev opened this issue Jun 26, 2024 · 0 comments
Labels
proposal Request for a new feature

Comments

@glopesdev
Copy link
Contributor

glopesdev commented Jun 26, 2024

Points to consider:

  • Ephys data is timestamped with different clock at acquisition time
    • There is a global correspondence table between clocks that can be used to build an interpolator but would be nice if the architecture could support this seamlessly
    • Names of files are different since we don't have a chunk timestamp at acquisition time
  • Ephys data is too big to load entire chunks (support for sub-chunking at read time would be useful)
    • Each chunk of neuropixel probe data is 81 GB
    • Even just one chunk of per-sample timestamps is ~800 MB
    • np.fromfile supports chunking, could also consider using memory mapping
  • There are multiple devices inside the ephys headstage, how should we group them?
    • Consider if they should be different devices at the dataset level, or sub-devices inside a headstage device
    • Might be useful to keep the flat stream structure at the dataset level
@glopesdev glopesdev added the proposal Request for a new feature label Jun 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
proposal Request for a new feature
Projects
None yet
Development

No branches or pull requests

1 participant