Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

375 Open 1,270 Closed
375 Open 1,270 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Quickstart vLLM examples do not work as expected
#3365 opened Nov 18, 2024 by prashant-warrier-echelonvi
Unable to build frontend after following the documentation
#3364 opened Nov 11, 2024 by mihaidusmanu
Trying to find a doc explaining how the scaling works (min_worker to max_worker)
#3362 opened Nov 9, 2024 by lschaupp
Issue when sending parallel requests
#3361 opened Nov 8, 2024 by lschaupp
weights_only default flip for torch.load
#3360 opened Nov 7, 2024 by mikaylagawarecki
Low Throughput and High Latency with TorchServe Deployment on AWS
#3359 opened Nov 6, 2024 by dummyuser-123
Model & Instance scaling
#3358 opened Nov 5, 2024 by markcNewell
413 Request Entity Too Large
#3357 opened Nov 5, 2024 by pengxin233
Allow to provide custom model_service_worker.py
#3353 opened Oct 23, 2024 by racinmat
Make TorchServe usable without torch installed
#3350 opened Oct 21, 2024 by racinmat
1
Error in MetricCollector when starting pytorch/torchserve:0.12.0-gpu container
#3349 opened Oct 19, 2024 by Hspix
Getting started guide client samples broken ?
#3348 opened Oct 15, 2024 by nikste
Add Detectron2 Support to TorchServe Object Detection Examples
#3344 opened Oct 9, 2024 by Mudassar-MLE
@Mudassar-MLE
2
Clarification on minWorkers and maxWorkers parameters
#3339 opened Oct 3, 2024 by krzwaraksa
throughput increase non-linearly with number of workers
#3338 opened Oct 3, 2024 by vandesa003
2
Kserve management api for registering new models question Further information is requested
#3325 opened Sep 20, 2024 by matej14086
@agunapal
"TorchServe Fails to Reload Models from S3 After k8s Pod Restart"
#3324 opened Sep 20, 2024 by koscevicb
1
CI: missing security check for security issues in the codebase
#3311 opened Sep 12, 2024 by ChengyuZhu6
1
1
Kserve TorchserveModel can't handle torch's auth
#3301 opened Aug 29, 2024 by AntPeixe
1
when to use ArgumentParser, raise "unrecognized arguments: --sock-type unix --sock-name /tmp/.ts.sock.9000"
#3299 opened Aug 23, 2024 by james-joobs
@mreso
3
integrating the Torch Serve hosted model with a third party application
#3296 opened Aug 22, 2024 by tarunsk1998
1
model_yaml_config usage is not explained well enough
#3290 opened Aug 20, 2024 by Foundsheep
@mreso
1
Incorrect Metric Type for HPA Scaling bug Something isn't working
#3286 opened Aug 15, 2024 by liaddrori1
@namannandan
2
Support for a CUDA 12.5.x
#3278 opened Aug 2, 2024 by jasonsmithio
1
1
Examples for authorization model
#3260 opened Jul 19, 2024 by RyanKadri
10
ProTip! Find all open issues with in progress development work with linked:pr.