Skip to main content
Vast.ai Documentation – Affordable GPU Cloud Marketplace home page
Search...
⌘K
Ask AI
Discord
Console
Console
Search...
Navigation
Server
HandlerConfig
Documentation
Examples
SDK
CLI
API
Get Started
Hello World
Authentication
Templates
VastAI Client
VastAI
Methods
Accounts
Billing
Instances
Network Volumes
Search
Serverless
Team
Templates
Volumes
Machines
Serverless
Client
Server
Worker (Server)
WorkerConfig
HandlerConfig
LogActionConfig
BenchmarkConfig
On this page
Import
Fields
Server
HandlerConfig
Copy page
Copy page
Configuration for defining handlers
Import
Copy
Ask AI
from
vastai
import
HandlerConfig
Fields
route
str
route
healthcheck
Optional[str]
default:
"None"
healthcheck
allow_parallel_requests
bool
default:
"False"
allow_parallel_requests
max_queue_time
Optional[float]
default:
"30.0"
max_queue_time
benchmark_config
Optional[BenchmarkConfig]
default:
"None"
benchmark_config
handler_class
Optional[Type[EndpointHandler]]
default:
"None"
handler_class
payload_class
Optional[Type[ApiPayload]]
default:
"None"
payload_class
request_parser
Optional[RequestPayloadParser]
default:
"None"
request_parser
response_generator
Optional[ClientResponseGenerator]
default:
"None"
response_generator
workload_calculator
Optional[WorkloadCalculator]
default:
"None"
workload_calculator
remote_function
Optional[Callable]
default:
"None"
remote_function
Suggest edits
Raise issue
WorkerConfig
LogActionConfig
⌘I
Assistant
Responses are generated using AI and may contain mistakes.