Core Concepts
- Simple-to-use: Sandboxes are created, used, and destroyed seamlessly.
- Secure: They provide a safe boundary for running untrusted AI actions, like executing AI-generated code.
- Nested: You can run a Sandbox inside a data processing pipeline or an AI agent workflow.
Supported Runtimes
| Runtime | Supported Sandboxes |
|---|---|
| Python | CPU, GPU |
| Go | CPU Only |
| Node.js | CPU Only |
| Deno | CPU Only |
| Bash | CPU Only |
CPU Sandboxes
CPUSandbox is ideal for running lightweight code, data processing, or executing user-submitted scripts securely.
Create Hardware-Isolated Sandbox and Run Code
JavaScript
GPU Sandboxes
GPUSandbox provides instant access to secure, hardware-isolated VMs with GPUs. They include automatic storage for self-hosted models (perfect for agents) and support concurrent requests on the same GPU for significant cost savings.
Upload Script and Run Inference
You can upload scripts or files into the sandbox and execute them on the GPU.JavaScript
Sandbox Management
Delete and Timeouts
You have the option to manually calldelete() to clean up a Sandbox when you’re ready.
If you don’t call delete(), the sandbox will be automatically cleaned up after the period you set for the timeout argument.
- Default Timeout: If you don’t set a
timeoutargument, the default is 1 minute. - Auto-Cleanup: The sandbox is destroyed automatically after the timeout expires.
JavaScript
Sandbox Configuration
You can customize the resources and environment for your sandboxes.Parameters
GPU Sandbox (Python SDK)- language:
python(more coming soon). - memory: RAM allocation (e.g.,
"65536MB"). - gpu: GPU Type (e.g.,
T4). - requirements: List of Python packages (e.g.,
['transformers']). - model: Path to model can be local or remote (e.g., Hugging Face
Qwen/Qwen3-8B).
- runtime: (e.g.,
node,python). - memory: RAM allocation.
- timeout: Max execution time in seconds.
Runtime Specifics
Python Requirements You can specify dependencies in your code or via arequirements.txt.
Nested Sandboxes
One of the most powerful features of Buildfunctions is Nested Orchestration. You can deploy a top-level Function (e.g., a Node.js API) that spins up child Sandboxes (e.g., Python GPU workers) to handle requests.Example Architecture
- Top-Level Function: Receives an HTTP request.
- Child Sandbox: The function spins up a
GPUSandboxto run a customized model. - Result: The sandbox returns the inference result to the function, which responds to the user.
- Cleanup: The sandbox is destroyed, ensuring clean resource usage.