Local LLMs
Execute an LLM within your DaDesktop environment rather than routing prompts to an external API. The model utilizes DaDesktop's GPU infrastructure, while your prompts, files, and data remain contained within the desktop environment. This setup allows you to pay for the desktop resource instead of incurring per-token costs.
Advantages of running LLMs locally
- Ensure data privacy: Your prompts, files, and data are retained securely within the DaDesktop environment.
- Avoid per-token charges: Utilize DaDesktop's GPU infrastructure to run models without paying API fees for individual requests.
- Select your model: Choose the specific model you wish to deploy and manage its configuration settings.
- Manage your own workloads: Interact with the model directly from the desktop, integrating it with other applications and tools.
AI agents
Deploy agents that leverage local models to complete tasks and interact with various tools.
Coding
Utilize local models to assist with coding tasks, development processes, and testing.
Research and experimentation
Employ models for research purposes, data analysis, and testing different models and configurations.
How it works
Select a DaDesktop GPU desktop, load your desired model, and execute it locally. GPU passthrough ensures the desktop has full access to a physical GPU for LLM workloads. You can review available GPUs, their specifications, and supported configurations on the GPU page.
Start Your Free Trial Today
Run seamless virtual IT training with cloud-based labs, no downtime, just scalable learning that works.