Filename: Private: No Yes Filetype: Auto ABAP Sophia Apex Azure CLI Batch Bicep C Cameligo Clojure CoffeeScript C++ C# CSP CSS Cypher Dart Dockerfile ECL Elixir Flow9 FreeMarker2 FreeMarker2 (Angle/Bracket) FreeMarker2 (Angle/Dollar) FreeMarker2 (Auto/Bracket) FreeMarker2 (Auto/Dollar) FreeMarker2 (Bracket/Bracket) FreeMarker2 (Bracket/Dollar) F# Go GraphQL Handlebars Terraform HTML Ini Java JavaScript Julia Kotlin Less Lexon Liquid Lua Modula-3 Markdown MDX MIPS DAX MySQL Objective-C Pascal Pascaligo Perl PostgreSQL PHP Plain text ATS PQ PowerShell Protobuf Pug Python Q# R Razor Redis Redshift ReStructuredText Ruby Rust Small Basic Scala Scheme Sass Shell Solidity SPARQL SQL StructuredText Swift SV Tcl Twig TypeScript TypeSpec Visual Basic V WebGPU Shading Language XML YAML Indentation: Spaces Tabs 1 2 3 4 5 6 7 8 Clone '''Open or Free''' * [https://ollama.com/ OLLAMA] - Tool for running LLMs locally, based llama.cpp. Supports a lot of LLMs. * [https://github.com/exo-explore/exo EXO] - Tool for running LLMs locally or combining multiple devices, based on llama.cpp. Supports the Major LLMs. * [https://github.com/open-webui/open-webui/ Open-WebUI] - Web interface for interfacing with propitiator and open LLM providers. * [https://www.librechat.ai/ LibreChat] - Web interface for interfacing with propitiator and open LLM providers. * [https://github.com/BigBIueWhale/ollama_load_balancer OLLAMA Load Balancer] * [https://docs.helix.ml/helix/ Helix] - Tool for setting up local LLMs + creating AI applications, like chatbots. * https://lmstudio.ai/ * https://localai.io/ * https://koboldai.com/Koboldcpp/ * PGvector * Apache Solr For balancing connections to LLMs we can use Nginx or Caddy: * https://github.com/j4ys0n/llm-proxy * https://www.greghilston.com/post/how-to-load-balance-with-preference/ '''Propriatory''' * https://anythingllm.com/ Paste
