LLM Hoster
Android app by JoblessAiDeveloper. Tools · JoblessAiDeveloper
- Store rating
- Unknown
- Store rating count
- Unknown
- Download price
- Free to download
- In-app purchases
- Not listed in captured metadata
- Version
- 1.6
- Listing last refreshed
- 2026-09-11
View the original store listing
Store description excerpt
Turn your Android phone into a powerful, private AI server — no cloud, no subscription, no data leaving your device. LLM Hoster lets you download and run large language models (LLMs) directly on your phone using the llama.cpp inference engine, and exposes a fully compatible API over your local network. Use it with any client that supports the baseAPI/v1API — Open WebUI, Continue.dev, Chatbox, LM Studio, or your own apps. ━━━━━━━━━━━━━━━━━━━━ 🔒 COMPLETELY PRIVATE Your data never leaves your device. No internet required for inference. No API keys, no cloud costs, no telemetry. What happens on your phone stays on your phone. 📥 ONE-TAP MODEL DOWNLOADS Browse and download GGUF models from Hugging Face with a single tap. Just paste a repo name like "author/model_name-GGUF" — the app automatically finds and downloads the best quantized version for mobile. 🌐 /v1-COMPATIBLE API Expose a real REST API on your LAN: • GET /v1/models • POST /v1/chat/completions • POST /v1/completions Connect from your laptop, tablet, or any device on the same network. 💬 BUILT-IN CHAT Chat with your loaded model directly inside the app. No external client needed for quick conversations. ⚡ PERFORMANCE TUNING Fine-tune inference for your device: • CPU core allocation (2–8 threads) • KV cache quantization (q4_0, q8_0) • Context window size (2K–16K tokens) • Batch size control • GPU layer offloading • Flash Attention support 🔧 RUNS IN THE BACKGROUND A foreground service keeps the server alive even when you switch apps. Stop it anytime from the notification shade. ━━━━━━━━━━━━━━━━━━━━ SUPPORTED MODELS Works with any GGUF-format model. Recommended starting points: • Llama 3.2 (1B / 3B) • Phi-3 Mini • Gemma 2 (2B) • Qwen 2.5 (1.5B / 3B) • Mistral 7B (Q4 quantized) Smaller quantized models (Q4_K_M, Q4_0) run best on phones. Models are stored locally and persist across sessions. ━━━━━━━━━━━━━━━━━━━━ USE CASES • Private AI assistant with zero cloud dependency • Development & testing of LLM-powered apps • Offline AI in areas with limited connectivity • Learning and experimenting with open-source models • Serving AI to multiple devices on your home network ━━━━━━━━━━━━━━━━━━━━ No ads. No tracking. No accounts. Just AI on your phone. Download LLM Hoster and start hosting your own private AI server today.
Review coverage
AppRill has captured 0 reviews for this app. This is a collected sample, separate from the store rating count. Latest review capture: Not captured yet.
Recent captured chart positions
No chart positions have been captured for this app yet.
Chart position, rating count and review coverage do not establish downloads, revenue or profit. Understand the differences.