What breaks in document AI

Offline install and dependencies

20 of 20 quotes

• “With `HF_HUB_OFFLINE=1`, a Hub-ID speculative draft model logs `ERROR ... Error retrieving safetensors: ... offline mode is enabled` twice (plus a 2 s retry sleep), although startup succeeds”

• “For offline boxes the workaround that saved me was pointing `RAG_EMBEDDING_ENGINE` at a local ollama (nomic-embed-text or bge-m3)”

• “OFFLINE_MODE does not prevent the Whisper model from downloading”

• “Currently, there is no straightforward way to export or copy a specific model from one machine to another.”

• “Web fetch no longer works in offline mode with external loader”

• Hit this one too? We are building for it. Join the waitlist.

• “The installer of AnythingLLM downloads Ollama Cuda v12 and v13 libraries, as well as other stuff such as mmpeg codecs etc.”

• “As far as I understand it, Ollama 0.30 requires a separate llama-server for the GGUF models. At least with Homebrew, this isn't currently installed automatically.”

• “privacy-restricted machines I run hit the same wall on first build.”

• “Building Ollama in fully offline environments is currently difficult because the go dependencies must be fetched at build time.”

• “Installing npm on my offline server is difficult, and I do not need to use the Web UI.”

• “this bug definitely increases the pain level for me a bit on upgrading llama.cpp regularly on an airgapped system.”

• “I'm building `llama-server` on an offline server and build fails because `llama.cpp` now has some parts of it on huggingface.co and downloads it automatically.”

• “I'm trying to run Gemma 4 (google/gemma-4-31B-it) with vLLM in a strictly air-gapped environment where downloads and inference must be completely separated.”

• “In a fully offline/air-gapped environment, we use `OFFLINE_MODE=true` to isolate the OpenWebUI backend. However, this does not isolate the client browser.”

• “so I just quickly unplugged ethernet cable, and voila. in the chat its just loading.”

• “However for offline environment (without Internet access), it just mentioned the upgrade of the Docker image, but not the code.”

• “'punkt_tab' not bundled with OWUI Container, results in Offline Mode / Airgapped system issues”

• “v0.7.2: --data-dir flag removed, breaks bare metal installs”

• “after a Windows installation it requires Internet connections and it calls home and furthermore it will not start without internet connection.”

• “I'm deploying Open WebUI in a fully air-gapped (offline) environment, where no external network access is available. Currently, every embedding or reranker model has to be manually downloaded from Hugging Face and then manually added into the Docker image.”

• Hit this one too? We are building for it. Join the waitlist.