feat(deploy): add Render + HF Inference API cloud deploy support - #1
Merged
Conversation
When HF_TOKEN env var is set the app switches automatically to cloud mode: - Backend set to openai_compatible pointing to HF Inference API - Authorization header injected in all LLM requests (query + stream) - Ollama install/check/start skipped entirely - Model list returns curated HF serverless models - Web UI status indicator shows "HF Inference API" instead of "Ollama" No behaviour change when HF_TOKEN is absent (local Ollama mode unchanged). New files: Procfile, render.yaml, .env.example Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
When HF_TOKEN env var is set the app switches automatically to cloud mode:
No behaviour change when HF_TOKEN is absent (local Ollama mode unchanged).
New files: Procfile, render.yaml, .env.example
What this PR does
Related issue
Closes #
Checklist
python3 -m unittest discover -s tests -vpasses (all 89 tests green)python3 tools/privacy_scan.pyexits 0 (no PII introduced)try/exceptblocks (use project helpers), noas any, no single-letter lambda names