Cog-based assistant architecture
Five cogs split responsibilities cleanly: assistant (ask, code, image, memory), translate (live mode + preferences), admin (config / enable / disable), owner (self-update prompts), and help (compact + detailed). The provider layer keeps the NIM async client retry-aware and streaming-capable.
- Ask: meta/llama-4-maverick-17b-128e-instruct
- Code/Update: qwen/qwen3-coder-480b-a35b-instruct
- Translate: google/gemma-3n-e4b-it
- Async NIM provider with retries + streaming support