m3oracle
MLX-LM inference
An SSH-managed M3 Max serves an OpenAI-compatible MLX-LM endpoint to the private network. A separate self-hosted Open WebUI VM makes it useful from a clean browser interface. Self-hosted models are also defined in my Pi settings, making local inference available directly inside the coding-agent harness.
- 16CPU cores
- 128 GBunified memory
- launchdmanaged service