What is the difference between llmaz and lws?

[zhaizhch]

[kerthcet]

Thanks @zhaizhch for your concern, basically llmaz uses lws as the underlying workload to support both single host and multi host scenarios. the difference is llmaz works as a platform offers features like model loading, lora aware routing(wip, see #313), gpu fungibility etc., we're targeting our v0.2.0 which includes a bunch of new features, you can take a look at https://github.com/InftyAI/llmaz/milestone/2.

[kerthcet]

/close
reopen if have any other quesitons.