Llm Powered Tool Selection And Invocation

via “function calling and tool use with schema-based dispatch”

Shanghai AI Lab's multilingual foundation model.

Unique: Uses special token vocabulary for tool invocation rather than relying on prompt-based function calling, enabling more reliable parsing and lower latency; integrates tightly with LMDeploy's constrained generation to enforce schema compliance

vs others: More reliable tool calling than Llama 2 (which uses prompt-based approach) due to token-level constraints; comparable to GPT-4's function calling but with open-source transparency and local deployment capability