Skip to content

Welcome to vLLM-MetaXΒΆ

vLLM Light

MetaX Hardware Backend Plugin

Star Watch Fork

vLLM MetaX is a hardware plugin for running vLLM seamlessly on MetaX GPU, which is a cuda_alike backend and provided near-native CUDA experiences on MetaX Hardware with MACA.

It is the recommended approach for supporting the MetaX backend within the vLLM community.

The plugin follows the vLLM plugin RFCs by default:

Which ensured the hardware features and functionality support on integration of the MetaX GPU with vLLM.