MLC LLM

MLC LLM lets you run language models like Llama and RedPajama natively across a diverse range of hardware platforms, including mobile devices. This tool supports native execution on iOS, Android, Windows, Linux, Mac, and web browsers, providing cross-platform compatibility. Developers can leverage detailed documentation to build custom applications integrated with MLC LLM’s capabilities. For end-users, MLC LLM offers out-of-the-box apps allowing interactive use cases such as conversational AI, writing assistance, analysis, and more. Free demo versions are available on mobile and desktop. MLC LLM runs best on devices with at least 6GB RAM.

For those using a mobile device, the app is called MLCChat on the iOS and Android app stores.