Wingman is a chatbot tool designed to run Large Language Models (LLMs) locally on both PC and Mac (Intel or Apple Silicon). Built with an easy-to-use user interface, Wingman provides a no-code solution that makes running LLMs accessible for anyone.

It supports a wide variety of language models such as Llama 2, OpenAI, Phi, Mistral, Yi, and Zephyr. These can be accessed directly from Hugging Face’s model hub within Wingman’s chatbot interface.

The system evaluates model compatibility with your machine to prevent crashes or slow performance. Users can customize system prompts for different use cases, enabling more interactive conversations with models.

Wingman operates fully on your device, ensuring your data is not shared with any external servers. The application only uses the network to initially download models, allowing for usage in offline environments.

Although currently without an operational API and multi-modal prompting, these features are said to be in development. As an open-source tool, Wingman is free to use and invites contribution from the wider tech community via its GitHub repo.

Additionally, it followed a regular updating schedule, promising an evolving tool that meets the needs of the user.