Welcome to

llmware is an integrated framework with over 50+ models in Hugging Face for quickly developing LLM-based applications including Retrieval Augmented Generation (RAG) and Multi-Step Orchestration of Agent Workflows.

Install llmware View llmware on GitHub Open an Issue on GitHub

Install llmware

New wheels are built generally on PyPy on a weekly basis and updated on PyPy versioning. The development repo is updated and current at all times, but may have updates that are not yet in the PyPy wheel. All wheels are built and tested on

Mac Metal

Mac x86

Windows x86 (+ with CUDA)

Linux x86 (+ with CUDA) - most testing on Ubuntu 22 and Ubuntu 20 - which are recommended.

Linux aarch64

We recommend that you use at least llmware >= 0.2.0. Other than that, make sure that you have the following set up.

Platforms: Mac M1, Mac x86, Windows, Linux (Ubuntu 22 preferred)

Hardware: 16 GB RAM minimum

Python versions: 3.9, 3.10, 3.11

You can install llmware via the Python Package Index (PIP), or you can manually download the wheel files from the GitHub repository.

PIP

You can easily install llmware via pip.

pip install llmware

Manual install of wheel files

First, go to the wheel_archives folder and download the wheel you want to install. For example, if you want to install llmware version 0.2.5 then choose llmware-0.2.5-py3-none-any.whl. After downloading, place the wheel archive in a folder. Finally, navigate to that folder and and run pip3 install llmware-0.2.5-py3-none-any.whl. On linux, a typical work flow would be the following.

cd Downloads

mkdir llmware
cd llmware

wget https://github.com/\
llmware-ai/llmware/\
blob/432b5530cda158f57442a3fe4a9f03a20945a41c/\
wheel_archives/llmware-0.2.5-py3-none-any.whl

pip3 install llmware-0.2.5-py3-none-any.whl

When to use llmware

llmware focuses on making it easy to integrate open source small specialized models and connecting enterprise knowledge safely and securely.

Usage

from llmware.models import ModelCatalog

# get all SLIM models, delivered as small, fast quantized tools
ModelCatalog().get_llm_toolkit()

# see the model in action with test script included
ModelCatalog().tool_test_run("slim-sentiment-tool") 

About the project

Contributing

Please first discuss any change you want to make publicly, for example on GitHub via raising an issue or starting a new discussion. You can also write an email or start a discussion on our Discrod channel. Read more about becoming a contributor in the GitHub repo.

Code of conduct

We welcome everyone into the llmware community. View our Code of Conduct in our GitHub repository.

`llmware` and AI Bloks

llmware is an open source project from AI Bloks - the company behind llmware. The company offers a Software as a Service (SaaS) Retrieval Augmented Generation (RAG) service. AI Bloks was founded by Namee Oberst and Darren Oberst in Oktober 2022.

License

llmware is distributed by an Apache-2.0 license.