Genoss is a pioneering open-source initiative that aims to offer a seamless alternative to OpenAI models such as GPT 3.5 & 4, using open-source models like GPT4ALL.
Project bootstrapped using Sicarator
Chat Completion and Embedding with GPT4ALL
https://github.com/OpenGenenerativeAI/GenossGPT/assets/19614572/9cfd4f69-6396-4883-b94d-e94dd76663dc
Before you embark, ensure Python 3.11 or higher is installed on your machine.
:warning: we are currently in prepublish.
pip install genoss
pip install git+https://github.com/OpenGenerativeAI/GenossGPT.git@main\#egg\=genoss
genoss-server
# To know more
genoss-server --help
Access the api docs via http://localhost:4321/docs .
You need to install poetry and a valid python version (3.11*).
poetry install
For more, on a complete install for development purpose, you can check the CONTRIBUTING.md. If you simply want to start the server, you can install with the corresponding poetry groups :
poetry install --only main,llms
After the Python package has been installed, you can run the application. The Uvicorn ASGI server can be used to run your application:
uvicorn main:app --host 0.0.0.0 --port 4321
This command launches the Genoss application on port 4321 of your machine.
In the demo/
cp .env.example .env
Replace the values and then
PYTHONPATH=. streamlit run demo/main.py
The Genoss API is a one-line replacement for the OpenAI ChatGPT API. It supports the same parameters and returns the same response format as the OpenAI API.
Simply replace the OpenAI API endpoint with the Genoss API endpoint and you’re good to go!
Modify the models to the supported list of models and you’re good to go!
You can find the API documentation at /docs
or /redoc
.
While GPT4ALL is the only model currently supported, we are planning to add more models in the future. So, stay tuned for more exciting updates.
The vision:
Genoss was imagined by Stan Girard when a feature of Quivr became too big and complicated to maintain.
The idea was to create a simple API that would allow to use any model with the same API as OpenAI’s ChatGPT API.
Then @mattzcarey, @MaximeThoonsen, @Wirg and @StanGirard started working on the project and it became a reality.
Your contributions to Genoss are immensely appreciated! Feel free to submit any issues or pull requests.
Thanks go to these wonderful people:
This project could not be possible without the support of our sponsors. Thank you for your support!
Genoss is licensed under the Apache2 License. For more details, refer to the LICENSE file.