minimal-llm-ui

Minimalistic Interface for Local Language Models (LLMs) (Powered by Ollama)

Introduction

This minimalistic UI is designed to act as a simple interface for Ollama models, allowing you to chat with your models, save conversations and toggle between different ones easily. The tool is built using React, Next.js, and Tailwind CSS, with LangchainJs and Ollama providing the magic behind the scenes.

Features

• Chat with Local Language Models (LLMs): Interact with your LLMs in real-time through our user-friendly interface.
• Model Toggling: You can switch between different LLMs easily (even mid-conversation), allowing you to experiment and explore different models for various tasks.
• Memory-based Context Storage: Keep track of context in memory, ensuring smooth interactions even when switching between models.
• Conversation History: Save conversations in a local database, allowing you to revisit them later.
• Prompt Templating: Save prompts you love by creating parameter-driven prompt templates to improve reuse
• Custom API Endpoint: Configure a custom base URL easily if Ollama is running on a different host/device.

Technical Details

• Built using React, Next.js, and Tailwind CSS for a clean and modern design.
• Utilizes LangchainJs and Ollama for seamless integration with Local Language Models (LLMs).
• Stores context in memory for efficient model switching.

Getting Started

1. Download and run Ollama on your machine with ollama serve or ollama run <model-name> (it will run at: http://localhost:11434/)

2. Open a new terminal and navigate to the root of this project.

3. Install the dependencies npm install in your terminal.

4. Also check whether your node by doing:

node -v

If it is less than 14.0.1. You can do this to update it:

• Install n using npm (Node.js package manager):

• bash:

npm install -g n

Use n to install a specific Node.js version: bash:

n 20.0.9

Verify the Node.js version:

• bash

node -v

5. Optional: If running Ollama on a different host/device, customize the Ollama API base URL by copying .env.example to .env.local and setting the environment variable NEXT_PUBLIC_OLLAMA_BASEURL. If not set, the base URL will default to http://localhost:11434.
6. Start the tool by running npm run dev (it should be available in your web browser at http://localhost:3000)

To-do

• Add edit message icon for user messages
• Add image uploads for multi-modal models
• Summarise conversations
• Incorporate visualisations
• Convert to a desktop app so that it can be more powerful
• Command menu should let you edit + delete existing prompts

Troubleshooting

If you encounter any issues, feel free to reach out!

License

This project is licensed under the MIT License. See LICENSE file for details.