Self-Hosting Ollama with Open WebUI on Windows: A Step-by-Step Guide

Apologies for my hiatus, obviously there are “reasons”.

This is a way to relatively quickly get a private and local AI, ChatGPT’esk setup on your Windows 10 machine – I tested on my laptop (my laptop = Intel i7-11375H / 64GB RAM, 99% sure CPU used only) – and, found it works pretty much as well (if not quicker) than ChatGPT, or other solutions.

In this guide, we’ll walk through the process of setting up Open WebUI, a ChatGPT-like interface that allows you to interact with Ollama/llama3.2, an AI “model” provided by Meta aka Facebook.

Prerequisites

Before we begin, make sure you have:

1. Python 3.11.x: This version of Python is required for Open WebUI to work properly (I used V3.11.9). You can download it from the official website: https://www.python.org/downloads/windows/
2. Admin privileges: You’ll need to run Command Prompt or PowerShell as an administrator to install Open WebUI. Type CMD in search box, and click on “Run as Administrator”
3. Basic computer knowledge: This guide assumes you have basic understanding of computers and operating systems, and courage to tackle using command line (bar is pretty low here, TBH).

Step 1: Install Python and Open WebUI

1. Download the specified version of Python from the official website.
2. Run the installer and select “all users” during the installation process to ensure that Python is installed for both user and system accounts.
3. Make sure the Python install directory and scripts directory have been added to your system’s PATH environment variable (user and system). In search box on Windows type “environment variables”.
4. Open Command Prompt or PowerShell and run the following commands as an administrator:

pip install open-webui
open-webui serve

This will start Open WebUI on http://localhost:8080 which you can access from your browser. Go there and setup a local account.

Step 2: Install Ollama

1. Head over to the official Ollama website: https://ollama.com/
2. Click on “Download” and follow the installation instructions.

Step 3: Configure Ollama Model llama3.2 to Work With OpenWebUI

1. In OpenWebUI, Settings -> Admin settings section, Go to Models. A JSON file is required for llama3.2. Mine was located at:

C:\Users\%username%\.ollama\models\manifests\registry.ollama.ai\library\llama3.2\latest

2. Update the model file with your own Ollama/llama3.2, model JSON file.
3. Click “Save” to save your changes.

Step 4: Start Chatting!

1. Go back to the chat screen in Open WebUI and select your preferred Ollama model (e.g., “llama3.2”).
2. You’re now ready to start chatting with Ollama!

That’s it! With these simplified steps, you should be able to self-host Ollama on Windows using Open WebUI.

Hold the press …

You can also integrate Web and search, here in Admin settings :

Image

Although, I wouldn’t recommend 50 in Search Result Count, maybe 3-10, maybe up to 30.

Finally – This is just the basics – OpenWebUI usage has grown exponentially this year, and, it is capable of much more powerful things – head over to OpenWebUI.com check it out.

Don Charisma

Full disclosure – I used this setup to help me improve my original draft of this post, generate Tags and WordPress Excerpt.



Help us out by using our referral codesTransferwiseDropboxpCloudBitChuteDigitalOcean $100 Free CreditGemini Crypto Exchange We Both Get $10 Bitcoin – Binance –Bybit – Bitget – Remitly –


Disclaimer

Disclaimer – This is creative writing, for the purposes of freedom of expression and shared connection, in the realm of the divine via communication, you know, art. If you take offense to anything herein, then I suggest you may be the intolerant, bigoted, hateful, ideologically possessed, sinful, undiverse, uninclusive, extreme, misinformed, uninformed, propagandised one, not I. But who knows I could be wrong, I have been before, and will be again.

“to err is human; to forgive, divine” – Alexander Pope


Resources & Sources

Unless otherwise stated everything here is (c) DonCharisma.org, all rights are reserved – Please contact us if you want to buy digital assets from this website, we’d be happy to help. Sometimes we use photos from stock sites (or public domain) which are un-watermarked (Watermarked photos are normally our own). Where content is included from elsewhere on the internet (for example news articles, or parts of articles, images or YouTube videos) – we have included under fair use, that is for “satire or discussion” (or any of the other fair uses), we will usually cite the source (where known or disclosed to us) and that copyright remains with copyright holder. Each and every post on this website has an open comments section, so it’s usually a discussion, but sometimes satire appears in comments, or in the post.


DonCharisma.com-logo-4

*Shameless self-promotion* – Sometimes we work – Our commercial site :

DonCharisma.com – you dream it we built it … because – “anything is possible with Charisma”

Charisma-Writing-Banner-DonCharisma.org-1024x512

A friend requested I link to their product on Amazon, so here it is :
Spartan.ist Motorcycle Saddlebags, 36L-58L Expandable Capacity, Motorcycle Panniers Universal, Waterproof, Detachable, Collapsible for Sport Dirt Bike Side Bags and Luggage


Comments

Comments are very often welcomed, provided you can string a legible, relevant and polite sentence together. In other cases probably best shared with your therapist, or kept to yourself.



6 thoughts on “Self-Hosting Ollama with Open WebUI on Windows: A Step-by-Step Guide

  1. Good to hear from you again and that you seem to be okay! This is way beyond me digitally but I will say I have used ChatGPT in my writing – not to do the writing but to run ideas against. Have to be careful there! Hope you are doing well!

    1. Likewise Noel. Life has been, well busy basically. I’m doing OK, but, you know how life is.

      I’m actually a relatively late adopter of ChatGPT etc. I don’t think it’s “great” for writing, but, like you say as an assistant – I actually wrote the above out myself first for a forum, and, then used AI to “improve” it here as a proof of concept, but, had to edit some things it got wrong, and, remove the “sales pitch” bits.

      And, of course it slants in the direction of it’s creator, so some things it’s pretty useless for.

      Also found AI handy for writing programming code, made some time saving programs. At the end of the day it’s a tool, and like any tool, if used well, can be helpful.

      I made the guide as simple as I could, hopefully some will be able to implement LOCAL and PRIVATE AI, for privacy.

      Best wishes to you and yours, hope you are well also.

      1. I never thought of ChatGPT for writing code, not that I am a coder. My son retired from the 82nd Airborne after 20 years and is now a student at Weber State with good benefits from the Army. He recently changed his major from Computer Science to Cyber Security. I think he will get a good job, maybe as an outside hire for the military.

        I hope you are doing well. I am aging – my body is telling me in so many ways. I just celebrated my 80th birthday but am in good health and at least look a lot younger. Walking and swimming are my exercises, although I loathe walking. I find it boring. I’m finishing up a book for publication in early 2025.

        Keep in touch!’

        Noelle

      2. ChatGPT and other AIs will write code, but, they have specific ones designed for that purpose.

        Good on your son, I looked into Cyber Security as a career pivot, but decided to go business route – AI would be the other “emerging” jobs market, off the top of my head. If you son has contacts still in military, that’s potentially very lucrative (I met someone who was doing just that, but with Networking).

        I’m doing OK, seem to get ill a lot easier these days, aging too, so body telling me the same. Congrats on 80th, and, good genetics + taking care of yourself 🙂

        Walking, yes (it is boring LOL), hard to find the motivation, some people listen to audiobooks or music – but best to keep active, even if it’s only 20-30 mins a day. Swimming I find takes up more time, with the changing, drying etc, but also a good exercise.

        Good job on the book, you seem an accomplished writer – seems like the hard bit is the writing, but, for commercial purposes, it’s selling copies, that’s often more challenging – ask me if there’s anything I can do, maybe able to offer advice, or, resources like this one – I don’t know your goals, or plan, so, can try help if I can.

        Same, keep in touch Noel.

        Cheers

        D

      3. Glad to hear you are doing OK, Don. You have to work hard to stay in place as you age. My walking has gotten shorter in length and I’m pretty tired at the end of the day. I like to say I can do everything I used to do but with rests factored in. I do love swimming and swim pretty much every day when the pool is open – laps and aerobics. A habit from when I was young. Lap swimming helps me solve problems! My son just retired from the 82nd Airborne after 20 years, so he still has contacts. I hope that will eventually help him get a lucrative military contract.

        My new book is YA about Daniel Boone – a topic I backed into. My other books are mysteries (5) and one historical novel about a Pilgrim woman. I hate editing and I hate marketing. Good thing I’m not in it for the money, huh?

        Do keep in touch. I enjoy hearing from you and also the photos you send!!

        Happy Christmas!

        Noelle

      4. Sorry for delay, I’ve either been flat out or exhausted. You’re welcome to post here anytime – but for more personal stuff may be better to email me – I think we did in the past, if not, let me know and, I’ll reach out to you.

        Wish I had more time to devote to writing, photography etc, but events of last few years have changed things for me dramatically.

        TC

        D

Comments are closed.