Install Private-GPT 0.2 on Windows Server 2019/2022

Total time is about 30min, depending on your hardware and internet connection.
This will install PrivateGPT on a Windows 2019/2022 machine and run everything (including the LLMs) locally. After installation, no further Internet connection required for most operations.

Install the following pre-requisite software:
Git from
Python 3.11.7 from
Cmake from

If you’re using a Nvidia GPU, also install:
MS Visual Studio Community 2022 from
Nvidia cuda_12.2.0_536.25_windows.exe from

Open an administrative Powershell window and type:
c:\git clone
pip install poetry
python.exe -m pip install –upgrade pip

Set-ExecutionPolicy Bypass -Scope Process -Force; [System.Net.ServicePointManager]::SecurityProtocol = [System.Net.ServicePointManager]::SecurityProtocol -bor 3072; iex ((New-Object System.Net.WebClient).DownloadString(‘’))

choco install make
poetry install –with ui,local

The following may take a while:
poetry run python scripts/setup

To enable PrivateGPT to use the Nvidia GPU, type:
$env:CMAKE_ARGS=’-DLLAMA_CUBLAS=on’; $Env:LLAMA_CUBLAS=”1″; $Env:FORCE_CMAKE=”1″; poetry run pip install –force-reinstall llama-cpp-python

Add some file processors for .docx, .html, ebooks, sound:
poetry add docx2txt ebookLib html2text whisper

Start the Private-GPT with:
make run

If all went well, after a minute, you’ll have an output that shows something like:

Open a browser on the machine that Private-GPT was installed on and type:

Note: To remove uploaded files, stop the server and type:
make wipe

Leave a Reply

Your email address will not be published. Required fields are marked *