Open source and AI-powered web search engine: local, private, dockerized and supported by a fluffy llamaš¦
SearchPhi is a Streamlit application that aims to implement similar features to SearchGPT, but in an open-source, local and private way.
git clone https://github.com/AstraBert/SearchPhi.git
cd SearchPhi
model
folder, download this GGUF file and move the GGUF file in the model
folder:mkdir model
mv /path/to/Downloads/Phi-3-mini-4k-instruct-q4.gguf model/
python3 -m venv /path/to/SearchPhi
source /path/to/SearchPhi/bin/activate
python3 -m pip install -r requirements.txt
c:\path\to\SearchPhi\Scripts\Activate.ps1 # For PowerShell
source c:\path\to\SearchPhi\Scripts\activate # For Git
python3 -m pip install -r requirements.txt
4. Run the application:
```bash
python3 -m streamlit run app.py
Youāll see the application on http://localhost:8501
.
PROs: You can customize the application code (change the GGUF model, change CPU/GPU settings, change generation kwargs, modify the app interfaceā¦)
CONs: Longer and more complex installation process
docker pull astrabert/searchphi:latest
docker run -p 8501:8501 astrabert/searchphi:latest
Shortly after you submit the docker run
command, the container logs will tell you that the application is up and running on http://localhost:8501
.
PROs: Shorter and simpler installation process
CONs: You cannot customize the application code
PROs: No local installation and you can exploit better hardwares
CONs: Limited resources
ā ļø The Streamlit application was successfully developed and tested on a Windows 10.0.22631 machine, with 32GB RAM, 16 core CPU and Nvidia GEFORCE RTX4050 GPU (6GB, cuda version 12.3), python version 3.11.9
ā ļø The Docker container was successfully tested on a Windows 10.0.22631 machine and on a Ubuntu 22.04.3 machine
Although being at a good stage of development, the application is a beta
and might still contain bugs and have OS/hardware/python version incompatibilities.
You can try out SearchPhi on this HuggingFace Space.
Hereās a video demo of what it can do:
Contributions are more than welcome! See contribution guidelines for more information :)
If you found this project useful, please consider to fund it and make it grow: letās support open-source together!š
This project is provided under MIT license: it will always be open-source and free to use.
If you use this project, please cite the author: Astra Clelia Bertelli