在用户的手机上离线运行大语言模型/LLM + edge

在用户的手机上离线运行大语言模型/LLM + edge

状态
Published
Tags
Resource
Tech_Tag
Created
Mar 21, 2024 05:12 PM
 
notion image

1

upscayl
upscaylUpdated Jun 11, 2025
🆙 Upscayl - Free and Open Source AI Image Upscaler for Linux, MacOS and Windows built with Linux-First philosophy.
场景:扩图
tag:离线,AGPL-3.0 license

2

LlamaEdge
LlamaEdgeUpdated Jun 10, 2025
The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
 

3

rag-stack
finic-aiUpdated Jun 5, 2025
🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization's knowledge base and use it as a corporate oracle. Supports open-source LLMs like Llama 2, Falcon, and GPT4All.
 

4

Queryable
mazzzystarUpdated Jun 8, 2025
Run OpenAI's CLIP model on iOS to search photos.
特性:iOS应用
中文名是寻隐(已上线App Store)
 

5

whisper.cpp
ggml-orgUpdated Jun 11, 2025
Port of OpenAI's Whisper model in C/C++
特性:支持iOS
 

6

llama.cpp
ggml-orgUpdated Jun 11, 2025
LLM inference in C/C++
特性:支持macOS