Vecy: On-device AI & LLM APP for RAG

Large Language Models (LLMs)
5.0
8 Views
24 Mar 2025
Startup Ideas AI

Vecy is an Android AI app that allows users to chat with fully-private LLMs and local files (documents, photos). It automatically processes and indexes local files on the phone, and users can also directly upload files. Vecy offers RAG tools for processing local files to enhance LLM responses. Users can select from a range of small LLMs (from 0.5B to 3.5B parameters) and engage in conversations with documents stored locally. The app automatically processes files (PDFs, DOCX documents, images, etc.) within the Documents, Download, and DCIM directories to generate embedding vectors, which are stored locally on the device. These embedding vectors are crucial for RAG (retrieval-augmented generation) capabilities, enhancing the LLM's ability to provide more accurate and relevant responses when queries are related to the local files.

Startup Ideas AI

12 Jun 2025
4.5/5
Rate this Tool
Featured
Promote this Startup
Copy Embedded Code

Have an awesome startup for founders?

Submit Startup
Feedback icon