VNCai Overview¶
VNCai is a secure, privacy-focused generative AI platform integrated into the VNClagoon enterprise suite. It enables the user to interact with the VNCai agent (Vincent) through VNCtalk for 1:1 or group chats, where the AI-Agent can be queried in a multi user conversation, and the VNCfluid dashboard for knowledge queries to the OVMS (OpenVINO™ Model Server) backend.
VNC focuses on leveraging the power of AI (Artificial Intelligence) within the VNClagoon environment to provide efficient and secure ways to manage tasks, projects, and other work-related activities.
VNClagoon integrates local AI with Intel Lunar Lake and OpenVINO to provide a secure, efficient, and privacy-centric collaboration suite. By processing AI-enhanced features directly on user devices, VNClagoon ensures sensitive data remains protected while delivering powerful functionality.
VNClagoon AI is currently accessible in VNCtalk and VNCfluid via the Web Client and the VNCtalk Desktop Client, which is enabling local AI. Users can interact with VNClagoon AI (Vincent/Vincenta) in a number of ways. These include direct interaction in one-to-one or group chats, as well as the use of generative AI to create new content and assist with various daily tasks.
Key capabilities include querying
- external data provided by pre-compiled publically availabe Open Source LLMs (Large Language Models) such as TinyLlama, LLAMA2, LLAMA3 and GGML Large V3.
- internal data provided by RAG (Retrieval-Augmented Generation) which composes of processed documents, information and sources managed by VNC administration to the
VNClagoon's VNCai platform provides the following features and functionalities
| Feature | Description |
|---|---|
| 1:1 Chat with AI via VNCtalk | Enables one-on-one chats with AI agent (Vincent) in VNCtalk, allowing users to switch between local (internal data) and server-side LLMs. Initiated by starting a chat with "Agent Vincent" in contacts or recent list. |
| Group Chat with AI via VNCtalk | Adds AI agent as a participant in group chats for real-time assistance, such as answering queries or summarizing discussions. Enable AI with the "AI" icon and prompt using "@Agent Vincent [Question]". Supports sharing media and documents for analysis within the chat group. |
| Access AI via VNCfluid Dashboard | Provides a unified interface in VNCfluid for natural language queries to the VNClagoon knowledge base, including internal/external data prompts and translations. Responses appear in the same dashlet. |
| Prompt to Internal Data | Allows querying secure internal VNClagoon data (e.g. products, documents) with AI responses based solely on verified company information when Use Internal Data option is enabled. |
| Prompt to External Data | Enables queries on general topics outside VNClagoon (e.g. weather, sightseeing, generative AI explanations) using preset external sources provided by the Open Source LLMs configured in the OVMS backend or downloaded and installed as plugin to the stand alone desktop client. |
| Document Sharing | Supports secure upload of various file formats (e.g. txt, docx, pdf, csv, xlsx, jpg, png, gif, mp3, wav, mp4) directly into chats or from local sources. |
| Translating Documents/Texts | Translates text or documents into multiple languages (e.g., English to German). |
| Summarizing Documents/Conversations/Texts | Generates summaries or key points from uploaded documents, chat conversations or pasted text. Specify the output format like word count or bullet points for better results. |
| Summarizing Video/Audio | Creates summaries or key points from video/audio files (.mp3, .mp4, .wav) provided as attachments via chat to the VNCai agent. |
| Ask AI for Content of Attached Documents | Extracts and answers questions about information in uploaded documents (e.g. PDF, DOC) directly in chats, maintaining context for targeted responses. |
| Ask AI about Content of Audio/Video Recordings | Analyzes and responds to queries about audio/video content (.mp3, .mp4, .wav) uploaded as attachment or provided via URLs. |
| Compare Documents | Analyzes and compares multiple documents to identify structural differences based on general focus, content, tone, and format. |
| Schedule Meetings with AI via VNCtalk | Generates meeting invitations from provided key points (topic, location, date, time, duration, attendees). AI then compiles a meeting agenda for the Meeting description and personalized eMails to the invitees and sends it to participants. |
| AI Settings Customization | Adjusts parameters for text generation: max_new_tokens (0-1000 for response length), temperature (0-4 for randomness/creativity), top_p (0-1 for nucleus sampling), and top_k (1-vocabulary size for token selection) to balance coherence and diversity for tasks like technical or creative writing. |
Documentation references