Something fun to start the new year:
I built a WordPress plugin that adds an LLM chatbot to any WordPress site, needing only an OpenAI-compatible API endpoint.
Includes configurable system prompt, sampler settings, starting assistant message, session management, and conversation history settings
In terms of security, it implements encrypted API keys, prepared SQL statements, input sanitization, nonce verification, and session-based rate limiting. Also has optional full conversation logging with IP tracking for monitoring.
The real value comes from a simple, self-contained RAG implementation that uses MySQL FULLTEXT search, allowing self-contained installation without requiring external databases or datasources. It reindexes site pages and posts on-demand and/or on post/edit.
With this basic indexing, users can ask questions about data in site pages and posts. Relevant content is retrieved and fed into context, allowing the model to automatically answer questions based on the site’s own data, complete with links to source pages.
Apache 2.0 license.
AightBits 
Leave a comment