Something fun to start the new year:

I built a WordPress plugin that adds an LLM chatbot to any WordPress site, needing only an OpenAI-compatible API endpoint.

Includes configurable system prompt, sampler settings, starting assistant message, session management, and conversation history settings

In terms of security, it implements encrypted API keys, prepared SQL statements, input sanitization, nonce verification, and session-based rate limiting. Also has optional full conversation logging with IP tracking for monitoring.

The real value comes from a simple, self-contained RAG implementation that uses MySQL FULLTEXT search, allowing self-contained installation without requiring external databases or datasources. It reindexes site pages and posts on-demand and/or on post/edit.

With this basic indexing, users can ask questions about data in site pages and posts. Relevant content is retrieved and fed into context, allowing the model to automatically answer questions based on the site’s own data, complete with links to source pages.

Apache 2.0 license.

https://github.com/AightBits/aightbot

Leave a Reply

Dave Ziegler

Director of Technology & AI Safety for The Human Line Project and a driver of LLM/chatbot literacy, safety, policy, ethics, and industry transparency/accountability.

Full-stack AI/LLM practitioner and solutions architect with 35+ years IT, application development, consulting, and technical communication experience.

Founder of Ziegler Technical Solutions, which provided practical AI/LLM development, consulting, and deployment services with a focus on secure, safe, ethical, and properly scoped applications.

Founding Member, AI Mental Health Collective

Community Moderator / SME, The Human Line Community

Let’s connect

Discord: AightBits

Discover more from AightBits

Subscribe now to keep reading and get access to the full archive.

Continue reading