mirror of
https://github.com/abhinavxd/libredesk.git
synced 2026-09-11 21:39:00 +00:00
Abhinav Raut
40f8284e98
When the agent built conversation history and mined FAQs, it used the raw message text, which included the full quoted reply chain from every email. That wasted tokens and confused the model with old back-and-forth. Add emailquote.go to strip quoted blocks. HTML messages get their quote containers pruned (gmail, yahoo, protonmail, outlook markers, and blockquotes); plain text gets trailing ">" lines and "On ... wrote:" / "Original Message" markers trimmed. If stripping leaves nothing (a quote-only reply or forward), we fall back to the full text so the message is not dropped. Add the matching protonmail_quote selector to the frontend hide-quoted-text styles so the two stay in sync. Also fix knowledge base chunking: plain text with no block structure was kept as one chunk and could overflow the model limit. It now packs into size-bound pieces on sentence boundaries, and oversized atomic blocks are flushed and truncated on their own so they can never sneak through.