Skip to main content

"Fin" and/or "Lex" AI chat is providing incorrect or misleading responses. What's going on?

AI bots and LLMs can sometimes provide incorrect information.

Written by Jeremiah Hendrickson

In striving to be a helpful assistant, Lexful's AI can occasionally produce responses that are incorrect or misleading.


This is a known behavior of LLMs, and it's a limitation shared by all current Generative AI models, including the ones that power Lexful. For example, the AI might misinterpret relationships between assets, configurations, or procedures in your documentation. It could also generate plausible-sounding details about client environments, passwords, or procedures that aren't actually in your records.


For MSPs, accuracy matters. We understand that incorrect information about client configurations, network details, or procedures can have real consequences. That's why we recommend:

  • Verify critical information: Always double-check AI-generated responses against your source documentation, especially for sensitive data like passwords, IP addresses, or client-specific configurations.

  • Review cited sources: When Lexful references specific documents or articles, click through to verify the original content. Important context or details may not be fully captured in the AI's synthesis.

  • Trust but verify for high-stakes tasks: For critical procedures like disaster recovery, security incidents, or compliance audits, use Lexful as a starting point and validate against your authoritative documentation.

  • Keep documentation current: The AI can only be as accurate as the documentation it's trained on. Outdated or incomplete records increase the likelihood of inaccurate responses.

We're continuously improving Lexful's accuracy through better AI models, enhanced retrieval methods, and feedback from MSPs like you.

Note: Lex might hallucinate and say there is a button to attach a file in the chat thread, this is not actually possible, there is no option to attach files via chat.


Help us improve: Reach out to us using the "Feedback" or "Support" menu options in the Lexful UI with your feedback or suggestions.

Did this answer your question?