Good question!
My Fibery Chatbot
The Fibery Chatbot (in my workspace) is very useful for me, but mainly because I have in my fibery workspace:
- Fibery scripts that are clearly tagged as ‘working’ (which is important for the Chatbot to know
- Full AI chats about code development that contain problems encountered and solutions created.
- An AI training document, which contains all the best practices, abilities and limitations of the Fibery API and common problems and their solutions, which I feed before co-developing a script with AI.
The User Guide Assistant
See: https://the.fibery.io/@public/ai-assistant/guide
This appears not very smart, it mostly dodges answers because it can’t find an answer in the User Guide. If it has an answer, it is very short. Because the user guide is relatively simple, the User Guide Assistant is not helpful for me. It has potential though if the Fibery team decides to hook it up with this Discourse platform, or more code examples made public.
Chatbot issue
With both My own Fibery Chatbot and the User Guide Assistant I have issues of freezing screens when inserting long inputs (see also 'Page Unresponsive' issue often happening with the AI Assistant chatbot
ChatGPT Plus
Although ChatGPT Plus uses also GPT4, in my experience it does much better than the OpenAI API GPT4. Answers are deeper and context is far better kept.
ChatGPT Plus is therefore still best of all in:
- Reasoning and Problem-Solving,
- Reliability and Accuracy,
- Contextual Understanding.
OpenAI API (GPT-3.5 and GPT-4-Preview)
I use in Fibery using scripts, which is the most promising and useful for now because I can automate chats and answers in entities and perform operations on them. This surpasses any of the above in usefulness when conversations directly relate to my fibery content.
Greatest drawback is its not well developed internet search. New regulations also make it not give details of website content.
Gemini Pro
Gemini Pro is the best of all in real time internet search and its ability to create google spreadsheets in one button click is amazing.
Its intelligence is still mediocre, it loses context and cant prioritize. But in tandem with ChatGPT Plus its works well.
Other LLMs
Currently I’m learning to work with HuggingFace
Coding Assistants (I tested them in VisualStudioCode):
- Github Copilot: The best of all AI coding assistants, but ChatGPT Plus is better in reasoning, therefore often more effective when analyzing complex and long pieces of code, or the creation of it. Benefit of the Copilot vs ChatGPT is the integration in code editors.
- TabNine AI: Okay
- Amazon Q: Okay
- Codium: Okay
AI Structured Conversations System
I’m creating a system that guides AI in conversations, its in development but already very helpful in maintaining context, priorities, reusing solutions and creating insights beyond its standard window of tokens. You can do this also simply by telling it to keep a simulated database with operations that need to be repeated and kept track of, including version naming etc.
P.s. Dont use free versions of any LLM, most of that is not useful for coding or deeper conversations.