Chatting

Create a new Chat

Click on the 'Create New Chat' button at the top of the sidebar to open the input form.

The description of each field is as follows.

Chat name

Set the chat name.

Flow

Select the type of chat.

In this application, different types of chats with different models and features are referred to as flows. The following flows are available in the Fujitsu Research Portal version:

• Simple chat
  • Allows conversation with the generation AI in chat format.
  • Fugaku-LLM is not available.
• Simple chat for Fugaku-LLM
  • Select this flow if you want to use Fugaku-LLM.
• Chat with retrievers
  • Allows chat while referencing documents registered in the document management feature.
  • In this feature, the AI references documents for every response.
  • Fugaku-LLM is not available.
• Chat with retriever for Fugaku-LLM
  • Select this flow if you want to use Fugaku-LLM with document referencing.

Retriever

When selecting a flow that references documents, you can choose the relevant retriever from the dropdown menu. Multiple retrievers can be selected. If multiple retrievers are selected, the search for content will be performed across all selected retrievers.

This option is not displayed for flows that do not reference documents.

Model

Select the model to use for generating responses.

Create button

Clicking the button will create a new chat and automatically open the chat screen. The created chat will also be added to the sidebar menu.

Chat with AI

Click on the chat tab in the sidebar. This will take you to the chat page.

If there is already a conversation in the chat, the chat history will be loaded. If not, you can start a new conversation. To chat with the AI, enter your question or statement in the text input area at the bottom of the chat page. Click the 'Send' button to submit your input.

The AI's response will be displayed.

You can continue the chat even after the AI's response.

Using Forms

By clicking the ✨ button at the bottom left of the chat input field, you can open a form that is available for use in the chat.

Once the form is displayed, you can enter values and generate AI responses based on the form input by clicking the send button. From simple "prompt engineering" to more complex processes, various functionality extensions can be invoked from the chat using forms.

In the Fujitsu Research Portal version, a sample form called "Word Explainer" is available.

This form allows you to input a "Word" and the AI will provide an explanation of that word. By entering appropriate "Roles" that can effectively describe the word, the quality of the explanation may be improved.

Operations for each massage

The icons at the bottom left of the conversation window can be used for the following:

The meanings of each icon are as follows:

• <> icon: Switch between text and markdown display
• Shield icon: call Hallucination Detection Feature
• Document icon: Display the reference location of the registered document that was used as the basis for the AI's answer
• Trash button: Delete the last conversation

Delete Chat

If you want to delete the chat itself, you can do so by clicking the trash button next to the chat title.

Deleted chats cannot be restored, so please be careful.

Chat Setting

You can change chat settings from the gear icon 'chat setting'.

Tokens Budget

You can adjust the tokens used by the AI model.

The following items can be set.

history tokens

Maximum token used to reference conversation history in chat

documents tokens

Maximum token used to reference documents

answer tokens

Maximum token used to generate answer

Both of them limit the maximum number of tokens that can be used. For example, even if you set 1000 for the answer tokens, it does not guarantee an output of 1000 tokens.

Toggle Chat Details

You can toggle the display of detailed chat information.