top of page

Creating An Application

In TalentBot Enterprise LLMops AIops, an "application" refers to a real-world scenario application built on large language models such as GPT. By creating an application, you can apply intelligent AI technology to specific needs. It encompasses both the engineering paradigms for developing AI applications and the specific deliverables.

In short, an application delivers to developers:

  • A user-friendly, encapsulated LLM API that can be called directly by backend or frontend applications with token authentication

  • A ready-to-use, beautiful, and hosted Web App that you can develop further using the Web App templates

  • A set of easy-to-use interfaces for Prompt Engineering, context management, log analysis, and annotation

You can choose one or all of them to support your AI application development.

Application Types

TalentBot Enterprise LLMops AIops offers two types of applications: text generation and conversational. More application paradigms may appear in the future (we should keep up-to-date), and the ultimate goal of Dify is to cover more than 80% of typical LLM application scenarios. The differences between text generation and conversational applications are shown in the table:

image.png

Steps to Create an Application

After logging in as an administrator in TalentBot Enterprise LLMops AIops, go to the main navigation application page Click "Create New Application" Choose a conversational or text generation application and give it a name (modifiable later)

image.png

We provide some templates in the application creation interface, and you can click to create from a template in the popup when creating an application. These templates will provide inspiration and reference for the application you want to develop.

Creating from a Configuration File

If you have obtained a template from the community or someone else, you can click to create from an application configuration file. Uploading the file will load most of the settings from the other party's application (but not the datasets at present).

Creating from a Configuration File.jpg

Your Application

If you are using it for the first time, you will be prompted to enter your OpenAI API key. A properly functioning LLM key is a prerequisite for using TalentBot Enterprise LLMops AIops. If you don't have one yet, please apply for one.

image.png

After creating an application or selecting an existing one, you will arrive at an application overview page showing the application's profile. You can directly access your WebApp or check the API status here, as well as enable or disable them.

Statistics show the usage, active user count, and LLM call consumption of the application over a period of time—enabling you to continually improve the cost-effectiveness of application operations. We will gradually provide more useful visualization capabilities; please let us know what you want.

application .jpg

Total Messages

Total Messages.png

Daily AI interactions count; prompt engineering/debugging excluded.

Active Users.png

Avg. Session Interactions

Average Session Interactions.png

Continuous user-AI communication count; for conversation-based apps.

User Satisfaction Rate.png

Avg. Response Time

Time (ms) for AI to process/respond; for text-based apps.

Token Usage.png

Active Users

Unique users engaging in Q&A with AI; prompt engineering/debugging excluded.

User Satisfaction Rate

Likes per 1,000 messages; indicates satisfaction with AI answers.

Token Usage

Daily language model token usage; for cost control.

bottom of page