Creating An Application
In TalentBot Enterprise LLMops AIops, an "application" refers to a real-world scenario application built on large language models such as GPT. By creating an application, you can apply intelligent AI technology to specific needs. It encompasses both the engineering paradigms for developing AI applications and the specific deliverables.
In short, an application delivers to developers:
A user-friendly, encapsulated LLM API that can be called directly by backend or frontend applications with token authentication
A ready-to-use, beautiful, and hosted Web App that you can develop further using the Web App templates
A set of easy-to-use interfaces for Prompt Engineering, context management, log analysis, and annotation
You can choose one or all of them to support your AI application development.
TalentBot Enterprise LLMops AIops offers two types of applications: text generation and conversational. More application paradigms may appear in the future (we should keep up-to-date), and the ultimate goal of Dify is to cover more than 80% of typical LLM application scenarios. The differences between text generation and conversational applications are shown in the table:
Steps to Create an Application
After logging in as an administrator in TalentBot Enterprise LLMops AIops, go to the main navigation application page Click "Create New Application" Choose a conversational or text generation application and give it a name (modifiable later)
We provide some templates in the application creation interface, and you can click to create from a template in the popup when creating an application. These templates will provide inspiration and reference for the application you want to develop.
Creating from a Configuration File
If you have obtained a template from the community or someone else, you can click to create from an application configuration file. Uploading the file will load most of the settings from the other party's application (but not the datasets at present).
If you are using it for the first time, you will be prompted to enter your OpenAI API key. A properly functioning LLM key is a prerequisite for using TalentBot Enterprise LLMops AIops. If you don't have one yet, please apply for one.
After creating an application or selecting an existing one, you will arrive at an application overview page showing the application's profile. You can directly access your WebApp or check the API status here, as well as enable or disable them.
Statistics show the usage, active user count, and LLM call consumption of the application over a period of time—enabling you to continually improve the cost-effectiveness of application operations. We will gradually provide more useful visualization capabilities; please let us know what you want.
Daily AI interactions count; prompt engineering/debugging excluded.
Avg. Session Interactions
Continuous user-AI communication count; for conversation-based apps.
Avg. Response Time
Time (ms) for AI to process/respond; for text-based apps.
Unique users engaging in Q&A with AI; prompt engineering/debugging excluded.
User Satisfaction Rate
Likes per 1,000 messages; indicates satisfaction with AI answers.
Daily language model token usage; for cost control.