Add a model

If the built-in models cannot meet your needs, you can manually add the required models.

Prerequisites

• Make sure that the current login user in the OCP console is the ADMIN role.
• OCP only supports models compatible with the OpenAI API.
• You have obtained the base URL and API key of the target model vendor.
• If you want to add a model from an existing vendor, the model must be in the Connected state.

Procedure

1. Log in to the OCP console.

2. In the left-side navigation pane, choose System Management > External Integration. The AI Models page automatically appears.

3. In the Model Vendor section, click Add.

4. In the right-side panel, specify the model information.

   Parameter	Description
   Model Vendor	Select the large model vendor type. Valid values: Existing Vendors and Custom. Existing Vendors: specifies a model of an existing large model vendor. Custom: specifies a model of a custom large model vendor.
   Vendor Name	When Model Vendor is set to Existing Vendors, select a large model vendor. When Model Vendor is set to Custom, enter the name of the large model vendor. The name must be 2 to 32 characters in length. Note If the vendor name already exists in OCP, the new model will be aggregated with the models of this vendor.
   Model Type	Select the model type based on the use case. Chat: a model that is pre-trained on large-scale text data to learn language patterns and achieve general language understanding and generation. Embed: a model that focuses on converting text into fixed-length vectors to retain the semantic information of the data, facilitating subsequent similarity calculations and classification tasks. Rerank: a model that re-ranks the initial search results to improve the accuracy of the search system. These models typically combine context information and user intent to optimize the search results.
   Model Name	Enter the name of the model. The name must meet the following requirements: The name must be an actual existing model name of the large model vendor. The model name must be unique within the same large model vendor. The name must be 2 to 32 characters in length.
   Access Address	Enter the Base URL of the large model when Model Vendor is set to Custom. For example, https://api.deepseek.com/v1.
   API Key	Enter the AccessKey Secret (SK) of the large model when Model Vendor is set to Custom. The API key is masked by default, and you can view the plain text. After you configure Access Address and API Key, click Test to verify whether the information is correct.
   Remarks	Enter additional information about the model.

5. Click Add.

6. In the dialog box that appears, click OK. The model is displayed on the card of the original vendor.