Use AI models

On the Models page of the AI services, you can browse and manage models in the model market, configure default models, manage data source model registration, and view API and SQL call examples for models. With these capabilities, you can enable applications to directly call models or leverage model capabilities through the AI functions in the database.

Features

The AI models page provides the following capabilities:

• Browse the model market: View the list of currently available models, filter models by provider or type, and enable or disable specific models.

• Compare model performance: Compare the 7-day performance trends and 24-hour availability of different models to assist in model selection.

• Configure default models: On the Basic Configuration tab, select default models for scenarios such as text generation, text embedding, text reordering, multimodal embedding, and multimodal reordering.

• manage data source model registration: After enabling this feature, the system will automatically handle database AI model registration, facilitating direct model call from the database side.

• View model call examples: Supports generating API call examples and SQL call examples to help you quickly complete integration and verification.

• Rate limiting: On the Throttling tab, set the upper limits for TPM and RPM for different model types.

Prerequisites

• You have activated the AI services and entered its page.

• You have created a usable API Key. For specific operations, see Manage AI API keys.

• If you need to call models via SQL in the database, log in to the database with a database account that has the ACCESS AI MODEL privilege. For more information, see Enable the AI function built-in AI models.

Data source model registration

Data source model registration controls database-side model registration capabilities. When enabled, the system automatically handles the capabilities required for database model registration. When disabled, you can still manually generate SQL and register it on the database side.

If your main use case involves calling models through SQL and AI functions, it is recommended to enable this option to simplify the database integration process.

Procedure

1. In the upper-right corner of the Models page, click Data Source Model Registration.

2. In the pop-up window, complete the following configuration:

   1. Select Instance: Supported only for instances of version V4.4.2 and later. Select the target instance for registering the AI model.

   2. Select Tenant: Select a tenant under the target instance.

   3. In the Models Callable by AI Functions section, select the model source:

      • Default Model: Directly select the already configured default model.

      • Custom Models: Specify a model from the list as needed.

   4. Select API Key: Select the API Key used for authentication. To create a new API Key, click Create API Key.

3. Click Generate SQL to obtain the SQL statement for registering the AI model.

For actual calls, you must log in to the database with a database account that has the ACCESS AI MODEL privilege to call the AI model.

The generated SQL can be used to complete the model registration in the target database.

View model call examples

In the upper-right corner of the Models page, click Model Call Examples to view API and SQL model call examples.

Call a model via API

On the Call Model via API tab, the page displays an example of calling a model through an HTTP interface. The process is as follows:

1. Create an API Key for authentication.

2. Use the API Key to call the model through an HTTP request.

For more information, see AI APIs.

 curl -X POST https://ai-api-g.oceanbase.com/api/v1/chat/completions \
    -H "Authorization: Bearer YOUR_API_KEY" \
    -H "Content-Type: application/json" \
    -d '{"model": "qwen3-max", "messages": [{"role": "user", "content": "Hello"}]}'

Call a model via SQL

On the Call Model via SQL tab, the page displays an example of calling a model in the database using the AI function. You can call the model in SQL as follows:

SELECT AI_COMPLETE("ob_complete","How are you") AS ans;
SELECT AI_EMBEDDING("ob_embed","I am OceanBase Cloud AI") AS embedding;
SELECT AI_RERANK("ob_rerank","Apple",["apple","banana","fruit","vegetable"]) AS rerank_result;

Rate limits & quotas

Project admins and project owners can set model-specific rate limits for the current project. The upper limit of a project's rate limit depends on the organization-level rate limit. To request a higher quota, contact the organization admin to increase the organizational rate limit.

The default rate limits & quota for each model type are as follows:

Modify rate limits & quotas

You can modify the rate limits & quota for each model type. The procedure is as follows:

1. On the Models page, switch to the Rate Limits & Quotas tab and locate the model type you want to modify in the list.

2. Click ··· in the Actions column of the corresponding row. In the pop-up window, adjust the values for Monthly Quota (M Tokens), Tokens per Minute (TPM), and Requests per Minute (RPM). The modified values must not exceed the upper limit of the organization-level rate limit.

3. Click the checkmark icon to complete the modification.