Create a Milvus data source

Before you create a data migration or data synchronization task, you must configure a data source. This topic describes how to create a Milvus data source in OceanBase Migration Service (OMS).

Prerequisites

You have obtained the IP address and port number of the database.

Procedure

1. Log in to the OMS console.

2. In the left-side navigation pane, click Data Source Management.

3. On the Data Source Management page, click New Data Source in the upper-right corner.

   

4. In the New Data Source dialog box, set Data Source Type to Milvus.

5. Configure the following parameters.

   Parameter	Description
   Data Source Identifier	We recommend that you use a combination of Chinese characters, digits, and letters. The name cannot contain spaces and must be no longer than 32 characters. Notice The data source ID must be unique in the OMS system.
   Region	Select the region where the data source is located from the drop-down list. The region is specified by the cm_region parameter when OMS is deployed. Notice This parameter is displayed only in a multi-region scenario. Make sure that the mapping between the data source and the region is consistent. Otherwise, the performance of data migration and synchronization may be poor.
   Host IP Address	The IP address of the database host. Enter the IP address of the physical RDS instance. Do not enter the IP address of the middleware.
   Port	The port number of the database host IP address. The default value is 19530.
   Username (Optional)	The username of the Milvus database for data migration.
   Password (Optional)	The password of the database user.
   Remarks (Optional)	The remarks of the data source.

   If you want to use the Milvus database as the source and select Incremental Synchronization in the data migration task, you must select the Incremental Synchronization option and configure the following parameters.

   Parameter	Description
   Kafka Data Source	Select the Kafka data source that stores the logs of the Milvus database from the drop-down list.
   Topic	Select the topics in the Kafka data source that store the logs of the Milvus database from the drop-down list. Make sure that the selected topics cover all topics required for incremental synchronization. Otherwise, data loss may occur during incremental synchronization, leading to data inconsistency. For more information, see Configure Milvus topics.
   etcd_endpoint	Enter the endpoint of the etcd service that stores the metadata of the Milvus database.
   etcd_root_path	The root prefix of the key in etcd where the Milvus database stores data.
   etcd_meta_sub_path	The subprefix of the key in etcd where the Milvus database stores metadata.
   Username (Optional)	The username of the Milvus database for connecting to etcd.
   Password (Optional)	The password of the Milvus database for connecting to etcd.

6. Click Test Connection to verify the network connection between OMS and the database and the validity of the username and password.

7. After the test is successful, click OK.