This topic describes how to create a data source in OceanBase Cloud.
Background information
A data source is a collection of database connection information, including the connection address, port, username, and password. In OceanBase Cloud, by configuring a data source, you can quickly establish connections to databases for tasks such as data migration and job scheduling, improving operational efficiency and reliability.
Currently, OceanBase Cloud supports data sources from cloud providers including AWS, Huawei Cloud, Alibaba Cloud, and Azure. It supports the following database types: OceanBase Database in MySQL-compatible mode and Oracle-compatible mode, MySQL databases (including Aurora MySQL, RDS MySQL, PolarDB MySQL, Azure MySQL, and self-managed MySQL), Oracle databases (including RDS Oracle and self-managed Oracle), Kafka (including cloud instances and self-managed Kafka), PostgreSQL databases (including RDS PostgreSQL, Azure for PostgreSQL, and self-managed PostgreSQL), and self-managed TiDB databases.
The connection method for a data source varies depending on the database type. Please select the appropriate connection method based on your database type.
OceanBase data sources (MySQL and Oracle compatibility modes)
For OceanBase Database, OceanBase Cloud provides three connection methods.
Quick connection to an OceanBase Cloud instance: This method is suitable for OceanBase Database instances created through the OceanBase Cloud console.
Endpoint connection or public network connection: This method is suitable for OceanBase Database deployed on infrastructure of AWS, Huawei Cloud, Alibaba Cloud, or Azure.
Prerequisites
You have created an instance and a tenant in the OceanBase Cloud console (either MySQL-compatible or Oracle-compatible mode is acceptable), and have an available database and account.
You have the permissions of Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left navigation bar, click Data Services > Data Source.
On the Data Source page, depending on your actual situation, click Create Data Source in the upper-right corner > OceanBase MySQL Compatible or OceanBase Oracle Compatible.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select OB Cloud Instance. Instance Type Includes Cluster Instance (Transactional), Cluster Instance (Flagship), Tenant Instance, and Cluster Instance (Analytical). This option is only displayed when Connection Method is set to OceanBase Cloud Instance. Note
Data migration only supports Flagship Edition instances and Cluster Instances (Analytical).
Instance Select the target instance from the drop-down list. This option is only displayed when Connection Method is set to OB Cloud Instance. Database Account The username of the OceanBase database. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have created an endpoint service for connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, depending on your actual situation, click Create Data Source in the upper-right corner and then select OceanBase MySQL Compatible or OceanBase Oracle Compatible.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Endpoint. Connection Information Enter the endpoint service name of the selected cloud provider. Instance The ID or name of the instance where the OceanBase database is located. You can view the ID or name of the target instance on the Instances page. Note
When the cloud provider is Alibaba Cloud, you can also select an instance of the Alibaba Cloud root account for cross-account authorization. For details, see Alibaba Cloud Account Authorization.
Tenant The ID or name of the OceanBase database tenant. Database Account The username of the OceanBase database user. Password The password of the database user. After selecting Connection Method as Endpoint, you can also decide whether to perform advanced settings based on your actual situation.
Notice
If the new migration task requires incremental synchronization, please enable both the sys tenant account and the incremental log proxy service.
ParameterDescriptionsys Tenant Account After enabling the sys tenant account, you need to enter the sys account and password. - Sys Account: The name of the sys user. This user is mainly used to read incremental logs and database object structure information from OceanBase Database. Please create it under the sys tenant of the business cluster.
- Password: The password of the sys user.
Incremental Log Proxy Service After enabling the incremental log proxy service, enter the OBLogProxy Connection Information. OBLogProxy is the incremental log proxy service for OceanBase Database. It provides real-time access to and management of incremental log projects, making it easier for applications to access incremental logs from OceanBase Database. It also enables incremental log subscription in network-isolated environments. The format is OBLogProxy IP:OBLogProxy Port.Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the allowlist of security groups for AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, depending on your requirements, click Create Data Source in the upper-right corner and select OceanBase MySQL Compatible or OceanBase Oracle Compatible.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Public IP. Connection Information Enter the IP address or hostname for the connection. Instance The ID or name of the instance where the OceanBase database is located. You can view the target instance's ID or name on the Instances page. Note
When the cloud provider is Alibaba Cloud, you can also select an Alibaba Cloud root account instance for cross-account authorization. For details, see Alibaba Cloud Account Authorization.
Tenant The ID or name of the OceanBase database tenant. Database Account The username of the OceanBase database user. Password The password of the database user. After selecting Connection Method as Public IP, you can decide whether to perform advanced settings based on your actual situation.
Notice
If the migration task you create requires incremental synchronization, you must also enable the sys tenant account and the incremental log proxy service.
ParameterDescriptionsys Tenant Account After enabling the sys tenant account, you need to enter the account and password of the sys tenant. - Sys Account: The name of the sys user. This user is mainly used to read incremental logs and database object structure information from OceanBase Database. Please create it under the sys tenant of the business cluster.
- Password: The password of the sys user.
Incremental Log Proxy Service After enabling the incremental log proxy service, enter the OBLogProxy Connection Information. OBLogProxy is the incremental log proxy service for OceanBase Database. It provides real-time access to and management of incremental log projects, making it easier for applications to access incremental logs from OceanBase Database. It also enables incremental log subscription in network-isolated environments. The format is OBLogProxy IP:OBLogProxy Port.Click Test Connection.
After the test connection succeeds, click Save.
OceanBase HBase API compatible mode
For the OceanBase HBase API compatible mode, OceanBase Cloud provides a quick connection for an OceanBase Cloud instance.
Prerequisites
You have created a cluster instance of the KV or Flagship Edition and a tenant in OceanBase HBase API-compatible mode, and have an available database and account.
You have Organization Admin or Project Admin permissions in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left navigation pane, click Data Services > Data Source.
On the Data Source page, depending on your actual situation, click Create Data Source in the upper-right corner > OceanBase HBase API Compatible.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select OceanBase Cloud Instance. Instance Type Includes Cluster Instance (Key-Value) or Cluster Instance (Flagship) Instance Select the target instance from the drop-down list. Tenant Select the target tenant from the drop-down list. Database Account The username of the OceanBase database. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
MySQL data source
For MySQL databases, OceanBase Cloud provides two connection methods: endpoint connection and public network connection.
Prerequisites
You have created an endpoint service for connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source > MySQL in the upper-right corner.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Endpoint. You must first add the account ID displayed on the page to the allowlist of your endpoint service to allow the endpoint of this account to connect to the endpoint service. For details, see the documentation in the Select Private Link section.
When you select Cloud Vendor as AWS and you selected Enable for the Require Acceptance to Use Endpoint parameter when creating the endpoint service, the Data Migration Service will prompt you to enter the AWS console to Accept the Endpoint Connection Request when it first accesses the private link.Instance Type - When you select Cloud Vendor as Alibaba Cloud, the instance types supported are RDS MySQL, PolarDB MySQL, and Self-managed MySQL.
- When you select AWS as the cloud provider, the instance types supported are Aurora MySQL, RDS MySQL, and Self-managed MySQL.
- When you select Huawei Cloud as the cloud provider, the instance types supported are RDS MySQL and Self-managed MySQL.
- When you select Azure as the cloud provider, the instance types supported are Azure MySQL and Self-managed MySQL.
Connection Information Enter the name of the endpoint service of the selected cloud provider. Database Account The username of the MySQL database. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the security group allowlist on AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Sources page, click Create Data Source in the upper-right corner and select MySQL.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Public IP. You must first add the data source IP address displayed on the page to the allowlist of the MySQL database instance to ensure connectivity. For more information, see the Select a public network connection section. Instance Type - If Cloud Vendor is set to Alibaba Cloud, the instance type supports RDS MySQL, PolarDB MySQL, and Self-managed MySQL.
- If the cloud provider is set to AWS, the instance type supports Aurora MySQL, RDS MySQL, and Self-managed MySQL.
- If the cloud provider is set to Huawei Cloud, the instance type supports RDS MySQL and Self-managed MySQL.
- If the cloud provider is set to Azure, the instance type supports Azure MySQL and Self-managed MySQL.
Connection Information Enter the IP address or hostname to connect to. Database Account The username of the MySQL database. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
Oracle data source
For Oracle databases, OceanBase Cloud provides two connection methods: endpoint connection and public network connection.
Prerequisites
You have created an endpoint service for connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner > Oracle.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Endpoint. You must first add the account ID displayed on the page to the allowlist of your endpoint service to allow the endpoint of this account to connect to the endpoint service. For details, see the documentation in the Select Private Link section.
When Cloud Vendor is set to AWS, if you selected Enable for the Require Acceptance to Use Endpoint parameter when creating the endpoint service, you will be prompted to enter the AWS console to Accept Endpoint Connection Request for the received connection request when the data migration service accesses the private link for the first time.Instance Type - When the cloud provider is AWS, the instance types supported are RDS Oracle and Self-managed Oracle.
- When the cloud provider is Alibaba Cloud, Huawei Cloud, or Azure, the instance type supported is Self-managed Oracle.
Connection Information Enter the name of the endpoint service of the selected cloud provider. Service Name The service name of the Oracle database. Database Account The username of the Oracle database. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the security group allowlist on AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source > Oracle in the upper-right corner.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Public IP. You must first add the data source IP address displayed on the page to the allowlist of the Oracle database instance to ensure connectivity. For more information, see the Select a public network connection section. Instance Type - If the cloud provider is set to AWS, the instance type can be RDS Oracle or Self-managed Oracle.
- If the cloud provider is set to Alibaba Cloud, Huawei Cloud, or Azure, the instance type can be Self-managed Oracle.
Connection Information Enter the IP address or hostname to connect to. Service Name The service name of the Oracle database. Database Account The username of the Oracle database user. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
Kafka data source
For Kafka instances, OceanBase Cloud provides two connection methods: endpoint connection and public network connection.
Prerequisites
You have created an endpoint service for connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source > Kafka in the upper-right corner.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Endpoint. You must first add the account ID displayed on the page to the allowlist of your endpoint service to allow the endpoint of this account to connect to the endpoint service. For details, see the documentation in the Select Private Link section.
When Cloud Vendor is set to AWS, if you selected Require Enable for the Require Accept to Use Endpoint parameter when creating the endpoint service, you will be prompted to enter the AWS console to perform the Accept Endpoint Connection Request operation for the received connection request when the data migration service accesses the private link for the first time.Instance Type Includes Self-managed Kafka and Cloud Instance Kafka. Connection Information Enter the name of the endpoint service of the selected cloud provider and the Kafka access point. Notice
- For cloud-managed Kafka on Alibaba Cloud, you cannot enter a domain name when entering the Kafka access point; only an IP address is supported.
Based on your business requirements, choose whether to enable SASL under Security Authentication. If SASL is enabled, configure the following parameters.
ParameterDescriptionAuthentication Method Supports PLAIN, SCRAM-SHA-256, and SCRAM-SHA-512. - The PLAIN authentication method is relatively simple but does not support dynamic user changes and configures the username and password in plaintext, which is not secure.
- SCRAM (Salted Challenge Response Authentication Mechanism) addresses security issues by using the traditional mechanism of username and password authentication. Kafka supports SCRAM-SHA-256, which can be used with TLS to perform secure authentication.
This authentication method allows for dynamic user changes, and user data is stored in Zookeeper. Before starting a broker, communication with Zookeeper is required to create a communication user between Zookeeper and the broker. However, this authentication method requires configuring the username and password in plaintext. - Kafka supports SCRAM-SHA-512, which can be used with TLS to perform secure authentication.
Username The username used for data migration. Password The password of the user used for data migration. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the allowlist of the security group in AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select Kafka.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Public IP. You must first add the data source IP address displayed on the page to the allowlist of the Kafka instance to ensure connectivity. For details, see the documentation in the Select a public network connection section. Instance Type Includes Self-managed Kafka and Cloud Instance Kafka. Connection Information Enter the Kafka access point information. If the security authentication configuration for the Kafka data source is not completed, the data migration task using this data source as the source or target may fail. The configuration area for security authentication is as follows.
Click Upload File to upload the trust certificate with the
.jksextension.Based on your business requirements, choose whether to enable SASL. If you enable SASL, configure the following parameters.
ParameterDescriptionAuthentication Method Supports PLAIN, SCRAM-SHA-256, and SCRAM-SHA-512. - The PLAIN authentication method is relatively simple but cannot dynamically change users and configures the username and password in plaintext, which is not secure.
- The SCRAM (Salted Challenge Response Authentication Mechanism) authentication method addresses security issues by implementing the traditional username and password authentication mechanism. Kafka supports SCRAM-SHA-256, which can be used with TLS to perform security authentication.
This authentication method allows dynamic user changes, and user data is stored in Zookeeper. Before starting a broker, communication with Zookeeper is required to create a communication user for the broker. However, this authentication method requires configuring the username and password in plaintext. - Kafka supports SCRAM-SHA-512, which can be used with TLS to perform security authentication.
Username The username used for data migration. Password The password for the user used for data migration.
Click Test Connection.
After the test connection succeeds, click Save.
PostgreSQL data source
For PostgreSQL databases, OceanBase Cloud provides two connection methods: endpoint connection and public network connection.
Prerequisites
You have created an endpoint service for connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner > PostgreSQL.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Endpoint. You must first add the account ID displayed on the page to the allowlist of your endpoint service to allow the endpoint of this account to connect to the endpoint service. For details, see the documentation in the Select Private Connection section.
When Cloud Vendor is set to AWS, if you selected Enable for the Require Acceptance to Use Endpoint parameter when creating the endpoint service, you will be prompted to enter the AWS console to Accept the Endpoint Connection Request for the received connection request when the data migration service accesses the private connection for the first time.Instance Type - When the cloud provider is AWS, the instance types supported are RDS PostgreSQL, Aurora PostgreSQL, and Self-managed PostgreSQL.
- When the cloud provider is Alibaba Cloud or Huawei Cloud, the instance types supported are RDS PostgreSQL and Self-managed PostgreSQL.
- When the cloud provider is Azure, the instance types supported are Azure for PostgreSQL and Self-managed PostgreSQL.
Connection Information Enter the name of the endpoint service for the selected cloud provider. Database Name The name of the PostgreSQL database. Database Account The username of the PostgreSQL database user. Password The password of the database user. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the security group allowlist on AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select PostgreSQL.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Public IP. You must add the data source IP address displayed on the page to the allowlist of the PostgreSQL database instance to ensure connectivity. For more information, see the Select a public network connection section. Instance Type - If the cloud provider is AWS, the instance types supported are RDS PostgreSQL, Aurora PostgreSQL, and Self-managed PostgreSQL.
- If the cloud provider is Alibaba Cloud or Huawei Cloud, the instance types supported are RDS PostgreSQL and Self-managed PostgreSQL.
- If the cloud provider is Azure, the instance types supported are Azure for PostgreSQL and Self-managed PostgreSQL.
Connection Information Enter the IP address or hostname to connect to. Database Name The name of the PostgreSQL database. Database Account The username for the PostgreSQL database. Password The password for the database user. Click Test Connection.
After the connection test succeeds, click Save.
TiDB data source
For TiDB databases, OceanBase Cloud provides two connection methods: endpoint connection and public network connection.
Prerequisites
You have created an endpoint service for the connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select TiDB.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Endpoint. You must first add the account ID displayed on the page to the allowlist of your endpoint service to allow the endpoint of this account to connect to the endpoint service. For details, see the documentation in the Select Private Network Connection section.
When Cloud Vendor is set to AWS, if you selected Enable for the Require Acceptance to Use Endpoint parameter when creating the endpoint service, you will be prompted to enter the AWS console to Accept the Endpoint Connection Request when the data migration service accesses the private connection for the first time.Instance Type Currently only supports Self-managed TiDB. Connection Information Enter the name of the endpoint service of the selected cloud provider. Database Account The username of the TiDB database. Password The password of the database user. Click Test Connection.
After the test connection succeeds, click Save.
Prerequisites
You have the permission to modify the allowlist of security groups on AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and then select TiDB.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud, AWS, Huawei Cloud, and Azure. Region Select the region where the data source is located. Connection Type Select Public IP. You must first add the data source IP address displayed on the page to the allowlist of the TiDB database instance to ensure connectivity. For more information, see the Select a public network connection section. Instance Type Currently only supports Self-managed TiDB. Connection Information Enter the IP address or hostname for the connection. Database Account The username for the TiDB database. Password The password for the database user. If you need to obtain incremental data from TiDB via Kafka, fill in the Incremental Sync Settings section to enable the Binlog and TiCDC data sources. If you do not configure this section, you will not be able to select Incremental Synchronization on the Select Type & Objects page when creating a data migration task from a new TiDB database to OceanBase Database in MySQL-compatible mode.
ParameterDescriptionKafka Data Source The Kafka data source is used to store information about Binlogs and incremental logs of TiDB data converted by the TiCDC tool, facilitating consumption by data migration. Note
You can only select a Kafka data source from the same cloud provider as TiDB.
Topic Select the topic of the Kafka data source to bind from the drop-down list. TiDB Data Format When migrating data from a TiDB database to OceanBase Database in MySQL-compatible mode, you can choose data in TiCDC or TiDB Binlog format. Select from the drop-down list. Click Test Connection.
After the connection test succeeds, click Save.
HBase data source
For an HBase data source, OceanBase Cloud provides a public network connection method.
Prerequisites
You have the permission to modify the allowlist of the security group for AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select HBase.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud. Region Select the region where the data source is located. Connection Type Select Public IP. You must first add the displayed data source IP address to the allowlist of the HBase database instance to ensure connectivity. For details, see the Select a public network connection section. Instance Type Currently only supports Alibaba Cloud HBase Enhanced Edition. Connection Information Enter the IP address or hostname for the connection. Port The port used for accessing your database. The specific value depends on your endpoint service configuration. Database Account The username for the HBase database. Password The password for the database user. If you need to obtain HBase incremental data via Kafka, please fill in the Kafka data source and Topic. Missing configurations may result in unavailable incremental synchronization.
ParameterDescriptionKafka Data Source You can select a Kafka data source saved during data transfer. For details, see the Kafka data sources section in this topic. Note
You can only select a Kafka data source from the same cloud provider.
Topic You can select or enter a Topic. Incremental Data Format Select the supported incremental data format. Currently supports DEBEZIUM_V2. Click Test Connection.
After the connection test succeeds, click Save.
Lindorm data source
For a Lindorm data source, OceanBase Cloud provides a public network connection method.
Prerequisites
You have the permission to modify the allowlist of the security group for AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select Lindorm.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud. Region Select the region where the data source is located. Connection Type Select Public IP. You must first add the displayed data source IP address to the allowlist of the Lindorm database instance to ensure connectivity. For details, see the Select a public network connection section. Instance Type Currently only supports Alibaba Cloud Lindorm. Connection Information Enter the IP address or hostname to connect to. Port The port used for accessing your database. The specific value depends on your endpoint service configuration. Database Account The username for the Lindorm database. Password The password for the database user. If you need to obtain Lindorm incremental data via Kafka, please fill in the Kafka data source and Topic. Missing configurations may result in unavailable incremental synchronization.
ParameterDescriptionKafka Data Source You can select a Kafka data source saved during data transmission. For details, see the Kafka data sources section in this topic. Note
You can only select a Kafka data source from the same cloud provider.
Topic You can select or enter a Topic. Incremental Data Format Select the supported incremental data format. Currently supports DEBEZIUM_V2. Click Test Connection.
After the connection test succeeds, click Save.
RocketMQ data source
For the RocketMQ data source, OceanBase Cloud provides both public network and private network connection methods.
Prerequisites
You have created an endpoint service for the connection on AWS, Huawei Cloud, Alibaba Cloud, or Azure, and have the permission to modify the endpoint allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner > RocketMQ.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud or AWS. Region Select the region where the data source is located. Connection Type Select Private Network. You must first add the account ID displayed in How to obtain? to the allowlist of your endpoint service to allow the endpoint of this account to connect to the endpoint service. For details, see the Select a private link section. Note
When the cloud provider is set to AWS, if you selected Required for the parameter Require Acceptance to Use Endpoint when creating the endpoint service, the Data Migration Service will prompt you to enter the AWS console to perform the Accept Endpoint Connection Request operation for the received connection request when accessing the private connection for the first time.
Instance Type The default is Self-managed RocketMQ. Namesrv Configuration Enter the endpoint service information and corresponding RocketMQ access point information for the namesrv configuration. Notice
Ensure that each endpoint service node corresponds one-to-one with a RocketMQ access point.
Broker Configuration Enter the endpoint service information and corresponding RocketMQ access point information for the broker configuration. Notice
Ensure that each endpoint service node corresponds one-to-one with a RocketMQ access point.
Based on your business requirements, choose whether to enable Security Authentication. If enabled, configure the following parameters.
ParameterDescriptionAuthentication Method You can select AccessKey. AccessKey The AccessKey ID you created in the cloud account management console, used for authentication. SecretKey The AccessKey Secret you created in the cloud account management console, used for authentication. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the security group allowlist on AWS, Huawei Cloud, Alibaba Cloud, or Azure.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select RocketMQ.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud and AWS. Region Select the region where the data source is located. Connection Type Select Public IP. Instance Type - The Alibaba Cloud channel supports RocketMQ on Alibaba Cloud and Self-managed RocketMQ.
- The AWS channel only supports Self-managed RocketMQ.
RocketMQ Access Point Enter the RocketMQ access point ID and port. You must first add the data source IP address displayed on the page to the allowlist of the RocketMQ instance to ensure connectivity. For details, see the documentation in the Select a public network connection section. Based on your business requirements, choose whether to enable Security Authentication. If enabled, configure the following parameters.
Note
- When the data source is a RocketMQ cloud instance on Alibaba Cloud V4.x, you need to enter the AK/SK corresponding to the cloud account.
- When the data source is a RocketMQ cloud instance on Alibaba Cloud V5.x, you need to enter the AK/SK that controls access to the cloud instance.
ParameterDescriptionAuthentication Method You can select AccessKey. AccessKey The AccessKey ID you created in the cloud account management console, used for identity authentication. SecretKey The AccessKey Secret you created in the cloud account management console, used for identity authentication. Click Test Connection.
After the connection test succeeds, click Save.
DataHub data source
For a DataHub data source, OceanBase Cloud provides both private network and public network connection methods.
Prerequisites
You have configured Alibaba Cloud to complete RAM access permission control. For detailed operations, see Add access control for an Alibaba Cloud DataHub instance in Add an Alibaba Cloud instance to the allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner > DataHub.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud. Region Select the region where the data source is located. Connection Type Select Private Network. Instance Type The default is Alibaba Cloud DataHub Instance. Access Point Select a target address access point from the drop-down list. You must first add the data source IP address displayed on the page to the allowlist of the cloud database security group to ensure connectivity. For details, see Add access control for an Alibaba Cloud DataHub instance in Add an Alibaba Cloud instance to the allowlist. Project Name The name of the DataHub instance. AccessKey The AccessKey ID you created in the cloud account management console, used for authentication. SecretKey The AccessKey Secret you created in the cloud account management console, used for authentication. Click Test Connection.
After the connection test succeeds, click Save.
Prerequisites
You have the permission to modify the Alibaba Cloud security group allowlist.
You have the permissions of an Organization Admin or Project Admin in the OceanBase Cloud console.
Procedure
Log in to the OceanBase Cloud console.
In the left-side navigation pane, click Data Services > Data Source.
On the Data Source page, click Create Data Source in the upper-right corner and select DataHub.
In the Create Data Source dialog box, configure the parameters.
ParameterDescriptionCloud Provider Currently supports Alibaba Cloud. Region Select the region where the data source is located. Connection Type Select Public IP. Instance Type The default value is Alibaba Cloud DataHub Instance. Access Point Information about the DataHub instance. You must first add the displayed data source IP address to the allowlist of the cloud database security group to ensure connectivity. For details, see Add access control for Alibaba Cloud DataHub instances in Add an Alibaba Cloud instance to the allowlist. Project Name The name of the DataHub instance. AccessKey The AccessKey ID you created in the cloud account management console, used for authentication. SecretKey The AccessKey Secret you created in the cloud account management console, used for authentication. Click Test Connection.
After the connection test succeeds, click Save.