Read and synchronize data in OceanBase Database by using SeaTunnel

This section describes how to synchronize data by using JDBC OceanBase Source Connector and JDBC OceanBase Sink Connector for SeaTunnel. JDBC OceanBase Source Connector supports full read and write on data from a single table of OceanBase Database. For more information, see JDBC OceanBase Source Connector. JDBC OceanBase Sink Connector supports full read and write on data from multiple tables of OceanBase Database. For more information, see JDBC OceanBase Sink Connector.

Procedure

Follow the steps below to synchronize data between MySQL tenants of OceanBase Database:

1. Create a SeaTunnel user.

    CREATE USER 'Username'@'%' IDENTIFIED BY 'Password';
    GRANT SELECT, INSERT, UPDATE, DELETE ON *.* TO 'Username';
   

2. Configure the config/plugin_config file.

3. Download the OceanBase Connector/J driver to the lib directory. For more information, see OceanBase Client.

4. Configure SeaTunnel.

   Modify the configuration file config/ob_to_ob as follows:

   env {
   parallelism = 1
   job.mode = "BATCH"
   }
   
   source {
   # This is a example source plugin **only for test and demonstrate the feature source plugin**
   Jdbc {
       driver = com.oceanbase.jdbc.Driver
       url = "jdbc:oceanbase://e2e_oceanbase_mysql:2881/seatunnel?useUnicode=true&characterEncoding=UTF-8&rewriteBatchedStatements=true&serverTimezone=UTC"
       user = "Username"
       password = "Password"
       query = "SELECT c_bit_1, c_bit_8 FROM source"
       compatible_mode = "mysql"
   }
   
   # If you would like to get more information about how to configure seatunnel and see full list of source plugins,
   # please go to https://seatunnel.apache.org/docs/connector-v2/source/FakeSource
   }
   
   sink {
   Jdbc {
       driver = com.oceanbase.jdbc.Driver
       url = "jdbc:oceanbase://e2e_oceanbase_mysql:2881/seatunnel?useUnicode=true&characterEncoding=UTF-8&rewriteBatchedStatements=true&serverTimezone=UTC"
       user = "Username"
       password = "Password"
       query = "insert into sink(c_bit_1, c_bit_8) values (?, ?);"
       compatible_mode = "mysql"
   }
   # If you would like to get more information about how to configure seatunnel and see full list of sink plugins,
   # please go to https://seatunnel.apache.org/docs/connector-v2/sink
   } 
   

5. Start SeaTunnel.

   Run the following command to start SeaTunnel:

   ./bin/seatunnel.sh --config ./config/ob_to_ob -e local