| checkpoint |
JsonNode |
Yes |
None |
The checkpoint. Format:
{ "ClientId": { "databaseName": "", "tableName": "", "value": { "col1": "val", "col2": "val" }, "syncedCount": the synchronized count.}, ... } |
| clients |
JsonNode |
Yes |
None |
The clients, in the format of a JSON list. |
| database_connection_timeout_sec |
Integer |
No |
120 |
The connection timeout period for each JDBC client in the database. |
| database_max_connection |
Integer |
No |
32 |
The maximum number of connections allowed for each JDBC client in the database. |
| database_time_zone |
String |
No |
+08:00 |
The time zone set in connections. |
| database_type |
String |
Yes |
None |
The type of the database. |
| dataflow_fetch_size |
Integer |
No |
1000 |
The size of data pulled at a time, which may increase based on the number of source databases. |
| dataflow_init_table_thread_num |
Integer |
No |
8 |
The number of worker thread pools for initializing tables. The values of the core and max parameters are the same. |
| dataflow_pull_worker_num |
Integer |
No |
32 |
The number of worker thread pools for pulling data. The values of the core and max parameters are the same. |
| dataflow_retry_time |
Integer |
No |
3 |
The number of retries for requesting a database operation. The default value is 3. |
| dataflow_retry_interval_sec |
Integer |
No |
3 |
The retry interval. The default value is 3, indicating 3 seconds. |
| dataflow_slice_queue_size |
Integer |
No |
128 |
The size of the dataflow slice queue, which increases based on the number of sources. The value of this parameter must be greater than 0. |
| dataflow_slice_worker_num |
Integer |
No |
16 |
The number of worker thread pools for sharding tables. The values of the core and max parameters are the same. |
| source_queue_size |
Integer |
No |
16384 |
The maximum number of messages in a queue on the source database side. |
