| Parameter | Default value | Description | Applicable version |
|---|---|---|---|
| limitator.platform.threads.number | The default value is subject to resource configurations for full verification. | The number of data source read threads to be verified. The number of read threads at the source and that at the destination are subject to the limitator.platform.threads.number and limitator.source.max.thread.size parameters. The calculation logic is as follows:
limitator.platform.threads.number is 10, each of the source and destination has five read threads. If the value of limitator.platform.threads.number is 14, each of the source and destination has six read threads. |
All versions |
| limitator.platform.split.threads.number | 16 | The number of splitting threads to be verified. | All versions |
| limitator.select.batch.max | 600 | The maximum number of records of each split part. In the case of table splitting based on the primary key or unique key, the value is the accurate number of records processed in each split part.
NoteWe recommend that you do not modify this parameter unless a splitting performance bottleneck occurs. |
All versions |
| limitator.reviewer.rounds.max | 20 | The number of reverification rounds.
NoteIf you want to quickly obtain data inconsistencies or in a confirmed data inconsistency scenario, you can set the value of this parameter to |
All versions |
| limitator.reviewer.review.batch.max | 100 | The number of inconsistent unique keys to be verified by each reverification task. | All versions |
| limitator.review.query.batch.limit | 100 | The number of unique keys queried at the source/destination at a time in reverification scenarios. This parameter is used in combination with limitator.reviewer.review.batch.max. For example, if limitator.reviewer.review.batch.max is set to 100 and limitator.review.query.batch.limit is set to 50, one reverification task needs to reverify 100 unique keys in total and can query 50 unique keys at the source/destination each time. Therefore, the reverification task will access the database twice. |
Versions later than oboms-verifier-2.0.0-xxx |
| filter.verify.rectify.type | No | Indicates whether to correct inconsistent data. Valid values:
Notice
|
All versions |
| filter.verify.inmod.tables | N/A | Specifies to verify tables by using the inmode mechanism. OMS Community Edition supports general verification and inmode verification. The two verification modes differ in the method used by the destination to read data. In inmode verification, the destination does not read data based on the split range. Instead, the destination calculates primary key values based on the data read by the source from a split part, and then reads data based on the primary key values.
NoticeThe inmode verification is inapplicable if the destination has data that does exist at the source, and will downgrade the verification performance.
|
All versions |
| limitator.table.diff.max | 10000 | The maximum number of data inconsistencies allowed for each table. If the number of data inconsistencies in a table exceeds this value, Full-Verification marks the table as an abnormal one and will not verify the remaining data.
NoticeWe recommend that you do not set this parameter to a value greater than 10 million. |
All versions |
| limitator.ready.verify.record.queue.size | 64 | The size of data to be verified. | Versions later than oboms-verifier-2.0.0-xxx |
| limitator.ready.rectify.record.queue.size | 64 | The size of data to be corrected. | Versions later than oboms-verifier-2.0.0-xxx |
| limitator.sink.slice.queue.size | 64 | The size of the splitting queue at the destination. | Versions later than oboms-verifier-2.0.0-xxx |
| task.coordinatorSection.reviewTaskQueueSize | 64 | The size of the reverification task queue. | Versions later than oboms-verifier-2.0.0-xxx |
| limitator.verify.thread.size | 8 | The number of verification threads. | Versions later than oboms-verifier-2.0.0-xxx |
| limitator.review.thread.size | 16 | The number of reverification threads. | Versions later than oboms-verifier-2.0.0-xxx |
| limitator.rectify.thread.size | 32 | The number of correction threads. | Versions later than oboms-verifier-2.0.0-xxx |
| limitator.slice.split.batch.size | N/A | The number of unique keys concatenated in a single IN query at the destination. | Versions later than oboms-verifier-1.0.23-20230904200300 |
| task.sourceMasterSection.matchAllColumn | true | Specifies whether to perform verification only if all fields of source tables are mapped to those of destination tables. Valid values: true and false.
|
OMS Community Edition V4.2.4 and later |
| task.sourceMasterSection.excludeColumn | N/A | The fields of the source tables that are not to be verified. Note that you cannot exclude fields in primary keys or unique keys. Otherwise, errors will occur during the verification. You can use a regular expression to specify fields to be excluded in the format of {"regular expression":"c1,c2,.."}. The table name in the regular expression must be in the format of schema.tablename. |
OMS Community Edition V4.2.4 and later |
The applicable versions in the preceding table are versions of Full-Verification. You can perform the following steps to query the current Full-Verification version of OMS Community Edition:
Log on to the server where OMS Community Edition is deployed.
Run the following command to enter the Docker container:
docker exec -it ${CONTAINER_NAME} bashNotice
CONTAINER_NAMEspecifies the name of the container.Run the following command to query the version of Full-Verification:
rpm -qa | grep "verifier"
