1
0
mirror of https://github.com/google/nomulus synced 2026-01-07 05:56:49 +00:00

Compare migration data with SQL as primary DB (#1497)

* Compare migration data with SQL as primary DB

Add a BEAM pipeline that compares the secondary Datastore against SQL.
This is a dumb pipeline to be launched by a driver (in a followup PR).
Manually tested pipeline in sandbox.

Also updated the ValidateSqlPipeline and the snapshot finder class so
that an appropriate Datastore export is found (one that ends before the
replay checkpoint value).
This commit is contained in:
Weimin Yu
2022-01-24 11:20:48 -05:00
committed by GitHub
parent b3a0eb6bd8
commit 207c7e7ca8
5 changed files with 180 additions and 28 deletions

View File

@@ -708,6 +708,9 @@ createToolTask(
createToolTask(
'validateSqlPipeline', 'google.registry.beam.comparedb.ValidateSqlPipeline')
createToolTask(
'validateDatastorePipeline', 'google.registry.beam.comparedb.ValidateDatastorePipeline')
createToolTask(
'jpaDemoPipeline', 'google.registry.beam.common.JpaDemoPipeline')