Replay Cloud SQL transactions against datastore (#738 )

* Replay Cloud SQL transactions against datastore Implement the ReplicateToDatastore cron job that will apply all Cloud SQL transactions to the datastore. The last transaction id is stored in a LastSqlTransaction entity in datastore. Note that this will not be activated in production until a) the cron configuration is updated and b) the cloudSql.replicateTransactions flag is set to true in the nomulus config file. * Post-review changes Fixed immutability issues with LastSqlTransaction, write a single transaction at a time to datastore. * Changes requested in review * Get a batch of SQL transactions Read a batch of SQL transactions at a time and then process them transactionally against datastore. * Bring this up-to-date with the codebase * Changes requested in review * Fixed date in copyright
Clean up Gradle Flyway tasks in :db (#990 )
2026-05-18 22:01:47 +00:00 · 2021-03-05 10:35:30 -05:00 · 2021-03-04 19:58:09 -05:00 · 2021-03-04 08:25:47 -05:00 · 2021-03-03 21:02:06 -05:00 · 2021-03-03 19:31:08 -05:00
366 changed files with 17306 additions and 13077 deletions
--- a/.gitignore
+++ b/.gitignore
@@ -75,7 +75,7 @@ local.properties
 autogenerated/

 # IDEA
-nomulus.iml
+**/*.iml
 nomulus.ipr
 nomulus.iws

--- a/build.gradle
+++ b/build.gradle
@@ -40,7 +40,7 @@ plugins {
  id 'com.github.johnrengelman.shadow' version '5.1.0'

  // NodeJs plugin
-  id "com.moowork.node" version "1.2.0"
+  id "com.github.node-gradle.node" version "3.0.1"

  id 'idea'
  id 'com.diffplug.gradle.spotless' version '3.25.0'
@@ -49,6 +49,12 @@ plugins {
  id 'com.dorongold.task-tree' version '1.5'
 }

+node {
+  download = true
+  version = "14.15.5"
+  npmVersion = "6.14.11"
+}
+
 wrapper {
  distributionType = Wrapper.DistributionType.ALL
 }
@@ -115,7 +121,7 @@ task stage {
 // App-engine environment configuration.  We set up all of the variables in
 // the root project.

-def environments = ['production', 'sandbox', 'alpha', 'crash']
+def environments = ['production', 'sandbox', 'alpha', 'crash', 'qa']

 def gcpProject = null

@@ -149,7 +155,7 @@ def verifyDeploymentParams() {
        System.err.println('-----------------------------------------------------------------')
        throw new GradleException('Aborting. See prominent error above.')
    } else if (gcpProject == null) {
-        def error = 'You must specify -P environment={alpha,crash}'
+        def error = 'You must specify -P environment={alpha,crash,qa}'
        System.err.println("\033[33;1m${error}\033[0m")
        throw GradleException("Aborting:  ${error}")
    }
--- a/buildSrc/build.gradle
+++ b/buildSrc/build.gradle
@@ -71,12 +71,13 @@ dependencies {
  def deps = dependencyMap
  compile deps['com.google.auth:google-auth-library-credentials']
  compile deps['com.google.auth:google-auth-library-oauth2-http']
-  compile deps['com.google.cloud:google-cloud-core']
-  compile deps['com.google.guava:guava']
  compile deps['com.google.auto.value:auto-value-annotations']
+  compile deps['com.google.cloud:google-cloud-core']
  compile deps['com.google.cloud:google-cloud-storage']
-  compile deps['org.apache.commons:commons-text']
+  compile deps['com.google.guava:guava']
+  compile deps['com.google.protobuf:protobuf-java']
  compile deps['com.google.template:soy']
+  compile deps['org.apache.commons:commons-text']
  annotationProcessor deps['com.google.auto.value:auto-value']
  testCompile deps['com.google.truth:truth']
  testCompile deps['com.google.truth.extensions:truth-java8-extension']
--- a/buildSrc/gradle/dependency-locks/annotationProcessor.lockfile
+++ b/buildSrc/gradle/dependency-locks/annotationProcessor.lockfile
@@ -3,7 +3,7 @@
 # This file is expected to be part of source control.
 com.github.ben-manes.caffeine:caffeine:2.7.0
 com.github.kevinstern:software-and-algorithms:1.0
-com.google.auto.value:auto-value:1.6.3
+com.google.auto.value:auto-value:1.7.4
 com.google.auto:auto-common:0.10
 com.google.code.findbugs:jFormatString:3.0.0
 com.google.code.findbugs:jsr305:3.0.2
--- a/buildSrc/gradle/dependency-locks/checkstyle.lockfile
+++ b/buildSrc/gradle/dependency-locks/checkstyle.lockfile
@@ -3,16 +3,17 @@
 # This file is expected to be part of source control.
 antlr:antlr:2.7.7
 com.google.code.findbugs:jsr305:3.0.2
-com.google.errorprone:error_prone_annotations:2.3.2
+com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:28.1-jre
+com.google.guava:guava:29.0-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
-com.puppycrawl.tools:checkstyle:8.27
+com.puppycrawl.tools:checkstyle:8.37
 commons-beanutils:commons-beanutils:1.9.4
 commons-collections:commons-collections:3.2.2
-info.picocli:picocli:4.1.1
-net.sf.saxon:Saxon-HE:9.9.1-5
-org.antlr:antlr4-runtime:4.7.2
-org.checkerframework:checker-qual:2.8.1
-org.codehaus.mojo:animal-sniffer-annotations:1.18
+info.picocli:picocli:4.5.2
+net.sf.saxon:Saxon-HE:10.3
+org.antlr:antlr4-runtime:4.8-1
+org.checkerframework:checker-qual:2.11.1
+org.javassist:javassist:3.26.0-GA
+org.reflections:reflections:0.9.12
--- a/buildSrc/gradle/dependency-locks/compile.lockfile
+++ b/buildSrc/gradle/dependency-locks/compile.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.ibm.icu:icu4j:57.1
 commons-codec:commons-codec:1.11
--- a/buildSrc/gradle/dependency-locks/compileClasspath.lockfile
+++ b/buildSrc/gradle/dependency-locks/compileClasspath.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.ibm.icu:icu4j:57.1
 commons-codec:commons-codec:1.11
--- a/buildSrc/gradle/dependency-locks/deploy_jar.lockfile
+++ b/buildSrc/gradle/dependency-locks/deploy_jar.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.ibm.icu:icu4j:57.1
 commons-codec:commons-codec:1.11
--- a/buildSrc/gradle/dependency-locks/jacocoAgent.lockfile
+++ b/buildSrc/gradle/dependency-locks/jacocoAgent.lockfile
@@ -1,4 +1,4 @@
 # This is a Gradle generated file for dependency locking.
 # Manual edits can break the build and are not advised.
 # This file is expected to be part of source control.
-org.jacoco:org.jacoco.agent:0.8.5
+org.jacoco:org.jacoco.agent:0.8.6
--- a/buildSrc/gradle/dependency-locks/jacocoAnt.lockfile
+++ b/buildSrc/gradle/dependency-locks/jacocoAnt.lockfile
@@ -1,11 +1,11 @@
 # This is a Gradle generated file for dependency locking.
 # Manual edits can break the build and are not advised.
 # This file is expected to be part of source control.
-org.jacoco:org.jacoco.agent:0.8.5
-org.jacoco:org.jacoco.ant:0.8.5
-org.jacoco:org.jacoco.core:0.8.5
-org.jacoco:org.jacoco.report:0.8.5
-org.ow2.asm:asm-analysis:7.2
-org.ow2.asm:asm-commons:7.2
-org.ow2.asm:asm-tree:7.2
-org.ow2.asm:asm:7.2
+org.jacoco:org.jacoco.agent:0.8.6
+org.jacoco:org.jacoco.ant:0.8.6
+org.jacoco:org.jacoco.core:0.8.6
+org.jacoco:org.jacoco.report:0.8.6
+org.ow2.asm:asm-analysis:8.0.1
+org.ow2.asm:asm-commons:8.0.1
+org.ow2.asm:asm-tree:8.0.1
+org.ow2.asm:asm:8.0.1
--- a/buildSrc/gradle/dependency-locks/runtime.lockfile
+++ b/buildSrc/gradle/dependency-locks/runtime.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.ibm.icu:icu4j:57.1
 commons-codec:commons-codec:1.11
--- a/buildSrc/gradle/dependency-locks/runtimeClasspath.lockfile
+++ b/buildSrc/gradle/dependency-locks/runtimeClasspath.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.ibm.icu:icu4j:57.1
 commons-codec:commons-codec:1.11
--- a/buildSrc/gradle/dependency-locks/testCompile.lockfile
+++ b/buildSrc/gradle/dependency-locks/testCompile.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
 com.google.truth:truth:1.0
@@ -50,8 +50,8 @@ javax.inject:javax.inject:1
 javax.validation:validation-api:1.0.0.GA
 joda-time:joda-time:2.9.2
 junit:junit:4.12
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.5
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 org.apache.commons:commons-lang3:3.8.1
 org.apache.commons:commons-text:1.6
 org.apache.httpcomponents:httpclient:4.5.8
@@ -66,8 +66,8 @@ org.junit.jupiter:junit-jupiter-engine:5.6.2
 org.junit.platform:junit-platform-commons:1.6.2
 org.junit.platform:junit-platform-engine:1.6.2
 org.junit:junit-bom:5.6.2
-org.mockito:mockito-core:3.3.3
-org.objenesis:objenesis:2.6
+org.mockito:mockito-core:3.7.7
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:6.0
 org.ow2.asm:asm-commons:6.0
--- a/buildSrc/gradle/dependency-locks/testCompileClasspath.lockfile
+++ b/buildSrc/gradle/dependency-locks/testCompileClasspath.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
 com.google.truth:truth:1.0
@@ -50,8 +50,8 @@ javax.inject:javax.inject:1
 javax.validation:validation-api:1.0.0.GA
 joda-time:joda-time:2.9.2
 junit:junit:4.12
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.5
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 org.apache.commons:commons-lang3:3.8.1
 org.apache.commons:commons-text:1.6
 org.apache.httpcomponents:httpclient:4.5.8
@@ -66,8 +66,8 @@ org.junit.jupiter:junit-jupiter-engine:5.6.2
 org.junit.platform:junit-platform-commons:1.6.2
 org.junit.platform:junit-platform-engine:1.6.2
 org.junit:junit-bom:5.6.2
-org.mockito:mockito-core:3.3.3
-org.objenesis:objenesis:2.6
+org.mockito:mockito-core:3.7.7
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:6.0
 org.ow2.asm:asm-commons:6.0
--- a/buildSrc/gradle/dependency-locks/testRuntime.lockfile
+++ b/buildSrc/gradle/dependency-locks/testRuntime.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
 com.google.truth:truth:1.0
@@ -50,8 +50,8 @@ javax.inject:javax.inject:1
 javax.validation:validation-api:1.0.0.GA
 joda-time:joda-time:2.9.2
 junit:junit:4.12
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.5
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 org.apache.commons:commons-lang3:3.8.1
 org.apache.commons:commons-text:1.6
 org.apache.httpcomponents:httpclient:4.5.8
@@ -66,8 +66,8 @@ org.junit.jupiter:junit-jupiter-engine:5.6.2
 org.junit.platform:junit-platform-commons:1.6.2
 org.junit.platform:junit-platform-engine:1.6.2
 org.junit:junit-bom:5.6.2
-org.mockito:mockito-core:3.3.3
-org.objenesis:objenesis:2.6
+org.mockito:mockito-core:3.7.7
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:6.0
 org.ow2.asm:asm-commons:6.0
--- a/buildSrc/gradle/dependency-locks/testRuntimeClasspath.lockfile
+++ b/buildSrc/gradle/dependency-locks/testRuntimeClasspath.lockfile
@@ -13,7 +13,7 @@ com.google.api:gax:1.35.1
 com.google.apis:google-api-services-storage:v1-rev20181013-1.27.0
 com.google.auth:google-auth-library-credentials:0.16.1
 com.google.auth:google-auth-library-oauth2-http:0.16.1
-com.google.auto.value:auto-value-annotations:1.6.3
+com.google.auto.value:auto-value-annotations:1.7.4
 com.google.cloud:google-cloud-core-http:1.59.0
 com.google.cloud:google-cloud-core:1.59.0
 com.google.cloud:google-cloud-storage:1.59.0
@@ -22,7 +22,7 @@ com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.http-client:google-http-client-appengine:1.27.0
@@ -33,7 +33,7 @@ com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
 com.google.oauth-client:google-oauth-client:1.27.0
 com.google.protobuf:protobuf-java-util:3.6.1
-com.google.protobuf:protobuf-java:3.6.1
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
 com.google.truth:truth:1.0
@@ -50,8 +50,8 @@ javax.inject:javax.inject:1
 javax.validation:validation-api:1.0.0.GA
 joda-time:joda-time:2.9.2
 junit:junit:4.12
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.5
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 org.apache.commons:commons-lang3:3.8.1
 org.apache.commons:commons-text:1.6
 org.apache.httpcomponents:httpclient:4.5.8
@@ -66,8 +66,8 @@ org.junit.jupiter:junit-jupiter-engine:5.6.2
 org.junit.platform:junit-platform-commons:1.6.2
 org.junit.platform:junit-platform-engine:1.6.2
 org.junit:junit-bom:5.6.2
-org.mockito:mockito-core:3.3.3
-org.objenesis:objenesis:2.6
+org.mockito:mockito-core:3.7.7
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:6.0
 org.ow2.asm:asm-commons:6.0
--- a/buildSrc/src/test/resources/mockito-extensions/org.mockito.plugins.MockMaker
+++ b/buildSrc/src/test/resources/mockito-extensions/org.mockito.plugins.MockMaker
@@ -0,0 +1 @@
+mock-maker-inline
--- a/common/gradle/dependency-locks/checkstyle.lockfile
+++ b/common/gradle/dependency-locks/checkstyle.lockfile
@@ -3,16 +3,17 @@
 # This file is expected to be part of source control.
 antlr:antlr:2.7.7
 com.google.code.findbugs:jsr305:3.0.2
-com.google.errorprone:error_prone_annotations:2.3.2
+com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:28.1-jre
+com.google.guava:guava:29.0-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
-com.puppycrawl.tools:checkstyle:8.27
+com.puppycrawl.tools:checkstyle:8.37
 commons-beanutils:commons-beanutils:1.9.4
 commons-collections:commons-collections:3.2.2
-info.picocli:picocli:4.1.1
-net.sf.saxon:Saxon-HE:9.9.1-5
-org.antlr:antlr4-runtime:4.7.2
-org.checkerframework:checker-qual:2.8.1
-org.codehaus.mojo:animal-sniffer-annotations:1.18
+info.picocli:picocli:4.5.2
+net.sf.saxon:Saxon-HE:10.3
+org.antlr:antlr4-runtime:4.8-1
+org.checkerframework:checker-qual:2.11.1
+org.javassist:javassist:3.26.0-GA
+org.reflections:reflections:0.9.12
--- a/common/gradle/dependency-locks/compile.lockfile
+++ b/common/gradle/dependency-locks/compile.lockfile
@@ -4,7 +4,7 @@
 com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 javax.inject:javax.inject:1
--- a/common/gradle/dependency-locks/compileClasspath.lockfile
+++ b/common/gradle/dependency-locks/compileClasspath.lockfile
@@ -4,7 +4,7 @@
 com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 javax.inject:javax.inject:1
--- a/common/gradle/dependency-locks/default.lockfile
+++ b/common/gradle/dependency-locks/default.lockfile
@@ -4,7 +4,7 @@
 com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 javax.inject:javax.inject:1
--- a/common/gradle/dependency-locks/deploy_jar.lockfile
+++ b/common/gradle/dependency-locks/deploy_jar.lockfile
@@ -4,7 +4,7 @@
 com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 javax.inject:javax.inject:1
--- a/common/gradle/dependency-locks/jacocoAgent.lockfile
+++ b/common/gradle/dependency-locks/jacocoAgent.lockfile
@@ -1,4 +1,4 @@
 # This is a Gradle generated file for dependency locking.
 # Manual edits can break the build and are not advised.
 # This file is expected to be part of source control.
-org.jacoco:org.jacoco.agent:0.8.5
+org.jacoco:org.jacoco.agent:0.8.6
--- a/common/gradle/dependency-locks/jacocoAnt.lockfile
+++ b/common/gradle/dependency-locks/jacocoAnt.lockfile
@@ -1,11 +1,11 @@
 # This is a Gradle generated file for dependency locking.
 # Manual edits can break the build and are not advised.
 # This file is expected to be part of source control.
-org.jacoco:org.jacoco.agent:0.8.5
-org.jacoco:org.jacoco.ant:0.8.5
-org.jacoco:org.jacoco.core:0.8.5
-org.jacoco:org.jacoco.report:0.8.5
-org.ow2.asm:asm-analysis:7.2
-org.ow2.asm:asm-commons:7.2
-org.ow2.asm:asm-tree:7.2
-org.ow2.asm:asm:7.2
+org.jacoco:org.jacoco.agent:0.8.6
+org.jacoco:org.jacoco.ant:0.8.6
+org.jacoco:org.jacoco.core:0.8.6
+org.jacoco:org.jacoco.report:0.8.6
+org.ow2.asm:asm-analysis:8.0.1
+org.ow2.asm:asm-commons:8.0.1
+org.ow2.asm:asm-tree:8.0.1
+org.ow2.asm:asm:8.0.1
--- a/common/gradle/dependency-locks/runtime.lockfile
+++ b/common/gradle/dependency-locks/runtime.lockfile
@@ -4,7 +4,7 @@
 com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 javax.inject:javax.inject:1
--- a/common/gradle/dependency-locks/runtimeClasspath.lockfile
+++ b/common/gradle/dependency-locks/runtimeClasspath.lockfile
@@ -4,7 +4,7 @@
 com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 javax.inject:javax.inject:1
--- a/common/gradle/dependency-locks/testCompile.lockfile
+++ b/common/gradle/dependency-locks/testCompile.lockfile
@@ -6,7 +6,7 @@ com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testCompileClasspath.lockfile
+++ b/common/gradle/dependency-locks/testCompileClasspath.lockfile
@@ -6,7 +6,7 @@ com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testRuntime.lockfile
+++ b/common/gradle/dependency-locks/testRuntime.lockfile
@@ -7,7 +7,7 @@ com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger-system-backend:0.1
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testRuntimeClasspath.lockfile
+++ b/common/gradle/dependency-locks/testRuntimeClasspath.lockfile
@@ -7,7 +7,7 @@ com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger-system-backend:0.1
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testingCompile.lockfile
+++ b/common/gradle/dependency-locks/testingCompile.lockfile
@@ -6,7 +6,7 @@ com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testingCompileClasspath.lockfile
+++ b/common/gradle/dependency-locks/testingCompileClasspath.lockfile
@@ -6,7 +6,7 @@ com.google.code.findbugs:jsr305:3.0.2
 com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testingRuntime.lockfile
+++ b/common/gradle/dependency-locks/testingRuntime.lockfile
@@ -7,7 +7,7 @@ com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger-system-backend:0.1
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/common/gradle/dependency-locks/testingRuntimeClasspath.lockfile
+++ b/common/gradle/dependency-locks/testingRuntimeClasspath.lockfile
@@ -7,7 +7,7 @@ com.google.errorprone:error_prone_annotations:2.3.4
 com.google.flogger:flogger-system-backend:0.1
 com.google.flogger:flogger:0.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.truth:truth:1.0
--- a/config/dependency-license/allowed_licenses.json
+++ b/config/dependency-license/allowed_licenses.json
@@ -72,9 +72,15 @@
    {
      "moduleLicense": "The 3-Clause BSD License"
    },
+    {
+      "moduleLicense": "BSD Licence 3"
+    },
    {
      "moduleLicense": "BSD License"
    },
+    {
+      "moduleLicense": "BSD License 3"
+    },
    {
      "moduleLicense": "BSD New License"
    },
@@ -230,6 +236,13 @@
      "moduleLicense": "Public Domain",
      "moduleName": "org.tukaani:xz"
    },
+    {
+      // "Apache License, Version 2.0". The plugin is able to parse
+      // 2.11.3 correctly but not this version.
+      "moduleLicense": null,
+      "moduleVersion": "2.12.1",
+      "moduleName": "com.fasterxml.jackson:jackson-bom"
+    },
    {
      // Actually Eclipse Public License v2.0
      "moduleLicense": null,
--- a/config/nom_build.py
+++ b/config/nom_build.py
@@ -111,8 +111,8 @@ PROPERTIES = [

    # Cloud SQL properties
    Property('dbServer',
-             'A registry environment name (e.g., "alpha") or a host[:port] '
-             'string'),
+             'The host[:port] of a database that accepts direct IP access. '
+             'This is typically used with a testing database.'),
    Property('dbName',
             'Database name to use in connection.',
             'postgres'),
--- a/config/presubmits.py
+++ b/config/presubmits.py
@@ -23,7 +23,7 @@ import sys
 import re

 # We should never analyze any generated files
-UNIVERSALLY_SKIPPED_PATTERNS = {"/build/", "cloudbuild-caches", "/out/", ".git/"}
+UNIVERSALLY_SKIPPED_PATTERNS = {"/build/", "cloudbuild-caches", "/out/", ".git/", ".gradle/"}
 # We can't rely on CI to have the Enum package installed so we do this instead.
 FORBIDDEN = 1
 REQUIRED = 2
@@ -176,7 +176,47 @@ PRESUBMITS = {
        "js",
        {"/node_modules/", "google/registry/ui/js/util.js", "registrar_bin."},
    ):
-        "JavaScript files should not include console logging."
+        "JavaScript files should not include console logging.",
+    # SQL injection protection rule for java source file:
+    # The sql template passed to createQuery/createNativeQuery methods must be
+    # a variable name in UPPER_CASE_UNDERSCORE format, i.e., a static final
+    # String variable. This forces the use of parameter-binding on all queries
+    # that take parameters.
+    # The rule would forbid invocation of createQuery(Criteria). However, this
+    # can be handled by adding a helper method in an exempted class to make
+    # the calls.
+    # TODO(b/179158393): enable the 'ConstantName' Java style check to ensure
+    # that non-final variables do not use the UPPER_CASE_UNDERSCORE format.
+    PresubmitCheck(
+        # Line 1: the method names we check and the opening parenthesis, which
+        #    marks the beginning of the first parameter
+        # Line 2: The first parameter is a match if is NOT any of the following:
+        #    - final variable name: \s*([A-Z_]+
+        #    - string literal: "([^"]|\\")*"
+        #    - concatenation of literals: (\s*\+\s*"([^"]|\\")*")*
+        # Line 3: , or the closing parenthesis, marking the end of the first
+        #    parameter
+        r'.*\.create(Native)?Query\('
+        r'(?!(\s*([A-Z_]+|"([^"]|\\")*"(\s*\+\s*"([^"]|\\")*")*)'
+        r'(,|\s*\))))',
+        "java",
+        # ActivityReportingQueryBuilder deals with Dremel queries
+        {"src/test", "ActivityReportingQueryBuilder.java",
+         # TODO(b/179158393): Remove everything below, which should be done
+         # using Criteria
+         "ForeignKeyIndex.java",
+         "HistoryEntryDao.java",
+         "JpaTransactionManagerImpl.java",
+         # CriteriaQueryBuilder is a false positive
+         "CriteriaQueryBuilder.java",
+         "RdapSearchActionBase.java",
+         },
+    ):
+        "The first String parameter to EntityManager.create(Native)Query "
+        "methods must be one of the following:\n"
+        "  - A String literal\n"
+        "  - Concatenation of String literals only\n"
+        "  - The name of a static final String variable"
 }

 # Note that this regex only works for one kind of Flyway file.  If we want to
--- a/core/build.gradle
+++ b/core/build.gradle
@@ -204,6 +204,7 @@ dependencies {
  runtimeOnly deps['com.google.cloud.sql:postgres-socket-factory']
  compile deps['com.google.cloud:google-cloud-secretmanager']
  compile deps['com.google.code.gson:gson']
+  compile deps['com.google.auto.service:auto-service-annotations']
  compile deps['com.google.auto.value:auto-value-annotations']
  compile deps['com.google.code.findbugs:jsr305']
  compile deps['com.google.dagger:dagger']
@@ -300,11 +301,7 @@ dependencies {
  compile project(path: ':db', configuration: 'compileApi')
  testRuntime project(':db')

-  // Include auto-value in compile until nebula-lint understands
-  // annotationProcessor
-  gradleLint.ignore('unused-dependency') {
-    compile deps['com.google.auto.value:auto-value']
-  }
+  annotationProcessor deps['com.google.auto.service:auto-service']
  annotationProcessor deps['com.google.auto.value:auto-value']
  testAnnotationProcessor deps['com.google.auto.value:auto-value']
  annotationProcessor deps['com.google.dagger:dagger-compiler']
@@ -317,7 +314,7 @@ dependencies {
  testCompile deps['com.google.monitoring-client:contrib']
  testCompile deps['com.google.truth:truth']
  testCompile deps['com.google.truth.extensions:truth-java8-extension']
-  testCompile deps['org.hamcrest:hamcrest-all']
+  testCompile deps['org.hamcrest:hamcrest']
  testCompile deps['org.hamcrest:hamcrest-core']
  testCompile deps['org.hamcrest:hamcrest-library']
  testCompile deps['junit:junit']
@@ -347,6 +344,8 @@ dependencies {
  jaxb deps['com.sun.xml.bind:jaxb-osgi']

  // Dependency needed for soy to java compilation.
+  soy deps['com.google.inject:guice']
+  soy deps['com.google.protobuf:protobuf-java']
  soy deps['com.google.template:soy']

  // Dependencies needed for compiling stylesheets to javascript
@@ -716,6 +715,10 @@ createToolTask(
    'google.registry.tools.DevTool',
    sourceSets.nonprod)

+
+createToolTask(
+        'jpaDemoPipeline', 'google.registry.beam.common.JpaDemoPipeline')
+
 project.tasks.create('initSqlPipeline', JavaExec) {
  main = 'google.registry.beam.initsql.InitSqlPipeline'

--- a/core/gradle/dependency-locks/annotationProcessor.lockfile
+++ b/core/gradle/dependency-locks/annotationProcessor.lockfile
@@ -3,7 +3,9 @@
 # This file is expected to be part of source control.
 com.github.ben-manes.caffeine:caffeine:2.7.0
 com.github.kevinstern:software-and-algorithms:1.0
-com.google.auto.value:auto-value:1.6.3
+com.google.auto.service:auto-service-annotations:1.0-rc7
+com.google.auto.service:auto-service:1.0-rc7
+com.google.auto.value:auto-value:1.7.4
 com.google.auto:auto-common:0.10
 com.google.code.findbugs:jFormatString:3.0.0
 com.google.code.findbugs:jsr305:3.0.2
@@ -19,7 +21,7 @@ com.google.errorprone:error_prone_type_annotations:2.3.4
 com.google.errorprone:javac-shaded:9-dev-r4023-3
 com.google.googlejavaformat:google-java-format:1.5
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.protobuf:protobuf-java:3.4.0
--- a/core/gradle/dependency-locks/checkstyle.lockfile
+++ b/core/gradle/dependency-locks/checkstyle.lockfile
@@ -3,16 +3,17 @@
 # This file is expected to be part of source control.
 antlr:antlr:2.7.7
 com.google.code.findbugs:jsr305:3.0.2
-com.google.errorprone:error_prone_annotations:2.3.2
+com.google.errorprone:error_prone_annotations:2.3.4
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:28.1-jre
+com.google.guava:guava:29.0-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
-com.puppycrawl.tools:checkstyle:8.27
+com.puppycrawl.tools:checkstyle:8.37
 commons-beanutils:commons-beanutils:1.9.4
 commons-collections:commons-collections:3.2.2
-info.picocli:picocli:4.1.1
-net.sf.saxon:Saxon-HE:9.9.1-5
-org.antlr:antlr4-runtime:4.7.2
-org.checkerframework:checker-qual:2.8.1
-org.codehaus.mojo:animal-sniffer-annotations:1.18
+info.picocli:picocli:4.5.2
+net.sf.saxon:Saxon-HE:10.3
+org.antlr:antlr4-runtime:4.8-1
+org.checkerframework:checker-qual:2.11.1
+org.javassist:javassist:3.26.0-GA
+org.reflections:reflections:0.9.12
--- a/core/gradle/dependency-locks/compile.lockfile
+++ b/core/gradle/dependency-locks/compile.lockfile
@@ -6,10 +6,14 @@ aopalliance:aopalliance:1.0
 args4j:args4j:2.33
 cglib:cglib-nodep:2.2
 com.beust:jcommander:1.60
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -18,90 +22,103 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -109,56 +126,49 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -178,27 +188,26 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-lang3:3.5
 org.apache.httpcomponents:httpclient:4.5.13
@@ -208,17 +217,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -226,9 +236,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -242,14 +251,12 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.xerial.snappy:snappy-java:1.1.4
--- a/core/gradle/dependency-locks/compileClasspath.lockfile
+++ b/core/gradle/dependency-locks/compileClasspath.lockfile
@@ -6,10 +6,14 @@ aopalliance:aopalliance:1.0
 args4j:args4j:2.33
 cglib:cglib-nodep:2.2
 com.beust:jcommander:1.60
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -18,88 +22,101 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -107,56 +124,47 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.11.4
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -176,25 +184,24 @@ javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-lang3:3.5
 org.apache.httpcomponents:httpclient:4.5.13
@@ -204,15 +211,17 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -220,9 +229,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -236,14 +244,12 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.xerial.snappy:snappy-java:1.1.4
--- a/core/gradle/dependency-locks/default.lockfile
+++ b/core/gradle/dependency-locks/default.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,91 +26,104 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
 com.google.cloud.sql:postgres-socket-factory:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -114,27 +131,23 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -142,31 +155,28 @@ guru.nidi:graphviz-java-all-j2v8:0.17.0
 guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -186,28 +196,27 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.arnx:nashorn-promise:0.1.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.5
@@ -219,17 +228,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -237,9 +247,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -253,17 +262,15 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
 org.slf4j:slf4j-jdk14:1.7.28
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/deploy_jar.lockfile
+++ b/core/gradle/dependency-locks/deploy_jar.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,91 +26,104 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
 com.google.cloud.sql:postgres-socket-factory:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -114,27 +131,23 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -142,31 +155,28 @@ guru.nidi:graphviz-java-all-j2v8:0.17.0
 guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -188,25 +198,24 @@ jline:jline:1.0
 joda-time:joda-time:2.10.5
 net.arnx:nashorn-promise:0.1.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.5
@@ -218,16 +227,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -235,9 +246,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -251,17 +261,15 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
 org.slf4j:slf4j-jdk14:1.7.28
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/jacocoAgent.lockfile
+++ b/core/gradle/dependency-locks/jacocoAgent.lockfile
@@ -1,4 +1,4 @@
 # This is a Gradle generated file for dependency locking.
 # Manual edits can break the build and are not advised.
 # This file is expected to be part of source control.
-org.jacoco:org.jacoco.agent:0.8.5
+org.jacoco:org.jacoco.agent:0.8.6
--- a/core/gradle/dependency-locks/jacocoAnt.lockfile
+++ b/core/gradle/dependency-locks/jacocoAnt.lockfile
@@ -1,11 +1,11 @@
 # This is a Gradle generated file for dependency locking.
 # Manual edits can break the build and are not advised.
 # This file is expected to be part of source control.
-org.jacoco:org.jacoco.agent:0.8.5
-org.jacoco:org.jacoco.ant:0.8.5
-org.jacoco:org.jacoco.core:0.8.5
-org.jacoco:org.jacoco.report:0.8.5
-org.ow2.asm:asm-analysis:7.2
-org.ow2.asm:asm-commons:7.2
-org.ow2.asm:asm-tree:7.2
-org.ow2.asm:asm:7.2
+org.jacoco:org.jacoco.agent:0.8.6
+org.jacoco:org.jacoco.ant:0.8.6
+org.jacoco:org.jacoco.core:0.8.6
+org.jacoco:org.jacoco.report:0.8.6
+org.ow2.asm:asm-analysis:8.0.1
+org.ow2.asm:asm-commons:8.0.1
+org.ow2.asm:asm-tree:8.0.1
+org.ow2.asm:asm:8.0.1
--- a/core/gradle/dependency-locks/nonprodCompile.lockfile
+++ b/core/gradle/dependency-locks/nonprodCompile.lockfile
@@ -6,10 +6,14 @@ aopalliance:aopalliance:1.0
 args4j:args4j:2.33
 cglib:cglib-nodep:2.2
 com.beust:jcommander:1.60
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -18,90 +22,103 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -109,56 +126,49 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -178,27 +188,26 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-lang3:3.5
 org.apache.httpcomponents:httpclient:4.5.13
@@ -208,17 +217,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -226,9 +236,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -242,14 +251,12 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.xerial.snappy:snappy-java:1.1.4
--- a/core/gradle/dependency-locks/nonprodCompileClasspath.lockfile
+++ b/core/gradle/dependency-locks/nonprodCompileClasspath.lockfile
@@ -6,10 +6,14 @@ aopalliance:aopalliance:1.0
 args4j:args4j:2.33
 cglib:cglib-nodep:2.2
 com.beust:jcommander:1.60
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -18,88 +22,101 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -107,56 +124,47 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.11.4
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -175,27 +183,26 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-lang3:3.5
 org.apache.httpcomponents:httpclient:4.5.13
@@ -205,16 +212,17 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -222,9 +230,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -238,14 +245,12 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.xerial.snappy:snappy-java:1.1.4
--- a/core/gradle/dependency-locks/nonprodRuntime.lockfile
+++ b/core/gradle/dependency-locks/nonprodRuntime.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,90 +26,103 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -113,27 +130,23 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -141,31 +154,28 @@ guru.nidi:graphviz-java-all-j2v8:0.17.0
 guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -185,28 +195,27 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.arnx:nashorn-promise:0.1.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.5
@@ -218,17 +227,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -236,9 +246,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -252,16 +261,14 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/nonprodRuntimeClasspath.lockfile
+++ b/core/gradle/dependency-locks/nonprodRuntimeClasspath.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,90 +26,103 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -113,27 +130,23 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -141,31 +154,28 @@ guru.nidi:graphviz-java-all-j2v8:0.17.0
 guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -185,28 +195,27 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.arnx:nashorn-promise:0.1.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.5
@@ -218,17 +227,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -236,9 +246,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -252,16 +261,14 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/runtime.lockfile
+++ b/core/gradle/dependency-locks/runtime.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,90 +26,103 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -113,27 +130,23 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -141,31 +154,28 @@ guru.nidi:graphviz-java-all-j2v8:0.17.0
 guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -185,28 +195,27 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.12
+junit:junit:4.13.1
 net.arnx:nashorn-promise:0.1.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.5
@@ -218,17 +227,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-core:1.3
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -236,9 +246,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -252,16 +261,14 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/runtimeClasspath.lockfile
+++ b/core/gradle/dependency-locks/runtimeClasspath.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.10.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.10.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,91 +26,104 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
 com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
 com.google.cloud.sql:postgres-socket-factory:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -114,27 +131,23 @@ com.google.jsinterop:jsinterop-annotations:1.0.2
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.googlecode.charts4j:charts4j:1.3
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
-com.squareup.okhttp:okhttp:2.5.0
-com.squareup.okio:okio:1.13.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -142,31 +155,28 @@ guru.nidi:graphviz-java-all-j2v8:0.17.0
 guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -188,25 +198,24 @@ jline:jline:1.0
 joda-time:joda-time:2.10.5
 net.arnx:nashorn-promise:0.1.1
 net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.5
@@ -218,16 +227,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
+org.hamcrest:hamcrest-core:2.1
+org.hamcrest:hamcrest:2.1
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -235,9 +246,8 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.jvnet.staxex:stax-ex:1.8
 org.mortbay.jetty:jetty-util:6.1.26
@@ -251,17 +261,15 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
 org.slf4j:slf4j-jdk14:1.7.28
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/soy.lockfile
+++ b/core/gradle/dependency-locks/soy.lockfile
@@ -3,19 +3,24 @@
 # This file is expected to be part of source control.
 aopalliance:aopalliance:1.0
 args4j:args4j:2.0.23
-com.google.code.findbugs:jsr305:2.0.3
+com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.7
 com.google.common.html.types:types:1.0.4
-com.google.guava:guava:21.0
+com.google.errorprone:error_prone_annotations:2.3.4
+com.google.guava:failureaccess:1.0.1
+com.google.guava:guava:30.1-jre
+com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.0-beta1
 com.google.inject.extensions:guice-multibindings:4.1.0
-com.google.inject:guice:4.1.0
-com.google.protobuf:protobuf-java:3.3.0
+com.google.inject:guice:5.0.1
+com.google.j2objc:j2objc-annotations:1.3
+com.google.protobuf:protobuf-java:3.13.0
 com.google.template:soy:2018-03-14
 com.ibm.icu:icu4j:57.1
 javax.annotation:jsr250-api:1.0
 javax.inject:javax.inject:1
 javax.validation:validation-api:1.0.0.GA
+org.checkerframework:checker-qual:3.5.0
 org.json:json:20160212
 org.ow2.asm:asm-analysis:6.0
 org.ow2.asm:asm-commons:6.0
--- a/core/gradle/dependency-locks/testAnnotationProcessor.lockfile
+++ b/core/gradle/dependency-locks/testAnnotationProcessor.lockfile
@@ -3,7 +3,7 @@
 # This file is expected to be part of source control.
 com.github.ben-manes.caffeine:caffeine:2.7.0
 com.github.kevinstern:software-and-algorithms:1.0
-com.google.auto.value:auto-value:1.6.3
+com.google.auto.value:auto-value:1.7.4
 com.google.auto:auto-common:0.10
 com.google.code.findbugs:jFormatString:3.0.0
 com.google.code.findbugs:jsr305:3.0.2
@@ -19,7 +19,7 @@ com.google.errorprone:error_prone_type_annotations:2.3.4
 com.google.errorprone:javac-shaded:9-dev-r4023-3
 com.google.googlejavaformat:google-java-format:1.5
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava:30.0-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.j2objc:j2objc-annotations:1.3
 com.google.protobuf:protobuf-java:3.4.0
--- a/core/gradle/dependency-locks/testCompile.lockfile
+++ b/core/gradle/dependency-locks/testCompile.lockfile
@@ -6,10 +6,14 @@ aopalliance:aopalliance:1.0
 args4j:args4j:2.33
 cglib:cglib-nodep:2.2
 com.beust:jcommander:1.60
-com.fasterxml.jackson.core:jackson-annotations:2.11.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.11.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -18,51 +22,61 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
@@ -70,40 +84,43 @@ com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-api-stubs:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava-testlib:30.0-jre
-com.google.guava:guava:30.0-jre
+com.google.guava:guava-testlib:30.1-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -112,12 +129,12 @@ com.google.monitoring-client:contrib:1.0.7
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
@@ -127,46 +144,40 @@ com.googlecode.java-diff-utils:diffutils:1.3.0
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
 com.squareup.okhttp3:okhttp:3.11.0
-com.squareup.okhttp:okhttp:2.5.0
 com.squareup.okio:okio:1.14.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.thoughtworks.qdox:qdox:1.12.1
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -186,29 +197,28 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.13
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
+junit:junit:4.13.1
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-direct-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-direct-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.8.1
@@ -228,19 +238,19 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-all:1.3
-org.hamcrest:hamcrest-core:1.3
-org.hamcrest:hamcrest-library:1.3
+org.hamcrest:hamcrest-core:2.2
+org.hamcrest:hamcrest-library:2.2
+org.hamcrest:hamcrest:2.2
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -248,27 +258,26 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.junit-pioneer:junit-pioneer:0.7.0
-org.junit.jupiter:junit-jupiter-api:5.6.2
-org.junit.jupiter:junit-jupiter-engine:5.6.2
-org.junit.jupiter:junit-jupiter-migrationsupport:5.6.2
-org.junit.jupiter:junit-jupiter-params:5.6.2
-org.junit.platform:junit-platform-commons:1.6.2
-org.junit.platform:junit-platform-engine:1.6.2
-org.junit.platform:junit-platform-launcher:1.6.2
-org.junit.platform:junit-platform-runner:1.6.2
-org.junit.platform:junit-platform-suite-api:1.6.2
-org.junit:junit-bom:5.6.2
+org.junit.jupiter:junit-jupiter-api:5.7.0
+org.junit.jupiter:junit-jupiter-engine:5.7.0
+org.junit.jupiter:junit-jupiter-migrationsupport:5.7.0
+org.junit.jupiter:junit-jupiter-params:5.7.0
+org.junit.platform:junit-platform-commons:1.7.0
+org.junit.platform:junit-platform-engine:1.7.0
+org.junit.platform:junit-platform-launcher:1.7.0
+org.junit.platform:junit-platform-runner:1.7.0
+org.junit.platform:junit-platform-suite-api:1.7.0
+org.junit:junit-bom:5.7.0
 org.jvnet.staxex:stax-ex:1.8
-org.mockito:mockito-core:3.3.3
-org.mockito:mockito-junit-jupiter:3.3.3
+org.mockito:mockito-core:3.7.7
+org.mockito:mockito-junit-jupiter:3.7.7
 org.mortbay.jetty:jetty-util:6.1.26
 org.mortbay.jetty:jetty:6.1.26
-org.objenesis:objenesis:2.6
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:8.0.1
 org.ow2.asm:asm-commons:7.1
@@ -278,8 +287,6 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.seleniumhq.selenium:selenium-api:3.141.59
 org.seleniumhq.selenium:selenium-chrome-driver:3.141.59
 org.seleniumhq.selenium:selenium-edge-driver:3.141.59
@@ -291,13 +298,13 @@ org.seleniumhq.selenium:selenium-remote-driver:3.141.59
 org.seleniumhq.selenium:selenium-safari-driver:3.141.59
 org.seleniumhq.selenium:selenium-support:3.141.59
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:junit-jupiter:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:selenium:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:junit-jupiter:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:selenium:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.xerial.snappy:snappy-java:1.1.4
--- a/core/gradle/dependency-locks/testCompileClasspath.lockfile
+++ b/core/gradle/dependency-locks/testCompileClasspath.lockfile
@@ -6,10 +6,14 @@ aopalliance:aopalliance:1.0
 args4j:args4j:2.33
 cglib:cglib-nodep:2.2
 com.beust:jcommander:1.60
-com.fasterxml.jackson.core:jackson-annotations:2.11.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.11.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -18,50 +22,60 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
@@ -69,39 +83,42 @@ com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-api-stubs:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava-testlib:30.0-jre
-com.google.guava:guava:30.0-jre
+com.google.guava:guava-testlib:30.1-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -110,12 +127,12 @@ com.google.monitoring-client:contrib:1.0.7
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.11.4
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
@@ -125,46 +142,38 @@ com.googlecode.java-diff-utils:diffutils:1.3.0
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
 com.squareup.okhttp3:okhttp:3.11.0
-com.squareup.okhttp:okhttp:2.5.0
 com.squareup.okio:okio:1.14.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.thoughtworks.qdox:qdox:1.12.1
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -183,29 +192,28 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.13
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
+junit:junit:4.13.1
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-direct-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-direct-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.8.1
@@ -225,18 +233,18 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-all:1.3
-org.hamcrest:hamcrest-core:1.3
-org.hamcrest:hamcrest-library:1.3
+org.hamcrest:hamcrest-core:2.2
+org.hamcrest:hamcrest-library:2.2
+org.hamcrest:hamcrest:2.2
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -244,27 +252,26 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.junit-pioneer:junit-pioneer:0.7.0
-org.junit.jupiter:junit-jupiter-api:5.6.2
-org.junit.jupiter:junit-jupiter-engine:5.6.2
-org.junit.jupiter:junit-jupiter-migrationsupport:5.6.2
-org.junit.jupiter:junit-jupiter-params:5.6.2
-org.junit.platform:junit-platform-commons:1.6.2
-org.junit.platform:junit-platform-engine:1.6.2
-org.junit.platform:junit-platform-launcher:1.6.2
-org.junit.platform:junit-platform-runner:1.6.2
-org.junit.platform:junit-platform-suite-api:1.6.2
-org.junit:junit-bom:5.6.2
+org.junit.jupiter:junit-jupiter-api:5.7.0
+org.junit.jupiter:junit-jupiter-engine:5.7.0
+org.junit.jupiter:junit-jupiter-migrationsupport:5.7.0
+org.junit.jupiter:junit-jupiter-params:5.7.0
+org.junit.platform:junit-platform-commons:1.7.0
+org.junit.platform:junit-platform-engine:1.7.0
+org.junit.platform:junit-platform-launcher:1.7.0
+org.junit.platform:junit-platform-runner:1.7.0
+org.junit.platform:junit-platform-suite-api:1.7.0
+org.junit:junit-bom:5.7.0
 org.jvnet.staxex:stax-ex:1.8
-org.mockito:mockito-core:3.3.3
-org.mockito:mockito-junit-jupiter:3.3.3
+org.mockito:mockito-core:3.7.7
+org.mockito:mockito-junit-jupiter:3.7.7
 org.mortbay.jetty:jetty-util:6.1.26
 org.mortbay.jetty:jetty:6.1.26
-org.objenesis:objenesis:2.6
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:8.0.1
 org.ow2.asm:asm-commons:7.1
@@ -274,8 +281,6 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.seleniumhq.selenium:selenium-api:3.141.59
 org.seleniumhq.selenium:selenium-chrome-driver:3.141.59
 org.seleniumhq.selenium:selenium-edge-driver:3.141.59
@@ -287,13 +292,13 @@ org.seleniumhq.selenium:selenium-remote-driver:3.141.59
 org.seleniumhq.selenium:selenium-safari-driver:3.141.59
 org.seleniumhq.selenium:selenium-support:3.141.59
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:junit-jupiter:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:selenium:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:junit-jupiter:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:selenium:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.xerial.snappy:snappy-java:1.1.4
--- a/core/gradle/dependency-locks/testRuntime.lockfile
+++ b/core/gradle/dependency-locks/testRuntime.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.11.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.11.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,51 +26,61 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
@@ -74,41 +88,44 @@ com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-api-stubs:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
 com.google.cloud.sql:postgres-socket-factory:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava-testlib:30.0-jre
-com.google.guava:guava:30.0-jre
+com.google.guava:guava-testlib:30.1-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -117,12 +134,12 @@ com.google.monitoring-client:contrib:1.0.7
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
@@ -132,17 +149,14 @@ com.googlecode.java-diff-utils:diffutils:1.3.0
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
 com.squareup.okhttp3:okhttp:3.11.0
-com.squareup.okhttp:okhttp:2.5.0
 com.squareup.okio:okio:1.14.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.thoughtworks.qdox:qdox:1.12.1
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -151,31 +165,28 @@ guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
 io.github.java-diff-utils:java-diff-utils:4.0
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -195,30 +206,29 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.13
+junit:junit:4.13.1
 net.arnx:nashorn-promise:0.1.1
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-direct-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-direct-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.8.1
@@ -239,20 +249,20 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.eclipse.jgit:org.eclipse.jgit:4.4.1.201607150455-r
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-all:1.3
-org.hamcrest:hamcrest-core:1.3
-org.hamcrest:hamcrest-library:1.3
+org.hamcrest:hamcrest-core:2.2
+org.hamcrest:hamcrest-library:2.2
+org.hamcrest:hamcrest:2.2
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -260,27 +270,26 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.junit-pioneer:junit-pioneer:0.7.0
-org.junit.jupiter:junit-jupiter-api:5.6.2
-org.junit.jupiter:junit-jupiter-engine:5.6.2
-org.junit.jupiter:junit-jupiter-migrationsupport:5.6.2
-org.junit.jupiter:junit-jupiter-params:5.6.2
-org.junit.platform:junit-platform-commons:1.6.2
-org.junit.platform:junit-platform-engine:1.6.2
-org.junit.platform:junit-platform-launcher:1.6.2
-org.junit.platform:junit-platform-runner:1.6.2
-org.junit.platform:junit-platform-suite-api:1.6.2
-org.junit:junit-bom:5.6.2
+org.junit.jupiter:junit-jupiter-api:5.7.0
+org.junit.jupiter:junit-jupiter-engine:5.7.0
+org.junit.jupiter:junit-jupiter-migrationsupport:5.7.0
+org.junit.jupiter:junit-jupiter-params:5.7.0
+org.junit.platform:junit-platform-commons:1.7.0
+org.junit.platform:junit-platform-engine:1.7.0
+org.junit.platform:junit-platform-launcher:1.7.0
+org.junit.platform:junit-platform-runner:1.7.0
+org.junit.platform:junit-platform-suite-api:1.7.0
+org.junit:junit-bom:5.7.0
 org.jvnet.staxex:stax-ex:1.8
-org.mockito:mockito-core:3.3.3
-org.mockito:mockito-junit-jupiter:3.3.3
+org.mockito:mockito-core:3.7.7
+org.mockito:mockito-junit-jupiter:3.7.7
 org.mortbay.jetty:jetty-util:6.1.26
 org.mortbay.jetty:jetty:6.1.26
-org.objenesis:objenesis:2.6
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:8.0.1
 org.ow2.asm:asm-commons:7.1
@@ -290,8 +299,6 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.seleniumhq.selenium:selenium-api:3.141.59
 org.seleniumhq.selenium:selenium-chrome-driver:3.141.59
 org.seleniumhq.selenium:selenium-edge-driver:3.141.59
@@ -305,13 +312,13 @@ org.seleniumhq.selenium:selenium-support:3.141.59
 org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:junit-jupiter:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:selenium:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:junit-jupiter:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:selenium:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/gradle/dependency-locks/testRuntimeClasspath.lockfile
+++ b/core/gradle/dependency-locks/testRuntimeClasspath.lockfile
@@ -10,10 +10,14 @@ com.eclipsesource.j2v8:j2v8_linux_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_macosx_x86_64:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86:4.6.0
 com.eclipsesource.j2v8:j2v8_win32_x86_64:4.6.0
-com.fasterxml.jackson.core:jackson-annotations:2.11.2
-com.fasterxml.jackson.core:jackson-core:2.11.3
-com.fasterxml.jackson.core:jackson-databind:2.11.2
+com.fasterxml.jackson.core:jackson-annotations:2.12.1
+com.fasterxml.jackson.core:jackson-core:2.12.1
+com.fasterxml.jackson.core:jackson-databind:2.12.1
+com.fasterxml.jackson:jackson-bom:2.12.1
 com.fasterxml:classmate:1.5.1
+com.github.docker-java:docker-java-api:3.2.7
+com.github.docker-java:docker-java-transport-zerodep:3.2.7
+com.github.docker-java:docker-java-transport:3.2.7
 com.github.jnr:jffi:1.2.23
 com.github.jnr:jnr-a64asm:1.0.0
 com.github.jnr:jnr-constants:0.9.15
@@ -22,51 +26,61 @@ com.github.jnr:jnr-ffi:2.1.13
 com.github.jnr:jnr-posix:3.0.55
 com.github.jnr:jnr-unixsocket:0.30
 com.github.jnr:jnr-x86asm:1.0.2
+com.github.rholder:guava-retrying:2.0.0
 com.google.android:annotations:4.1.1.4
 com.google.api-client:google-api-client-appengine:1.30.8
-com.google.api-client:google-api-client-jackson2:1.30.9
-com.google.api-client:google-api-client-java6:1.30.9
+com.google.api-client:google-api-client-jackson2:1.30.10
+com.google.api-client:google-api-client-java6:1.30.10
 com.google.api-client:google-api-client-servlet:1.30.8
-com.google.api-client:google-api-client:1.30.9
-com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:grpc-google-common-protos:1.17.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.90.0
-com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.90.0
-com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-bigtable-v2:1.9.1
-com.google.api.grpc:proto-google-cloud-datastore-v1:0.85.0
-com.google.api.grpc:proto-google-cloud-pubsub-v1:1.85.1
-com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.3
-com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.3
-com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:1.49.1
-com.google.api.grpc:proto-google-cloud-spanner-v1:1.49.1
-com.google.api.grpc:proto-google-common-protos:2.0.0
-com.google.api.grpc:proto-google-iam-v1:1.0.1
+com.google.api-client:google-api-client:1.30.10
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:grpc-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-bigtable-v2:1.14.0
+com.google.api.grpc:grpc-google-cloud-pubsub-v1:1.90.3
+com.google.api.grpc:grpc-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:grpc-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:grpc-google-common-protos:1.18.1
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:1.5.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1alpha2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:0.105.5
+com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:0.105.5
+com.google.api.grpc:proto-google-cloud-bigtable-admin-v2:1.14.0
+com.google.api.grpc:proto-google-cloud-bigtable-v2:1.16.1
+com.google.api.grpc:proto-google-cloud-datastore-v1:0.88.0
+com.google.api.grpc:proto-google-cloud-pubsub-v1:1.92.0
+com.google.api.grpc:proto-google-cloud-pubsublite-v1:0.7.0
+com.google.api.grpc:proto-google-cloud-secretmanager-v1:1.2.9
+com.google.api.grpc:proto-google-cloud-secretmanager-v1beta1:1.2.9
+com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:2.0.2
+com.google.api.grpc:proto-google-cloud-spanner-v1:2.0.2
+com.google.api.grpc:proto-google-common-protos:2.0.1
+com.google.api.grpc:proto-google-iam-v1:1.0.5
 com.google.api:api-common:1.10.1
-com.google.api:gax-grpc:1.60.0
-com.google.api:gax-httpjson:0.70.1
-com.google.api:gax:1.60.0
+com.google.api:gax-grpc:1.60.1
+com.google.api:gax-httpjson:0.76.1
+com.google.api:gax:1.60.1
 com.google.apis:google-api-services-admin-directory:directory_v1-rev72-1.22.0
 com.google.apis:google-api-services-appengine:v1-rev101-1.25.0
-com.google.apis:google-api-services-bigquery:v2-rev20191211-1.30.9
-com.google.apis:google-api-services-clouddebugger:v2-rev20200313-1.30.9
+com.google.apis:google-api-services-bigquery:v2-rev20200916-1.30.10
+com.google.apis:google-api-services-clouddebugger:v2-rev20200501-1.30.10
 com.google.apis:google-api-services-cloudkms:v1-rev12-1.22.0
-com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200311-1.30.9
-com.google.apis:google-api-services-dataflow:v1b3-rev20200305-1.30.9
+com.google.apis:google-api-services-cloudresourcemanager:v1-rev20200720-1.30.10
+com.google.apis:google-api-services-dataflow:v1b3-rev20200713-1.30.10
 com.google.apis:google-api-services-dns:v2beta1-rev6-1.22.0
 com.google.apis:google-api-services-drive:v2-rev160-1.19.1
 com.google.apis:google-api-services-groupssettings:v1-rev60-1.22.0
-com.google.apis:google-api-services-healthcare:v1beta1-rev20200525-1.30.9
+com.google.apis:google-api-services-healthcare:v1beta1-rev20200713-1.30.10
+com.google.apis:google-api-services-iamcredentials:v1-rev20201022-1.30.10
 com.google.apis:google-api-services-monitoring:v3-rev426-1.23.0
-com.google.apis:google-api-services-pubsub:v1-rev20200312-1.30.9
+com.google.apis:google-api-services-pubsub:v1-rev20200713-1.30.10
 com.google.apis:google-api-services-sheets:v4-rev483-1.22.0
 com.google.apis:google-api-services-sqladmin:v1beta4-rev20190827-1.30.1
-com.google.apis:google-api-services-storage:v1-rev20200326-1.30.9
+com.google.apis:google-api-services-storage:v1-rev20200927-1.30.10
 com.google.appengine.tools:appengine-gcs-client:0.6
 com.google.appengine.tools:appengine-mapreduce:0.9
 com.google.appengine.tools:appengine-pipeline:0.2.13
@@ -74,41 +88,44 @@ com.google.appengine:appengine-api-1.0-sdk:1.9.81
 com.google.appengine:appengine-api-stubs:1.9.81
 com.google.appengine:appengine-remote-api:1.9.81
 com.google.appengine:appengine-testing:1.9.81
-com.google.auth:google-auth-library-credentials:0.22.0
-com.google.auth:google-auth-library-oauth2-http:0.22.0
+com.google.auth:google-auth-library-credentials:0.22.2
+com.google.auth:google-auth-library-oauth2-http:0.22.2
+com.google.auto.service:auto-service-annotations:1.0-rc7
 com.google.auto.value:auto-value-annotations:1.7.4
-com.google.auto.value:auto-value:1.6.3
-com.google.cloud.bigdataoss:gcsio:2.1.3
-com.google.cloud.bigdataoss:util:2.1.3
-com.google.cloud.bigtable:bigtable-client-core:1.13.0
+com.google.auto.value:auto-value:1.7.4
+com.google.cloud.bigdataoss:gcsio:2.1.6
+com.google.cloud.bigdataoss:util:2.1.6
+com.google.cloud.bigtable:bigtable-client-core:1.16.0
 com.google.cloud.datastore:datastore-v1-proto-client:1.6.3
 com.google.cloud.sql:jdbc-socket-factory-core:1.0.16
 com.google.cloud.sql:postgres-socket-factory:1.0.16
-com.google.cloud:google-cloud-bigquery:1.106.0
-com.google.cloud:google-cloud-bigquerystorage:0.125.0-beta
-com.google.cloud:google-cloud-bigtable:1.9.1
-com.google.cloud:google-cloud-core-grpc:1.92.2
-com.google.cloud:google-cloud-core-http:1.92.4
-com.google.cloud:google-cloud-core:1.92.5
-com.google.cloud:google-cloud-secretmanager:1.2.3
-com.google.cloud:google-cloud-spanner:1.49.1
+com.google.cloud:google-cloud-bigquery:1.122.2
+com.google.cloud:google-cloud-bigquerystorage:1.5.5
+com.google.cloud:google-cloud-bigtable:1.14.0
+com.google.cloud:google-cloud-core-grpc:1.93.9
+com.google.cloud:google-cloud-core-http:1.93.9
+com.google.cloud:google-cloud-core:1.93.9
+com.google.cloud:google-cloud-pubsub:1.110.0
+com.google.cloud:google-cloud-pubsublite:0.7.0
+com.google.cloud:google-cloud-secretmanager:1.2.9
+com.google.cloud:google-cloud-spanner:2.0.2
 com.google.code.findbugs:jsr305:3.0.2
 com.google.code.gson:gson:2.8.6
 com.google.common.html.types:types:1.0.4
 com.google.dagger:dagger:2.28
-com.google.errorprone:error_prone_annotations:2.4.0
+com.google.errorprone:error_prone_annotations:2.5.0
 com.google.flogger:flogger-system-backend:0.5.1
 com.google.flogger:flogger:0.5.1
 com.google.flogger:google-extensions:0.5.1
 com.google.guava:failureaccess:1.0.1
-com.google.guava:guava-testlib:30.0-jre
-com.google.guava:guava:30.0-jre
+com.google.guava:guava-testlib:30.1-jre
+com.google.guava:guava:30.1-jre
 com.google.guava:listenablefuture:9999.0-empty-to-avoid-conflict-with-guava
 com.google.gwt:gwt-user:2.8.2
-com.google.http-client:google-http-client-appengine:1.34.1
-com.google.http-client:google-http-client-jackson2:1.37.0
+com.google.http-client:google-http-client-appengine:1.36.0
+com.google.http-client:google-http-client-jackson2:1.38.0
 com.google.http-client:google-http-client-protobuf:1.33.0
-com.google.http-client:google-http-client:1.37.0
+com.google.http-client:google-http-client:1.38.0
 com.google.inject.extensions:guice-multibindings:4.1.0
 com.google.inject:guice:4.1.0
 com.google.j2objc:j2objc-annotations:1.3
@@ -117,12 +134,12 @@ com.google.monitoring-client:contrib:1.0.7
 com.google.monitoring-client:metrics:1.0.7
 com.google.monitoring-client:stackdriver:1.0.7
 com.google.oauth-client:google-oauth-client-appengine:1.30.5
-com.google.oauth-client:google-oauth-client-java6:1.30.6
+com.google.oauth-client:google-oauth-client-java6:1.31.2
 com.google.oauth-client:google-oauth-client-jetty:1.28.0
 com.google.oauth-client:google-oauth-client-servlet:1.30.5
-com.google.oauth-client:google-oauth-client:1.30.6
-com.google.protobuf:protobuf-java-util:3.13.0
-com.google.protobuf:protobuf-java:3.13.0
+com.google.oauth-client:google-oauth-client:1.31.2
+com.google.protobuf:protobuf-java-util:3.14.0
+com.google.protobuf:protobuf-java:3.14.0
 com.google.re2j:re2j:1.1
 com.google.template:soy:2018-03-14
 com.google.truth.extensions:truth-java8-extension:1.0
@@ -132,17 +149,14 @@ com.googlecode.java-diff-utils:diffutils:1.3.0
 com.googlecode.json-simple:json-simple:1.1.1
 com.ibm.icu:icu4j:57.1
 com.jcraft:jsch:0.1.55
-com.kohlschutter.junixsocket:junixsocket-common:2.0.4
-com.kohlschutter.junixsocket:junixsocket-native-common:2.0.4
 com.squareup.okhttp3:okhttp:3.11.0
-com.squareup.okhttp:okhttp:2.5.0
 com.squareup.okio:okio:1.14.0
 com.sun.istack:istack-commons-runtime:3.0.7
 com.sun.xml.fastinfoset:FastInfoset:1.2.15
 com.thoughtworks.paranamer:paranamer:2.7
 com.thoughtworks.qdox:qdox:1.12.1
 com.zaxxer:HikariCP:3.4.5
-commons-codec:commons-codec:1.13
+commons-codec:commons-codec:1.15
 commons-logging:commons-logging:1.2
 dnsjava:dnsjava:2.1.7
 guru.nidi.com.kitfox:svgSalamander:1.1.3
@@ -151,31 +165,28 @@ guru.nidi:graphviz-java:0.17.0
 io.dropwizard.metrics:metrics-core:3.2.6
 io.github.classgraph:classgraph:4.8.65
 io.github.java-diff-utils:java-diff-utils:4.0
-io.grpc:grpc-all:1.27.2
-io.grpc:grpc-alts:1.32.2
-io.grpc:grpc-api:1.32.2
-io.grpc:grpc-auth:1.32.2
-io.grpc:grpc-context:1.32.2
-io.grpc:grpc-core:1.32.2
-io.grpc:grpc-grpclb:1.32.2
-io.grpc:grpc-netty-shaded:1.32.2
-io.grpc:grpc-netty:1.27.2
-io.grpc:grpc-okhttp:1.27.2
-io.grpc:grpc-protobuf-lite:1.32.2
-io.grpc:grpc-protobuf:1.32.2
-io.grpc:grpc-stub:1.32.2
-io.grpc:grpc-testing:1.27.2
-io.netty:netty-buffer:4.1.42.Final
-io.netty:netty-codec-http2:4.1.42.Final
-io.netty:netty-codec-http:4.1.42.Final
-io.netty:netty-codec-socks:4.1.42.Final
-io.netty:netty-codec:4.1.42.Final
-io.netty:netty-common:4.1.42.Final
-io.netty:netty-handler-proxy:4.1.42.Final
-io.netty:netty-handler:4.1.42.Final
-io.netty:netty-resolver:4.1.42.Final
-io.netty:netty-tcnative-boringssl-static:2.0.17.Final
-io.netty:netty-transport:4.1.42.Final
+io.grpc:grpc-alts:1.34.1
+io.grpc:grpc-api:1.34.1
+io.grpc:grpc-auth:1.34.1
+io.grpc:grpc-context:1.34.1
+io.grpc:grpc-core:1.34.1
+io.grpc:grpc-grpclb:1.34.1
+io.grpc:grpc-netty-shaded:1.34.1
+io.grpc:grpc-netty:1.32.2
+io.grpc:grpc-protobuf-lite:1.34.1
+io.grpc:grpc-protobuf:1.34.1
+io.grpc:grpc-stub:1.34.1
+io.netty:netty-buffer:4.1.51.Final
+io.netty:netty-codec-http2:4.1.51.Final
+io.netty:netty-codec-http:4.1.51.Final
+io.netty:netty-codec-socks:4.1.51.Final
+io.netty:netty-codec:4.1.51.Final
+io.netty:netty-common:4.1.51.Final
+io.netty:netty-handler-proxy:4.1.51.Final
+io.netty:netty-handler:4.1.51.Final
+io.netty:netty-resolver:4.1.51.Final
+io.netty:netty-tcnative-boringssl-static:2.0.33.Final
+io.netty:netty-transport:4.1.51.Final
 io.opencensus:opencensus-api:0.24.0
 io.opencensus:opencensus-contrib-grpc-util:0.24.0
 io.opencensus:opencensus-contrib-http-util:0.24.0
@@ -195,30 +206,29 @@ javax.validation:validation-api:1.0.0.GA
 javax.xml.bind:jaxb-api:2.3.1
 jline:jline:1.0
 joda-time:joda-time:2.10.5
-junit:junit:4.13
+junit:junit:4.13.1
 net.arnx:nashorn-promise:0.1.1
-net.bytebuddy:byte-buddy-agent:1.10.5
-net.bytebuddy:byte-buddy:1.10.17
-net.java.dev.jna:jna-platform:5.5.0
+net.bytebuddy:byte-buddy-agent:1.10.19
+net.bytebuddy:byte-buddy:1.10.19
 net.java.dev.jna:jna:5.5.0
 org.apache.avro:avro:1.8.2
-org.apache.beam:beam-model-fn-execution:2.23.0
-org.apache.beam:beam-model-job-management:2.23.0
-org.apache.beam:beam-model-pipeline:2.23.0
-org.apache.beam:beam-runners-core-construction-java:2.23.0
-org.apache.beam:beam-runners-direct-java:2.23.0
-org.apache.beam:beam-runners-google-cloud-dataflow-java:2.23.0
-org.apache.beam:beam-runners-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-core:2.23.0
-org.apache.beam:beam-sdks-java-expansion-service:2.23.0
-org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.23.0
-org.apache.beam:beam-sdks-java-extensions-protobuf:2.23.0
-org.apache.beam:beam-sdks-java-fn-execution:2.23.0
-org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.23.0
+org.apache.beam:beam-model-fn-execution:2.27.0
+org.apache.beam:beam-model-job-management:2.27.0
+org.apache.beam:beam-model-pipeline:2.27.0
+org.apache.beam:beam-runners-core-construction-java:2.27.0
+org.apache.beam:beam-runners-direct-java:2.27.0
+org.apache.beam:beam-runners-google-cloud-dataflow-java:2.27.0
+org.apache.beam:beam-runners-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-core:2.27.0
+org.apache.beam:beam-sdks-java-expansion-service:2.27.0
+org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:2.27.0
+org.apache.beam:beam-sdks-java-extensions-protobuf:2.27.0
+org.apache.beam:beam-sdks-java-fn-execution:2.27.0
+org.apache.beam:beam-sdks-java-io-google-cloud-platform:2.27.0
 org.apache.beam:beam-vendor-bytebuddy-1_10_8:0.1
 org.apache.beam:beam-vendor-grpc-1_26_0:0.3
 org.apache.beam:beam-vendor-guava-26_0-jre:0.1
-org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.23.0
+org.apache.beam:beam-vendor-sdks-java-extensions-protobuf:2.27.0
 org.apache.commons:commons-compress:1.20
 org.apache.commons:commons-exec:1.3
 org.apache.commons:commons-lang3:3.8.1
@@ -239,20 +249,20 @@ org.bouncycastle:bcpg-jdk15on:1.61
 org.bouncycastle:bcpkix-jdk15on:1.61
 org.bouncycastle:bcprov-jdk15on:1.61
 org.checkerframework:checker-compat-qual:2.5.5
-org.checkerframework:checker-qual:3.5.0
+org.checkerframework:checker-qual:3.7.0
 org.codehaus.jackson:jackson-core-asl:1.9.13
 org.codehaus.jackson:jackson-mapper-asl:1.9.13
 org.codehaus.mojo:animal-sniffer-annotations:1.19
-org.conscrypt:conscrypt-openjdk-uber:2.2.1
+org.conscrypt:conscrypt-openjdk-uber:2.5.1
 org.dom4j:dom4j:2.1.3
 org.easymock:easymock:3.0
 org.eclipse.jgit:org.eclipse.jgit:4.4.1.201607150455-r
 org.flywaydb:flyway-core:5.2.4
 org.glassfish.jaxb:jaxb-runtime:2.3.1
 org.glassfish.jaxb:txw2:2.3.1
-org.hamcrest:hamcrest-all:1.3
-org.hamcrest:hamcrest-core:1.3
-org.hamcrest:hamcrest-library:1.3
+org.hamcrest:hamcrest-core:2.2
+org.hamcrest:hamcrest-library:2.2
+org.hamcrest:hamcrest:2.2
 org.hibernate.common:hibernate-commons-annotations:5.1.2.Final
 org.hibernate:hibernate-core:5.4.23.Final
 org.hibernate:hibernate-hikaricp:5.4.23.Final
@@ -260,27 +270,26 @@ org.javassist:javassist:3.24.0-GA
 org.jboss.logging:jboss-logging:3.4.1.Final
 org.jboss.spec.javax.transaction:jboss-transaction-api_1.2_spec:1.1.1.Final
 org.jboss:jandex:2.1.3.Final
-org.jetbrains:annotations:19.0.0
 org.joda:joda-money:1.0.1
-org.json:json:20160810
+org.json:json:20200518
 org.jsoup:jsoup:1.13.1
 org.junit-pioneer:junit-pioneer:0.7.0
-org.junit.jupiter:junit-jupiter-api:5.6.2
-org.junit.jupiter:junit-jupiter-engine:5.6.2
-org.junit.jupiter:junit-jupiter-migrationsupport:5.6.2
-org.junit.jupiter:junit-jupiter-params:5.6.2
-org.junit.platform:junit-platform-commons:1.6.2
-org.junit.platform:junit-platform-engine:1.6.2
-org.junit.platform:junit-platform-launcher:1.6.2
-org.junit.platform:junit-platform-runner:1.6.2
-org.junit.platform:junit-platform-suite-api:1.6.2
-org.junit:junit-bom:5.6.2
+org.junit.jupiter:junit-jupiter-api:5.7.0
+org.junit.jupiter:junit-jupiter-engine:5.7.0
+org.junit.jupiter:junit-jupiter-migrationsupport:5.7.0
+org.junit.jupiter:junit-jupiter-params:5.7.0
+org.junit.platform:junit-platform-commons:1.7.0
+org.junit.platform:junit-platform-engine:1.7.0
+org.junit.platform:junit-platform-launcher:1.7.0
+org.junit.platform:junit-platform-runner:1.7.0
+org.junit.platform:junit-platform-suite-api:1.7.0
+org.junit:junit-bom:5.7.0
 org.jvnet.staxex:stax-ex:1.8
-org.mockito:mockito-core:3.3.3
-org.mockito:mockito-junit-jupiter:3.3.3
+org.mockito:mockito-core:3.7.7
+org.mockito:mockito-junit-jupiter:3.7.7
 org.mortbay.jetty:jetty-util:6.1.26
 org.mortbay.jetty:jetty:6.1.26
-org.objenesis:objenesis:2.6
+org.objenesis:objenesis:3.1
 org.opentest4j:opentest4j:1.2.0
 org.ow2.asm:asm-analysis:8.0.1
 org.ow2.asm:asm-commons:7.1
@@ -290,8 +299,6 @@ org.ow2.asm:asm:8.0.1
 org.postgresql:postgresql:42.2.18
 org.rnorth.duct-tape:duct-tape:1.0.8
 org.rnorth.visible-assertions:visible-assertions:2.1.2
-org.rnorth:tcp-unix-socket-proxy:1.0.2
-org.scijava:native-lib-loader:2.0.2
 org.seleniumhq.selenium:selenium-api:3.141.59
 org.seleniumhq.selenium:selenium-chrome-driver:3.141.59
 org.seleniumhq.selenium:selenium-edge-driver:3.141.59
@@ -306,13 +313,13 @@ org.slf4j:jcl-over-slf4j:1.7.30
 org.slf4j:jul-to-slf4j:1.7.30
 org.slf4j:slf4j-api:1.7.30
 org.slf4j:slf4j-jdk14:1.7.28
-org.testcontainers:database-commons:1.14.3
-org.testcontainers:jdbc:1.14.3
-org.testcontainers:junit-jupiter:1.14.3
-org.testcontainers:postgresql:1.14.3
-org.testcontainers:selenium:1.14.3
-org.testcontainers:testcontainers:1.14.3
-org.threeten:threetenbp:1.4.5
+org.testcontainers:database-commons:1.15.1
+org.testcontainers:jdbc:1.15.1
+org.testcontainers:junit-jupiter:1.15.1
+org.testcontainers:postgresql:1.15.1
+org.testcontainers:selenium:1.15.1
+org.testcontainers:testcontainers:1.15.1
+org.threeten:threetenbp:1.5.0
 org.tukaani:xz:1.8
 org.w3c.css:sac:1.3
 org.webjars.npm:viz.js-for-graphviz-java:2.1.3
--- a/core/src/main/java/google/registry/backup/ReplayCommitLogsToSqlAction.java
+++ b/core/src/main/java/google/registry/backup/ReplayCommitLogsToSqlAction.java
@@ -140,11 +140,13 @@ public class ReplayCommitLogsToSqlAction implements Runnable {
    transaction.stream()
        .sorted(ReplayCommitLogsToSqlAction::compareByWeight)
        .forEach(
-            versionedEntity ->
-                versionedEntity
-                    .getEntity()
-                    .ifPresentOrElse(
-                        this::handleEntityPut, () -> handleEntityDelete(versionedEntity)));
+            versionedEntity -> {
+              if (versionedEntity.getEntity().isPresent()) {
+                handleEntityPut(versionedEntity.getEntity().get());
+              } else {
+                handleEntityDelete(versionedEntity);
+              }
+            });
  }

  private void handleEntityPut(Entity entity) {
--- a/core/src/main/java/google/registry/batch/DeleteExpiredDomainsAction.java
+++ b/core/src/main/java/google/registry/batch/DeleteExpiredDomainsAction.java
@@ -104,8 +104,9 @@ public class DeleteExpiredDomainsAction implements Runnable {
            runLocked();
            response.setStatus(SC_OK);
          } catch (Exception e) {
+            logger.atSevere().withCause(e).log("Errored out during execution.");
            response.setStatus(SC_INTERNAL_SERVER_ERROR);
-            response.setPayload("Encountered error; see GCP logs for full details.");
+            response.setPayload(String.format("Errored out with cause: %s", e));
          }
          return null;
        };
--- a/core/src/main/java/google/registry/beam/common/JpaDemoPipeline.java
+++ b/core/src/main/java/google/registry/beam/common/JpaDemoPipeline.java
@@ -0,0 +1,81 @@
+// Copyright 2020 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.beam.common;
+
+import static com.google.common.base.Verify.verify;
+import static google.registry.persistence.transaction.TransactionManagerFactory.jpaTm;
+
+import google.registry.backup.AppEngineEnvironment;
+import google.registry.persistence.transaction.JpaTransactionManager;
+import java.io.Serializable;
+import org.apache.beam.sdk.Pipeline;
+import org.apache.beam.sdk.metrics.Counter;
+import org.apache.beam.sdk.metrics.Metrics;
+import org.apache.beam.sdk.options.PipelineOptionsFactory;
+import org.apache.beam.sdk.transforms.Create;
+import org.apache.beam.sdk.transforms.DoFn;
+import org.apache.beam.sdk.transforms.ParDo;
+
+/** Toy pipeline that demonstrates how to use {@link JpaTransactionManager} in BEAM pipelines. */
+public class JpaDemoPipeline implements Serializable {
+
+  public static void main(String[] args) {
+    RegistryPipelineOptions options =
+        PipelineOptionsFactory.fromArgs(args).withValidation().as(RegistryPipelineOptions.class);
+    RegistryPipelineOptions.validateRegistryPipelineOptions(options);
+
+    Pipeline pipeline = Pipeline.create(options);
+    pipeline
+        .apply("Start", Create.of((Void) null))
+        .apply(
+            "Generate Elements",
+            ParDo.of(
+                new DoFn<Void, Void>() {
+                  @ProcessElement
+                  public void processElement(OutputReceiver<Void> output) {
+                    for (int i = 0; i < 500; i++) {
+                      output.output(null);
+                    }
+                  }
+                }))
+        .apply(
+            "Make Query",
+            ParDo.of(
+                new DoFn<Void, Void>() {
+                  private Counter counter = Metrics.counter("Demo", "Read");
+
+                  @ProcessElement
+                  public void processElement() {
+                    // AppEngineEnvironment is needed as long as JPA entity classes still depends
+                    // on Objectify.
+                    try (AppEngineEnvironment allowOfyEntity = new AppEngineEnvironment()) {
+                      int result =
+                          (Integer)
+                              jpaTm()
+                                  .transact(
+                                      () ->
+                                          jpaTm()
+                                              .getEntityManager()
+                                              .createNativeQuery("select 1;")
+                                              .getSingleResult());
+                      verify(result == 1, "Expecting 1, got %s.", result);
+                    }
+                    counter.inc();
+                  }
+                }));
+
+    pipeline.run();
+  }
+}
--- a/core/src/main/java/google/registry/beam/common/RegistryPipelineComponent.java
+++ b/core/src/main/java/google/registry/beam/common/RegistryPipelineComponent.java
@@ -0,0 +1,47 @@
+// Copyright 2020 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.beam.common;
+
+import dagger.Component;
+import dagger.Lazy;
+import google.registry.config.CredentialModule;
+import google.registry.config.RegistryConfig.Config;
+import google.registry.config.RegistryConfig.ConfigModule;
+import google.registry.persistence.PersistenceModule;
+import google.registry.persistence.PersistenceModule.BeamJpaTm;
+import google.registry.persistence.transaction.JpaTransactionManager;
+import google.registry.privileges.secretmanager.SecretManagerModule;
+import google.registry.util.UtilsModule;
+import javax.inject.Singleton;
+
+/** Component that provides everything needed on a Pipeline worker. */
+@Singleton
+@Component(
+    modules = {
+      ConfigModule.class,
+      CredentialModule.class,
+      PersistenceModule.class,
+      SecretManagerModule.class,
+      UtilsModule.class
+    })
+public interface RegistryPipelineComponent {
+
+  /** Returns the GCP project ID. */
+  @Config("projectId")
+  String getProjectId();
+
+  @BeamJpaTm
+  Lazy<JpaTransactionManager> getJpaTransactionManager();
+}
--- a/core/src/main/java/google/registry/beam/common/RegistryPipelineOptions.java
+++ b/core/src/main/java/google/registry/beam/common/RegistryPipelineOptions.java
@@ -0,0 +1,58 @@
+// Copyright 2020 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.beam.common;
+
+import google.registry.config.RegistryEnvironment;
+import java.util.Objects;
+import javax.annotation.Nullable;
+import org.apache.beam.sdk.extensions.gcp.options.GcpOptions;
+import org.apache.beam.sdk.options.Description;
+
+/** Defines Nomulus-specific pipeline options. */
+public interface RegistryPipelineOptions extends GcpOptions {
+
+  @Description("The Registry environment.")
+  @Nullable
+  RegistryEnvironment getRegistryEnvironment();
+
+  void setRegistryEnvironment(RegistryEnvironment environment);
+
+  /**
+   * Validates the GCP project and Registry environment settings in {@code option}. If project is
+   * undefined, it is set according to the Registry environment; if project is defined but
+   * inconsistent with the Registry environment, an {@link IllegalArgumentException} will be thrown.
+   *
+   * <p>This method may modify the system property ("google.registry.environment" which is defined
+   * in {@link RegistryEnvironment}). Tests calling this method must restore the original
+   * environment on completion.
+   */
+  static void validateRegistryPipelineOptions(RegistryPipelineOptions option) {
+    RegistryEnvironment environment = option.getRegistryEnvironment();
+    if (environment == null) {
+      return;
+    }
+    environment.setup();
+    String projectByEnv = DaggerRegistryPipelineComponent.create().getProjectId();
+    if (Objects.equals(option.getProject(), projectByEnv)) {
+      return;
+    }
+    if (option.getProject() == null) {
+      option.setProject(projectByEnv);
+      return;
+    }
+    throw new IllegalArgumentException(
+        "Arguments for --project and --registryEnvironment do not match.");
+  }
+}
--- a/core/src/main/java/google/registry/beam/common/RegistryPipelineWorkerInitializer.java
+++ b/core/src/main/java/google/registry/beam/common/RegistryPipelineWorkerInitializer.java
@@ -0,0 +1,49 @@
+// Copyright 2020 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.beam.common;
+
+import com.google.auto.service.AutoService;
+import com.google.common.flogger.FluentLogger;
+import dagger.Lazy;
+import google.registry.config.RegistryEnvironment;
+import google.registry.persistence.transaction.JpaTransactionManager;
+import google.registry.persistence.transaction.TransactionManagerFactory;
+import org.apache.beam.sdk.harness.JvmInitializer;
+import org.apache.beam.sdk.options.PipelineOptions;
+
+/**
+ * Sets up Nomulus environment and initializes JPA on each pipeline worker.
+ *
+ * <p>This class only takes effect in portable beam pipeline runners (including the Cloud Dataflow
+ * runner). It is not invoked in test pipelines.
+ */
+@AutoService(JvmInitializer.class)
+public class RegistryPipelineWorkerInitializer implements JvmInitializer {
+  private static final FluentLogger logger = FluentLogger.forEnclosingClass();
+
+  @Override
+  public void beforeProcessing(PipelineOptions options) {
+    RegistryEnvironment environment =
+        options.as(RegistryPipelineOptions.class).getRegistryEnvironment();
+    if (environment == null || environment.equals(RegistryEnvironment.UNITTEST)) {
+      return;
+    }
+    logger.atInfo().log("Setting up RegistryEnvironment: %s", environment);
+    environment.setup();
+    Lazy<JpaTransactionManager> transactionManagerLazy =
+        DaggerRegistryPipelineComponent.create().getJpaTransactionManager();
+    TransactionManagerFactory.setJpaTmOnBeamWorker(transactionManagerLazy::get);
+  }
+}
--- a/core/src/main/java/google/registry/env/common/backend/WEB-INF/web.xml
+++ b/core/src/main/java/google/registry/env/common/backend/WEB-INF/web.xml
@@ -337,12 +337,18 @@
    <url-pattern>/_dr/task/refreshDnsOnHostRename</url-pattern>
  </servlet-mapping>

-  <!--  Mapreduce to expand recurring billing events into OneTimes. -->
+  <!-- Mapreduce to expand recurring billing events into OneTimes. -->
  <servlet-mapping>
    <servlet-name>backend-servlet</servlet-name>
    <url-pattern>/_dr/task/expandRecurringBillingEvents</url-pattern>
  </servlet-mapping>

+  <!-- Background action to delete domains past end of autorenewal. -->
+  <servlet-mapping>
+    <servlet-name>backend-servlet</servlet-name>
+    <url-pattern>/_dr/task/deleteExpiredDomains</url-pattern>
+  </servlet-mapping>
+
  <!-- Mapreduce to import contacts from escrow file -->
  <servlet-mapping>
    <servlet-name>backend-servlet</servlet-name>
--- a/core/src/main/java/google/registry/env/production/default/WEB-INF/cron.xml
+++ b/core/src/main/java/google/registry/env/production/default/WEB-INF/cron.xml
@@ -280,7 +280,7 @@
  </cron>

  <cron>
-    <url><![CDATA[/_dr/task/icannReportingUpload]]></url>
+    <url><![CDATA[/_dr/cron/fanout?queue=retryable-cron-tasks&endpoint=/_dr/task/icannReportingUpload&runInEmpty]]></url>
    <description>
      Checks if the monthly ICANN reports have been successfully uploaded. If they have not, attempts to upload them again.
      Most of the time, this job should not do anything since the uploads are triggered when the reports are staged.
--- a/core/src/main/java/google/registry/export/BigqueryPollJobAction.java
+++ b/core/src/main/java/google/registry/export/BigqueryPollJobAction.java
@@ -45,13 +45,16 @@ import org.joda.time.Duration;
 /**
 * An action which polls the state of a bigquery job. If it is completed then it will log its
 * completion state; otherwise it will return a failure code so that the task will be retried.
+ *
+ * <p>Note that this is AUTH_INTERNAL_ONLY: we don't allow "admin" for this to mitigate a
+ * vulnerability, see b/177308043.
 */
@Action(
    service = Action.Service.BACKEND,
    path = BigqueryPollJobAction.PATH,
    method = {Action.Method.GET, Action.Method.POST},
    automaticallyPrintOk = true,
-    auth = Auth.AUTH_INTERNAL_OR_ADMIN)
+    auth = Auth.AUTH_INTERNAL_ONLY)
 public class BigqueryPollJobAction implements Runnable {

  private static final FluentLogger logger = FluentLogger.forEnclosingClass();
--- a/core/src/main/java/google/registry/export/ExportPremiumTermsAction.java
+++ b/core/src/main/java/google/registry/export/ExportPremiumTermsAction.java
@@ -17,7 +17,6 @@ package google.registry.export;
 import static com.google.common.base.Preconditions.checkState;
 import static com.google.common.base.Strings.isNullOrEmpty;
 import static com.google.common.net.MediaType.PLAIN_TEXT_UTF_8;
-import static google.registry.model.registry.label.PremiumListUtils.loadPremiumListEntries;
 import static google.registry.request.Action.Method.POST;
 import static java.nio.charset.StandardCharsets.UTF_8;
 import static javax.servlet.http.HttpServletResponse.SC_INTERNAL_SERVER_ERROR;
@@ -32,7 +31,8 @@ import com.google.common.flogger.FluentLogger;
 import com.google.common.net.MediaType;
 import google.registry.config.RegistryConfig.Config;
 import google.registry.model.registry.Registry;
-import google.registry.model.registry.label.PremiumList;
+import google.registry.model.registry.label.PremiumList.PremiumListEntry;
+import google.registry.model.registry.label.PremiumListDualDao;
 import google.registry.request.Action;
 import google.registry.request.Parameter;
 import google.registry.request.RequestParameters;
@@ -137,11 +137,12 @@ public class ExportPremiumTermsAction implements Runnable {
  }

  private String getFormattedPremiumTerms(Registry registry) {
-    Optional<PremiumList> premiumList = PremiumList.getCached(registry.getPremiumList().getName());
-    checkState(premiumList.isPresent(), "Could not load premium list for " + tld);
+    String premiumListName = registry.getPremiumList().getName();
+    checkState(
+        PremiumListDualDao.exists(premiumListName), "Could not load premium list for " + tld);
    SortedSet<String> premiumTerms =
-        Streams.stream(loadPremiumListEntries(premiumList.get()))
-            .map(entry -> Joiner.on(",").join(entry.getLabel(), entry.getValue()))
+        Streams.stream(PremiumListDualDao.loadAllPremiumListEntries(premiumListName))
+            .map(PremiumListEntry::toString)
            .collect(ImmutableSortedSet.toImmutableSortedSet(String::compareTo));

    return Joiner.on("\n")
--- a/core/src/main/java/google/registry/flows/EppRequestHandler.java
+++ b/core/src/main/java/google/registry/flows/EppRequestHandler.java
@@ -25,6 +25,7 @@ import com.google.common.flogger.FluentLogger;
 import com.google.common.net.MediaType;
 import google.registry.model.eppoutput.EppOutput;
 import google.registry.request.Response;
+import google.registry.util.ProxyHttpHeaders;
 import javax.inject.Inject;

 /** Handle an EPP request and response. */
@@ -72,7 +73,7 @@ public class EppRequestHandler {
      // See: https://tools.ietf.org/html/rfc5734#section-2
      if (eppOutput.isResponse()
          && eppOutput.getResponse().getResult().getCode() == SUCCESS_AND_CLOSE) {
-        response.setHeader("Epp-Session", "close");
+        response.setHeader(ProxyHttpHeaders.EPP_SESSION, "close");
      }
      // If a login request returns a success, a logged-in header is added to the response to inform
      // the proxy that it is no longer necessary to send the full client certificate to the backend
@@ -80,7 +81,7 @@ public class EppRequestHandler {
      if (eppOutput.isResponse()
          && eppOutput.getResponse().isLoginResponse()
          && eppOutput.isSuccess()) {
-        response.setHeader("Logged-In", "true");
+        response.setHeader(ProxyHttpHeaders.LOGGED_IN, "true");
      }
    } catch (Exception e) {
      logger.atWarning().withCause(e).log("handleEppCommand general exception");
--- a/core/src/main/java/google/registry/flows/ExtensionManager.java
+++ b/core/src/main/java/google/registry/flows/ExtensionManager.java
@@ -47,8 +47,8 @@ public final class ExtensionManager {

  private static final FluentLogger logger = FluentLogger.forEnclosingClass();

-  /** Blacklist of extension URIs that cause an error if they are used without being declared. */
-  private static final ImmutableSet<String> UNDECLARED_URIS_BLACKLIST = FEE_EXTENSION_URIS;
+  /** Denylist of extension URIs that cause an error if they are used without being declared. */
+  private static final ImmutableSet<String> UNDECLARED_URIS_DENYLIST = FEE_EXTENSION_URIS;

  private final ImmutableSet.Builder<Class<? extends CommandExtension>> implementedBuilder =
      new ImmutableSet.Builder<>();
@@ -95,7 +95,7 @@ public final class ExtensionManager {
    if (undeclaredUris.isEmpty()) {
      return;
    }
-    Set<String> undeclaredUrisThatError = intersection(undeclaredUris, UNDECLARED_URIS_BLACKLIST);
+    Set<String> undeclaredUrisThatError = intersection(undeclaredUris, UNDECLARED_URIS_DENYLIST);
    if (!undeclaredUrisThatError.isEmpty()) {
      throw new UndeclaredServiceExtensionException(undeclaredUrisThatError);
    }
--- a/core/src/main/java/google/registry/flows/TlsCredentials.java
+++ b/core/src/main/java/google/registry/flows/TlsCredentials.java
@@ -33,6 +33,8 @@ import google.registry.flows.certs.CertificateChecker.InsecureCertificateExcepti
 import google.registry.model.registrar.Registrar;
 import google.registry.request.Header;
 import google.registry.util.CidrAddressBlock;
+import google.registry.util.Clock;
+import google.registry.util.ProxyHttpHeaders;
 import java.io.ByteArrayInputStream;
 import java.net.InetAddress;
 import java.security.cert.CertificateException;
@@ -41,6 +43,7 @@ import java.util.Base64;
 import java.util.Optional;
 import javax.inject.Inject;
 import javax.servlet.http.HttpServletRequest;
+import org.joda.time.DateTime;

 /**
 * Container and validation for TLS certificate and IP-allow-listing.
@@ -63,25 +66,30 @@ import javax.servlet.http.HttpServletRequest;
 public class TlsCredentials implements TransportCredentials {

  private static final FluentLogger logger = FluentLogger.forEnclosingClass();
+  private static final DateTime CERT_ENFORCEMENT_START_TIME =
+      DateTime.parse("2021-03-01T16:00:00Z");

  private final boolean requireSslCertificates;
  private final Optional<String> clientCertificateHash;
  private final Optional<String> clientCertificate;
  private final Optional<InetAddress> clientInetAddr;
  private final CertificateChecker certificateChecker;
+  private final Clock clock;

  @Inject
  public TlsCredentials(
      @Config("requireSslCertificates") boolean requireSslCertificates,
-      @Header("X-SSL-Certificate") Optional<String> clientCertificateHash,
-      @Header("X-SSL-Full-Certificate") Optional<String> clientCertificate,
-      @Header("X-Forwarded-For") Optional<String> clientAddress,
-      CertificateChecker certificateChecker) {
+      @Header(ProxyHttpHeaders.CERTIFICATE_HASH) Optional<String> clientCertificateHash,
+      @Header(ProxyHttpHeaders.FULL_CERTIFICATE) Optional<String> clientCertificate,
+      @Header(ProxyHttpHeaders.IP_ADDRESS) Optional<String> clientAddress,
+      CertificateChecker certificateChecker,
+      Clock clock) {
    this.requireSslCertificates = requireSslCertificates;
    this.clientCertificateHash = clientCertificateHash;
    this.clientCertificate = clientCertificate;
    this.clientInetAddr = clientAddress.map(TlsCredentials::parseInetAddress);
    this.certificateChecker = certificateChecker;
+    this.clock = clock;
  }

  static InetAddress parseInetAddress(String asciiAddr) {
@@ -180,9 +188,12 @@ public class TlsCredentials implements TransportCredentials {
        try {
          certificateChecker.validateCertificate(passedCert);
        } catch (InsecureCertificateException e) {
+          // TODO(Sarahbot@): Remove this if statement after March 1. After March 1, exception
+          // should be thrown in all environments.
          // throw exception in unit tests and Sandbox
          if (RegistryEnvironment.get().equals(RegistryEnvironment.UNITTEST)
-              || RegistryEnvironment.get().equals(RegistryEnvironment.SANDBOX)) {
+              || RegistryEnvironment.get().equals(RegistryEnvironment.SANDBOX)
+              || clock.nowUtc().isAfter(CERT_ENFORCEMENT_START_TIME)) {
            throw new CertificateContainsSecurityViolationsException(e);
          }
          logger.atWarning().log(
@@ -204,6 +215,9 @@ public class TlsCredentials implements TransportCredentials {
  }

  private void validateCertificateHash(Registrar registrar) throws AuthenticationErrorException {
+    logger.atWarning().log(
+        "Error validating certificate for %s, attempting to validate using certificate hash.",
+        registrar.getClientId());
    // Check the certificate hash as a failover
    // TODO(sarahbot): Remove hash checks once certificate checks are working.
    if (!registrar.getClientCertificateHash().isPresent()
@@ -315,25 +329,25 @@ public class TlsCredentials implements TransportCredentials {
  public static final class EppTlsModule {

    @Provides
-    @Header("X-SSL-Certificate")
+    @Header(ProxyHttpHeaders.CERTIFICATE_HASH)
    static Optional<String> provideClientCertificateHash(HttpServletRequest req) {
      // Note: This header is actually required, we just want to handle its absence explicitly
      // by throwing an EPP exception rather than a generic Bad Request exception.
-      return extractOptionalHeader(req, "X-SSL-Certificate");
+      return extractOptionalHeader(req, ProxyHttpHeaders.CERTIFICATE_HASH);
    }

    @Provides
-    @Header("X-SSL-Full-Certificate")
+    @Header(ProxyHttpHeaders.FULL_CERTIFICATE)
    static Optional<String> provideClientCertificate(HttpServletRequest req) {
      // Note: This header is actually required, we just want to handle its absence explicitly
      // by throwing an EPP exception rather than a generic Bad Request exception.
-      return extractOptionalHeader(req, "X-SSL-Full-Certificate");
+      return extractOptionalHeader(req, ProxyHttpHeaders.FULL_CERTIFICATE);
    }

    @Provides
-    @Header("X-Forwarded-For")
-    static Optional<String> provideForwardedFor(HttpServletRequest req) {
-      return extractOptionalHeader(req, "X-Forwarded-For");
+    @Header(ProxyHttpHeaders.IP_ADDRESS)
+    static Optional<String> provideIpAddress(HttpServletRequest req) {
+      return extractOptionalHeader(req, ProxyHttpHeaders.IP_ADDRESS);
    }
  }
 }
--- a/core/src/main/java/google/registry/flows/domain/DomainCheckFlow.java
+++ b/core/src/main/java/google/registry/flows/domain/DomainCheckFlow.java
@@ -301,6 +301,7 @@ public final class DomainCheckFlow implements Flow {
          feeCheck.getItems().stream()
              .filter(fc -> fc.getCommandName() == CommandName.RESTORE)
              .map(FeeCheckCommandExtensionItem::getDomainName)
+              .distinct()
              .collect(toImmutableList());
    } else if (feeCheck.getItems().stream()
        .anyMatch(fc -> fc.getCommandName() == CommandName.RESTORE)) {
--- a/core/src/main/java/google/registry/model/DatabaseMigrationUtils.java
+++ b/core/src/main/java/google/registry/model/DatabaseMigrationUtils.java
@@ -16,6 +16,9 @@ package google.registry.model;

 import com.google.common.flogger.FluentLogger;
 import google.registry.config.RegistryEnvironment;
+import google.registry.model.common.DatabaseTransitionSchedule;
+import google.registry.model.common.DatabaseTransitionSchedule.PrimaryDatabase;
+import google.registry.model.common.DatabaseTransitionSchedule.TransitionId;

 /** Utility methods related to migrating dual-read/dual-write entities. */
 public class DatabaseMigrationUtils {
@@ -34,5 +37,12 @@ public class DatabaseMigrationUtils {
    }
  }

+  /** Gets the value for the database currently considered primary. */
+  public static PrimaryDatabase getPrimaryDatabase(TransitionId transitionId) {
+    return DatabaseTransitionSchedule.getCached(transitionId)
+        .map(DatabaseTransitionSchedule::getPrimaryDatabase)
+        .orElse(PrimaryDatabase.DATASTORE);
+  }
+
  private DatabaseMigrationUtils() {}
 }
--- a/core/src/main/java/google/registry/model/EntityClasses.java
+++ b/core/src/main/java/google/registry/model/EntityClasses.java
@@ -17,6 +17,7 @@ package google.registry.model;
 import com.google.common.collect.ImmutableSet;
 import google.registry.model.billing.BillingEvent;
 import google.registry.model.common.Cursor;
+import google.registry.model.common.DatabaseTransitionSchedule;
 import google.registry.model.common.EntityGroupRoot;
 import google.registry.model.common.GaeUserIdConverter;
 import google.registry.model.contact.ContactHistory;
@@ -51,6 +52,7 @@ import google.registry.model.tmch.ClaimsListShard;
 import google.registry.model.tmch.ClaimsListShard.ClaimsListRevision;
 import google.registry.model.tmch.ClaimsListShard.ClaimsListSingleton;
 import google.registry.model.tmch.TmchCrl;
+import google.registry.schema.replay.LastSqlTransaction;

 /** Sets of classes of the Objectify-registered entities in use throughout the model. */
 public final class EntityClasses {
@@ -74,6 +76,7 @@ public final class EntityClasses {
          ContactHistory.class,
          ContactResource.class,
          Cursor.class,
+          DatabaseTransitionSchedule.class,
          DomainBase.class,
          DomainHistory.class,
          EntityGroupRoot.class,
@@ -88,6 +91,7 @@ public final class EntityClasses {
          HostResource.class,
          KmsSecret.class,
          KmsSecretRevision.class,
+          LastSqlTransaction.class,
          Lock.class,
          PollMessage.class,
          PollMessage.Autorenew.class,
--- a/core/src/main/java/google/registry/model/OteAccountBuilder.java
+++ b/core/src/main/java/google/registry/model/OteAccountBuilder.java
@@ -40,6 +40,7 @@ import google.registry.model.registrar.RegistrarContact;
 import google.registry.model.registry.Registry;
 import google.registry.model.registry.Registry.TldState;
 import google.registry.model.registry.label.PremiumList;
+import google.registry.model.registry.label.PremiumListDualDao;
 import google.registry.util.CidrAddressBlock;
 import java.util.Collection;
 import java.util.Optional;
@@ -288,7 +289,7 @@ public final class OteAccountBuilder {
      boolean isEarlyAccess,
      int roidSuffix) {
    String tldNameAlphaNumerical = tldName.replaceAll("[^a-z0-9]", "");
-    Optional<PremiumList> premiumList = PremiumList.getUncached(DEFAULT_PREMIUM_LIST);
+    Optional<PremiumList> premiumList = PremiumListDualDao.getLatestRevision(DEFAULT_PREMIUM_LIST);
    checkState(premiumList.isPresent(), "Couldn't find premium list %s.", DEFAULT_PREMIUM_LIST);
    Registry.Builder builder =
        new Registry.Builder()
--- a/core/src/main/java/google/registry/model/common/DatabaseTransitionSchedule.java
+++ b/core/src/main/java/google/registry/model/common/DatabaseTransitionSchedule.java
@@ -0,0 +1,161 @@
+// Copyright 2021 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.model.common;
+
+import static com.google.common.base.Preconditions.checkNotNull;
+import static google.registry.config.RegistryConfig.getSingletonCacheRefreshDuration;
+import static google.registry.model.common.EntityGroupRoot.getCrossTldKey;
+import static google.registry.persistence.transaction.TransactionManagerFactory.ofyTm;
+import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
+
+import com.google.common.cache.CacheBuilder;
+import com.google.common.cache.CacheLoader;
+import com.google.common.cache.LoadingCache;
+import com.google.common.collect.ImmutableSortedMap;
+import com.googlecode.objectify.Key;
+import com.googlecode.objectify.annotation.Embed;
+import com.googlecode.objectify.annotation.Entity;
+import com.googlecode.objectify.annotation.Id;
+import com.googlecode.objectify.annotation.Mapify;
+import com.googlecode.objectify.annotation.Parent;
+import google.registry.model.ImmutableObject;
+import google.registry.model.UpdateAutoTimestamp;
+import google.registry.model.common.TimedTransitionProperty.TimeMapper;
+import google.registry.model.common.TimedTransitionProperty.TimedTransition;
+import google.registry.model.registry.label.PremiumList;
+import google.registry.model.registry.label.ReservedList;
+import google.registry.model.smd.SignedMarkRevocationList;
+import google.registry.persistence.VKey;
+import google.registry.schema.replay.DatastoreOnlyEntity;
+import java.util.Optional;
+import javax.annotation.concurrent.Immutable;
+import org.joda.time.DateTime;
+
+@Entity
+@Immutable
+public class DatabaseTransitionSchedule extends ImmutableObject implements DatastoreOnlyEntity {
+
+  /**
+   * The name of the database to be treated as the primary database. The first entry in the schedule
+   * will always be Datastore.
+   */
+  public enum PrimaryDatabase {
+    CLOUD_SQL,
+    DATASTORE
+  }
+
+  /** The id of the transition schedule. */
+  public enum TransitionId {
+    /** The schedule for the migration of {@link PremiumList} and {@link ReservedList}. */
+    DOMAIN_LABEL_LISTS,
+    /** The schedule for the migration of the {@link SignedMarkRevocationList} entity. */
+    SIGNED_MARK_REVOCATION_LIST,
+    /** The schedule for all asynchronously-replayed entities, ones not dually-written. */
+    REPLAYED_ENTITIES,
+  }
+
+  /**
+   * The transition to a specified primary database at a specific point in time, for use in a
+   * TimedTransitionProperty.
+   */
+  @Embed
+  public static class PrimaryDatabaseTransition extends TimedTransition<PrimaryDatabase> {
+    private PrimaryDatabase primaryDatabase;
+
+    @Override
+    protected PrimaryDatabase getValue() {
+      return primaryDatabase;
+    }
+
+    @Override
+    protected void setValue(PrimaryDatabase primaryDatabase) {
+      this.primaryDatabase = primaryDatabase;
+    }
+  }
+
+  @Parent Key<EntityGroupRoot> parent = getCrossTldKey();
+
+  @Id String transitionId;
+
+  /** An automatically managed timestamp of when this schedule was last written to Datastore. */
+  UpdateAutoTimestamp lastUpdateTime = UpdateAutoTimestamp.create(null);
+
+  /** A property that tracks the primary database for a dual-read/dual-write database migration. */
+  @Mapify(TimeMapper.class)
+  TimedTransitionProperty<PrimaryDatabase, PrimaryDatabaseTransition> databaseTransitions =
+      TimedTransitionProperty.forMapify(PrimaryDatabase.DATASTORE, PrimaryDatabaseTransition.class);
+
+  /** A cache that loads the {@link DatabaseTransitionSchedule} for a given id. */
+  private static final LoadingCache<TransitionId, Optional<DatabaseTransitionSchedule>> CACHE =
+      CacheBuilder.newBuilder()
+          .expireAfterWrite(
+              java.time.Duration.ofMillis(getSingletonCacheRefreshDuration().getMillis()))
+          .build(
+              new CacheLoader<TransitionId, Optional<DatabaseTransitionSchedule>>() {
+                @Override
+                public Optional<DatabaseTransitionSchedule> load(TransitionId transitionId) {
+                  return DatabaseTransitionSchedule.get(transitionId);
+                }
+              });
+
+  public static DatabaseTransitionSchedule create(
+      TransitionId transitionId,
+      TimedTransitionProperty<PrimaryDatabase, PrimaryDatabaseTransition> databaseTransitions) {
+    checkNotNull(transitionId, "Id cannot be null");
+    checkNotNull(databaseTransitions, "databaseTransitions cannot be null");
+    databaseTransitions.checkValidity();
+    DatabaseTransitionSchedule instance = new DatabaseTransitionSchedule();
+    instance.transitionId = transitionId.name();
+    instance.databaseTransitions = databaseTransitions;
+    return instance;
+  }
+
+  /** Returns the database that is indicated as primary at the given time. */
+  public PrimaryDatabase getPrimaryDatabase() {
+    return databaseTransitions.getValueAtTime(tm().getTransactionTime());
+  }
+
+  /** Returns the database transitions as a map of start time to primary database. */
+  public ImmutableSortedMap<DateTime, PrimaryDatabase> getDatabaseTransitions() {
+    return databaseTransitions.toValueMap();
+  }
+
+  /**
+   * Returns the current cached schedule for the given id.
+   *
+   * <p>WARNING: The schedule returned by this method could be up to 10 minutes out of date.
+   */
+  public static Optional<DatabaseTransitionSchedule> getCached(TransitionId id) {
+    return CACHE.getUnchecked(id);
+  }
+
+  /** Returns the schedule for a given id. */
+  public static Optional<DatabaseTransitionSchedule> get(TransitionId transitionId) {
+    VKey<DatabaseTransitionSchedule> key =
+        VKey.create(
+            DatabaseTransitionSchedule.class,
+            transitionId,
+            Key.create(getCrossTldKey(), DatabaseTransitionSchedule.class, transitionId.name()));
+
+    return ofyTm().transact(() -> ofyTm().loadByKeyIfPresent(key));
+  }
+
+  @Override
+  public String toString() {
+    return String.format(
+        "%s(last updated at %s): %s",
+        transitionId, lastUpdateTime.getTimestamp(), databaseTransitions.toValueMap());
+  }
+}
--- a/core/src/main/java/google/registry/model/domain/DomainContent.java
+++ b/core/src/main/java/google/registry/model/domain/DomainContent.java
@@ -337,6 +337,10 @@ public class DomainContent extends EppResource
        nullToEmptyImmutableCopy(dsData).stream()
            .map(dsData -> dsData.cloneWithDomainRepoId(getRepoId()))
            .collect(toImmutableSet());
+
+    if (transferData != null) {
+      transferData.convertVKeys();
+    }
  }

  @PostLoad
--- a/core/src/main/java/google/registry/model/ofy/EntityWritePriorities.java
+++ b/core/src/main/java/google/registry/model/ofy/EntityWritePriorities.java
@@ -41,9 +41,9 @@ public class EntityWritePriorities {
   */
  static final ImmutableMap<String, Integer> CLASS_PRIORITIES =
      ImmutableMap.of(
+          "ContactResource", -15,
          "HistoryEntry", -10,
          "AllocationToken", -9,
-          "ContactResource", 5,
          "DomainBase", 10);

  // The beginning of the range of priority numbers reserved for delete.  This must be greater than
--- a/core/src/main/java/google/registry/model/ofy/Ofy.java
+++ b/core/src/main/java/google/registry/model/ofy/Ofy.java
@@ -116,7 +116,7 @@ public class Ofy {
    return ofy().getTransaction() != null;
  }

-  void assertInTransaction() {
+  public void assertInTransaction() {
    checkState(inTransaction(), "Must be called in a transaction");
  }

--- a/core/src/main/java/google/registry/model/poll/PollMessage.java
+++ b/core/src/main/java/google/registry/model/poll/PollMessage.java
@@ -295,7 +295,7 @@ public abstract class PollMessage extends ImmutableObject
    @Transient @ImmutableObject.DoNotCompare
    List<DomainPendingActionNotificationResponse> domainPendingActionNotificationResponses;

-    @Transient List<DomainTransferResponse> domainTransferResponses;
+    @Transient @ImmutableObject.DoNotCompare List<DomainTransferResponse> domainTransferResponses;

    @Transient List<HostPendingActionNotificationResponse> hostPendingActionNotificationResponses;

@@ -406,17 +406,20 @@ public abstract class PollMessage extends ImmutableObject
                    pendingActionNotificationResponse.processedDate));
      }
      if (contactId != null && transferResponse != null) {
-        contactTransferResponses =
-            ImmutableList.of(
-                new ContactTransferResponse.Builder()
-                    .setContactId(contactId)
-                    .setGainingClientId(transferResponse.getGainingClientId())
-                    .setLosingClientId(transferResponse.getLosingClientId())
-                    .setTransferStatus(transferResponse.getTransferStatus())
-                    .setTransferRequestTime(transferResponse.getTransferRequestTime())
-                    .setPendingTransferExpirationTime(
-                        transferResponse.getPendingTransferExpirationTime())
-                    .build());
+        // The transferResponse is currently an unspecialized TransferResponse instance, create a
+        // ContactTransferResponse so that the value is consistently specialized and store it in the
+        // list representation for datastore.
+        transferResponse =
+            new ContactTransferResponse.Builder()
+                .setContactId(contactId)
+                .setGainingClientId(transferResponse.getGainingClientId())
+                .setLosingClientId(transferResponse.getLosingClientId())
+                .setTransferStatus(transferResponse.getTransferStatus())
+                .setTransferRequestTime(transferResponse.getTransferRequestTime())
+                .setPendingTransferExpirationTime(
+                    transferResponse.getPendingTransferExpirationTime())
+                .build();
+        contactTransferResponses = ImmutableList.of((ContactTransferResponse) transferResponse);
      }
    }

--- a/core/src/main/java/google/registry/model/pricing/StaticPremiumListPricingEngine.java
+++ b/core/src/main/java/google/registry/model/pricing/StaticPremiumListPricingEngine.java
@@ -15,11 +15,11 @@
 package google.registry.model.pricing;

 import static com.google.common.base.Preconditions.checkNotNull;
-import static google.registry.model.registry.label.PremiumListUtils.getPremiumPrice;
 import static google.registry.util.DomainNameUtils.getTldFromDomainName;

 import com.google.common.net.InternetDomainName;
 import google.registry.model.registry.Registry;
+import google.registry.model.registry.label.PremiumListDualDao;
 import java.util.Optional;
 import javax.inject.Inject;
 import org.joda.money.Money;
@@ -38,7 +38,7 @@ public final class StaticPremiumListPricingEngine implements PremiumPricingEngin
    String tld = getTldFromDomainName(fullyQualifiedDomainName);
    String label = InternetDomainName.from(fullyQualifiedDomainName).parts().get(0);
    Registry registry = Registry.get(checkNotNull(tld, "tld"));
-    Optional<Money> premiumPrice = getPremiumPrice(label, registry);
+    Optional<Money> premiumPrice = PremiumListDualDao.getPremiumPrice(label, registry);
    return DomainPrices.create(
        premiumPrice.isPresent(),
        premiumPrice.orElse(registry.getStandardCreateCost()),
--- a/core/src/main/java/google/registry/model/registrar/Registrar.java
+++ b/core/src/main/java/google/registry/model/registrar/Registrar.java
@@ -996,6 +996,13 @@ public class Registrar extends ImmutableObject
    return CACHE_BY_CLIENT_ID.get().values();
  }

+  /** Loads all registrar keys using an in-memory cache. */
+  public static ImmutableSet<VKey<Registrar>> loadAllKeysCached() {
+    return CACHE_BY_CLIENT_ID.get().keySet().stream()
+        .map(Registrar::createVKey)
+        .collect(toImmutableSet());
+  }
+
  /** Loads and returns a registrar entity by its client id directly from Datastore. */
  public static Optional<Registrar> loadByClientId(String clientId) {
    checkArgument(!Strings.isNullOrEmpty(clientId), "clientId must be specified");
--- a/core/src/main/java/google/registry/model/registry/label/PremiumList.java
+++ b/core/src/main/java/google/registry/model/registry/label/PremiumList.java
@@ -18,23 +18,12 @@ import static com.google.common.base.Charsets.US_ASCII;
 import static com.google.common.base.Preconditions.checkArgument;
 import static com.google.common.hash.Funnels.stringFunnel;
 import static com.google.common.hash.Funnels.unencodedCharsFunnel;
-import static google.registry.config.RegistryConfig.getDomainLabelListCacheDuration;
-import static google.registry.config.RegistryConfig.getSingletonCachePersistDuration;
-import static google.registry.config.RegistryConfig.getStaticPremiumListMaxCachedEntries;
-import static google.registry.model.common.EntityGroupRoot.getCrossTldKey;
 import static google.registry.model.ofy.ObjectifyService.allocateId;
-import static google.registry.model.ofy.ObjectifyService.ofy;
-import static google.registry.persistence.transaction.TransactionManagerFactory.tm;

 import com.google.common.annotations.VisibleForTesting;
 import com.google.common.base.Splitter;
-import com.google.common.cache.CacheBuilder;
-import com.google.common.cache.CacheLoader;
-import com.google.common.cache.CacheLoader.InvalidCacheLoadException;
-import com.google.common.cache.LoadingCache;
 import com.google.common.collect.ImmutableMap;
 import com.google.common.hash.BloomFilter;
-import com.google.common.util.concurrent.UncheckedExecutionException;
 import com.googlecode.objectify.Key;
 import com.googlecode.objectify.annotation.Entity;
 import com.googlecode.objectify.annotation.Id;
@@ -46,18 +35,14 @@ import google.registry.model.annotations.ReportedOn;
 import google.registry.model.registry.Registry;
 import google.registry.schema.replay.DatastoreOnlyEntity;
 import google.registry.schema.replay.NonReplicatedEntity;
-import google.registry.schema.tld.PremiumListDao;
-import google.registry.util.NonFinalForTesting;
+import google.registry.schema.tld.PremiumListSqlDao;
 import java.io.ByteArrayOutputStream;
 import java.io.IOException;
 import java.math.BigDecimal;
 import java.util.List;
 import java.util.Map;
-import java.util.NoSuchElementException;
 import java.util.Objects;
-import java.util.Optional;
 import java.util.Set;
-import java.util.concurrent.ExecutionException;
 import javax.annotation.Nullable;
 import javax.persistence.CollectionTable;
 import javax.persistence.Column;
@@ -72,7 +57,6 @@ import javax.persistence.Transient;
 import org.hibernate.LazyInitializationException;
 import org.joda.money.CurrencyUnit;
 import org.joda.money.Money;
-import org.joda.time.Duration;

 /**
 * A premium list entity that is used to check domain label prices.
@@ -171,124 +155,11 @@ public final class PremiumList extends BaseDomainLabelList<Money, PremiumList.Pr
    }
  }

-  /**
-   * In-memory cache for premium lists.
-   *
-   * <p>This is cached for a shorter duration because we need to periodically reload this entity to
-   * check if a new revision has been published, and if so, then use that.
-   */
-  @NonFinalForTesting
-  static LoadingCache<String, PremiumList> cachePremiumLists =
-      createCachePremiumLists(getDomainLabelListCacheDuration());
-
-  @VisibleForTesting
-  public static void setPremiumListCacheForTest(Optional<Duration> expiry) {
-    Duration effectiveExpiry = expiry.orElse(getDomainLabelListCacheDuration());
-    cachePremiumLists = createCachePremiumLists(effectiveExpiry);
-  }
-
-  @VisibleForTesting
-  static LoadingCache<String, PremiumList> createCachePremiumLists(Duration cachePersistDuration) {
-    return CacheBuilder.newBuilder()
-        .expireAfterWrite(java.time.Duration.ofMillis(cachePersistDuration.getMillis()))
-        .build(
-            new CacheLoader<String, PremiumList>() {
-              @Override
-              public PremiumList load(final String name) {
-                return tm().doTransactionless(() -> loadPremiumList(name));
-              }
-            });
-  }
-
-  private static PremiumList loadPremiumList(String name) {
-    return tm().isOfy()
-        ? ofy().load().type(PremiumList.class).parent(getCrossTldKey()).id(name).now()
-        : PremiumListDao.getLatestRevision(name).orElseThrow(NoSuchElementException::new);
-  }
-
-  /**
-   * In-memory cache for {@link PremiumListRevision}s, used for retrieving Bloom filters quickly.
-   *
-   * <p>This is cached for a long duration (essentially indefinitely) because a given {@link
-   * PremiumListRevision} is immutable and cannot ever be changed once created, so its cache need
-   * not ever expire.
-   */
-  static final LoadingCache<Key<PremiumListRevision>, PremiumListRevision>
-      cachePremiumListRevisions =
-          CacheBuilder.newBuilder()
-              .expireAfterWrite(
-                  java.time.Duration.ofMillis(getSingletonCachePersistDuration().getMillis()))
-              .build(
-                  new CacheLoader<Key<PremiumListRevision>, PremiumListRevision>() {
-                    @Override
-                    public PremiumListRevision load(final Key<PremiumListRevision> revisionKey) {
-                      return tm().doTransactionless(() -> ofy().load().key(revisionKey).now());
-                    }
-                  });
-
-  /**
-   * In-memory cache for {@link PremiumListEntry}s for a given label and {@link PremiumListRevision}
-   *
-   * <p>Because the PremiumList itself makes up part of the PremiumListRevision's key, this is
-   * specific to a given premium list. Premium list entries might not be present, as indicated by
-   * the Optional wrapper, and we want to cache that as well.
-   *
-   * <p>This is cached for a long duration (essentially indefinitely) because a given {@link
-   * PremiumListRevision} and its child {@link PremiumListEntry}s are immutable and cannot ever be
-   * changed once created, so the cache need not ever expire.
-   *
-   * <p>A maximum size is set here on the cache because it can potentially grow too big to fit in
-   * memory if there are a large number of distinct premium list entries being queried (both those
-   * that exist, as well as those that might exist according to the Bloom filter, must be cached).
-   * The entries judged least likely to be accessed again will be evicted first.
-   */
-  @NonFinalForTesting
-  static LoadingCache<Key<PremiumListEntry>, Optional<PremiumListEntry>> cachePremiumListEntries =
-      createCachePremiumListEntries(getSingletonCachePersistDuration());
-
-  @VisibleForTesting
-  public static void setPremiumListEntriesCacheForTest(Optional<Duration> expiry) {
-    Duration effectiveExpiry = expiry.orElse(getSingletonCachePersistDuration());
-    cachePremiumListEntries = createCachePremiumListEntries(effectiveExpiry);
-  }
-
-  @VisibleForTesting
-  static LoadingCache<Key<PremiumListEntry>, Optional<PremiumListEntry>>
-      createCachePremiumListEntries(Duration cachePersistDuration) {
-    return CacheBuilder.newBuilder()
-        .expireAfterWrite(java.time.Duration.ofMillis(cachePersistDuration.getMillis()))
-        .maximumSize(getStaticPremiumListMaxCachedEntries())
-        .build(
-            new CacheLoader<Key<PremiumListEntry>, Optional<PremiumListEntry>>() {
-              @Override
-              public Optional<PremiumListEntry> load(final Key<PremiumListEntry> entryKey) {
-                return tm().doTransactionless(
-                        () -> Optional.ofNullable(ofy().load().key(entryKey).now()));
-              }
-            });
-  }
-
  @VisibleForTesting
  public Key<PremiumListRevision> getRevisionKey() {
    return revisionKey;
  }

-  /** Returns the PremiumList with the specified name, from cache. */
-  public static Optional<PremiumList> getCached(String name) {
-    try {
-      return Optional.of(cachePremiumLists.get(name));
-    } catch (InvalidCacheLoadException e) {
-      return Optional.empty();
-    } catch (ExecutionException e) {
-      throw new UncheckedExecutionException("Could not retrieve premium list named " + name, e);
-    }
-  }
-
-  /** Returns the PremiumList with the specified name, uncached. */
-  public static Optional<PremiumList> getUncached(String name) {
-    return Optional.ofNullable(loadPremiumList(name));
-  }
-
  /** Returns the {@link CurrencyUnit} used for this list. */
  public CurrencyUnit getCurrency() {
    return currency;
@@ -300,7 +171,7 @@ public final class PremiumList extends BaseDomainLabelList<Money, PremiumList.Pr
   * <p>Note that this is lazily loaded and thus will throw a {@link LazyInitializationException} if
   * used outside the transaction in which the given entity was loaded. You generally should not be
   * using this anyway as it's inefficient to load all of the PremiumEntry rows if you don't need
-   * them. To check prices, use {@link PremiumListDao#getPremiumPrice} instead.
+   * them. To check prices, use {@link PremiumListSqlDao#getPremiumPrice} instead.
   */
  @Nullable
  public ImmutableMap<String, BigDecimal> getLabelsToPrices() {
@@ -337,6 +208,12 @@ public final class PremiumList extends BaseDomainLabelList<Money, PremiumList.Pr
      return price;
    }

+    @Override
+    public String toString() {
+      // Don't include the comment so that we can use this when exporting the premium list
+      return String.format("%s,%s", label, price);
+    }
+
    @Override
    public Builder asBuilder() {
      return new Builder(clone(this));
--- a/core/src/main/java/google/registry/model/registry/label/PremiumListDatastoreDao.java
+++ b/core/src/main/java/google/registry/model/registry/label/PremiumListDatastoreDao.java
@@ -0,0 +1,365 @@
+// Copyright 2021 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.model.registry.label;
+
+import static com.google.common.base.Preconditions.checkState;
+import static com.google.common.collect.ImmutableSet.toImmutableSet;
+import static com.google.common.collect.Iterables.partition;
+import static google.registry.config.RegistryConfig.getDomainLabelListCacheDuration;
+import static google.registry.config.RegistryConfig.getSingletonCachePersistDuration;
+import static google.registry.config.RegistryConfig.getStaticPremiumListMaxCachedEntries;
+import static google.registry.model.common.EntityGroupRoot.getCrossTldKey;
+import static google.registry.model.ofy.ObjectifyService.ofy;
+import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.BLOOM_FILTER_NEGATIVE;
+import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.CACHED_NEGATIVE;
+import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.CACHED_POSITIVE;
+import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.UNCACHED_NEGATIVE;
+import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.UNCACHED_POSITIVE;
+import static google.registry.persistence.transaction.TransactionManagerFactory.ofyTm;
+import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
+import static org.joda.time.DateTimeZone.UTC;
+
+import com.google.auto.value.AutoValue;
+import com.google.common.annotations.VisibleForTesting;
+import com.google.common.cache.CacheBuilder;
+import com.google.common.cache.CacheLoader;
+import com.google.common.cache.CacheLoader.InvalidCacheLoadException;
+import com.google.common.cache.LoadingCache;
+import com.google.common.collect.ImmutableMap;
+import com.google.common.collect.ImmutableSet;
+import com.google.common.collect.Streams;
+import com.googlecode.objectify.Key;
+import google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome;
+import google.registry.model.registry.label.PremiumList.PremiumListEntry;
+import google.registry.model.registry.label.PremiumList.PremiumListRevision;
+import google.registry.persistence.VKey;
+import google.registry.util.NonFinalForTesting;
+import java.util.List;
+import java.util.Objects;
+import java.util.Optional;
+import java.util.concurrent.ExecutionException;
+import org.joda.money.Money;
+import org.joda.time.DateTime;
+import org.joda.time.Duration;
+
+/**
+ * DAO for {@link PremiumList} objects stored in Datastore.
+ *
+ * <p>This class handles both the mapping from string to Datastore-level PremiumList objects as well
+ * as the mapping from PremiumList objects to the contents of those premium lists in the Datastore
+ * world. Specifically, this deals with retrieving the most recent revision for a given list and
+ * retrieving (or writing/deleting) all entries associated with that particular revision. The {@link
+ * PremiumList} object itself, in the Datastore world, does not store the premium pricing data.
+ */
+public class PremiumListDatastoreDao {
+
+  /** The number of premium list entry entities that are created and deleted per batch. */
+  private static final int TRANSACTION_BATCH_SIZE = 200;
+
+  /**
+   * In-memory cache for premium lists.
+   *
+   * <p>This is cached for a shorter duration because we need to periodically reload this entity to
+   * check if a new revision has been published, and if so, then use that.
+   *
+   * <p>We also cache the absence of premium lists with a given name to avoid unnecessary pointless
+   * lookups. Note that this cache is only applicable to PremiumList objects stored in Datastore.
+   */
+  @NonFinalForTesting
+  static LoadingCache<String, Optional<PremiumList>> premiumListCache =
+      createPremiumListCache(getDomainLabelListCacheDuration());
+
+  @VisibleForTesting
+  public static void setPremiumListCacheForTest(Optional<Duration> expiry) {
+    Duration effectiveExpiry = expiry.orElse(getSingletonCachePersistDuration());
+    premiumListCache = createPremiumListCache(effectiveExpiry);
+  }
+
+  @VisibleForTesting
+  public static LoadingCache<String, Optional<PremiumList>> createPremiumListCache(
+      Duration cachePersistDuration) {
+    return CacheBuilder.newBuilder()
+        .expireAfterWrite(java.time.Duration.ofMillis(cachePersistDuration.getMillis()))
+        .build(
+            new CacheLoader<String, Optional<PremiumList>>() {
+              @Override
+              public Optional<PremiumList> load(final String name) {
+                return tm().doTransactionless(() -> getLatestRevisionUncached(name));
+              }
+            });
+  }
+
+  /**
+   * In-memory cache for {@link PremiumListRevision}s, used for retrieving Bloom filters quickly.
+   *
+   * <p>This is cached for a long duration (essentially indefinitely) because a given {@link
+   * PremiumListRevision} is immutable and cannot ever be changed once created, so its cache need
+   * not ever expire.
+   */
+  static final LoadingCache<Key<PremiumListRevision>, PremiumListRevision>
+      premiumListRevisionsCache =
+          CacheBuilder.newBuilder()
+              .expireAfterWrite(
+                  java.time.Duration.ofMillis(getSingletonCachePersistDuration().getMillis()))
+              .build(
+                  new CacheLoader<Key<PremiumListRevision>, PremiumListRevision>() {
+                    @Override
+                    public PremiumListRevision load(final Key<PremiumListRevision> revisionKey) {
+                      return ofyTm().doTransactionless(() -> ofy().load().key(revisionKey).now());
+                    }
+                  });
+
+  /**
+   * In-memory cache for {@link PremiumListEntry}s for a given label and {@link PremiumListRevision}
+   *
+   * <p>Because the PremiumList itself makes up part of the PremiumListRevision's key, this is
+   * specific to a given premium list. Premium list entries might not be present, as indicated by
+   * the Optional wrapper, and we want to cache that as well.
+   *
+   * <p>This is cached for a long duration (essentially indefinitely) because a given {@link
+   * PremiumListRevision} and its child {@link PremiumListEntry}s are immutable and cannot ever be
+   * changed once created, so the cache need not ever expire.
+   *
+   * <p>A maximum size is set here on the cache because it can potentially grow too big to fit in
+   * memory if there are a large number of distinct premium list entries being queried (both those
+   * that exist, as well as those that might exist according to the Bloom filter, must be cached).
+   * The entries judged least likely to be accessed again will be evicted first.
+   */
+  @NonFinalForTesting
+  static LoadingCache<Key<PremiumListEntry>, Optional<PremiumListEntry>> premiumListEntriesCache =
+      createPremiumListEntriesCache(getSingletonCachePersistDuration());
+
+  @VisibleForTesting
+  public static void setPremiumListEntriesCacheForTest(Optional<Duration> expiry) {
+    Duration effectiveExpiry = expiry.orElse(getSingletonCachePersistDuration());
+    premiumListEntriesCache = createPremiumListEntriesCache(effectiveExpiry);
+  }
+
+  @VisibleForTesting
+  static LoadingCache<Key<PremiumListEntry>, Optional<PremiumListEntry>>
+      createPremiumListEntriesCache(Duration cachePersistDuration) {
+    return CacheBuilder.newBuilder()
+        .expireAfterWrite(java.time.Duration.ofMillis(cachePersistDuration.getMillis()))
+        .maximumSize(getStaticPremiumListMaxCachedEntries())
+        .build(
+            new CacheLoader<Key<PremiumListEntry>, Optional<PremiumListEntry>>() {
+              @Override
+              public Optional<PremiumListEntry> load(final Key<PremiumListEntry> entryKey) {
+                return ofyTm()
+                    .doTransactionless(() -> Optional.ofNullable(ofy().load().key(entryKey).now()));
+              }
+            });
+  }
+
+  public static Optional<PremiumList> getLatestRevision(String name) {
+    return premiumListCache.getUnchecked(name);
+  }
+
+  /**
+   * Returns the premium price for the specified list, label, and TLD, or absent if the label is not
+   * premium.
+   */
+  public static Optional<Money> getPremiumPrice(String premiumListName, String label, String tld) {
+    DateTime startTime = DateTime.now(UTC);
+    Optional<PremiumList> maybePremumList = getLatestRevision(premiumListName);
+    if (!maybePremumList.isPresent()) {
+      return Optional.empty();
+    }
+    PremiumList premiumList = maybePremumList.get();
+    // If we're dealing with a list from SQL, reload from Datastore if necessary
+    if (premiumList.getRevisionKey() == null) {
+      Optional<PremiumList> fromDatastore = getLatestRevision(premiumList.getName());
+      if (fromDatastore.isPresent()) {
+        premiumList = fromDatastore.get();
+      } else {
+        return Optional.empty();
+      }
+    }
+    PremiumListRevision revision;
+    try {
+      revision = premiumListRevisionsCache.get(premiumList.getRevisionKey());
+    } catch (InvalidCacheLoadException | ExecutionException e) {
+      throw new RuntimeException(
+          "Could not load premium list revision " + premiumList.getRevisionKey(), e);
+    }
+    checkState(
+        revision.getProbablePremiumLabels() != null,
+        "Probable premium labels Bloom filter is null on revision '%s'",
+        premiumList.getRevisionKey());
+
+    CheckResults checkResults = checkStatus(revision, label);
+    DomainLabelMetrics.recordPremiumListCheckOutcome(
+        tld,
+        premiumList.getName(),
+        checkResults.checkOutcome(),
+        DateTime.now(UTC).getMillis() - startTime.getMillis());
+
+    return checkResults.premiumPrice();
+  }
+
+  /**
+   * Persists a new or updated PremiumList object and its descendant entities to Datastore.
+   *
+   * <p>The flow here is: save the new premium list entries parented on that revision entity,
+   * save/update the PremiumList, and then delete the old premium list entries associated with the
+   * old revision.
+   *
+   * <p>This is the only valid way to save these kinds of entities!
+   */
+  public static PremiumList save(String name, List<String> inputData) {
+    PremiumList premiumList = new PremiumList.Builder().setName(name).build();
+    ImmutableMap<String, PremiumListEntry> premiumListEntries = premiumList.parse(inputData);
+    final Optional<PremiumList> oldPremiumList = getLatestRevisionUncached(premiumList.getName());
+
+    // Create the new revision (with its Bloom filter) and parent the entries on it.
+    final PremiumListRevision newRevision =
+        PremiumListRevision.create(premiumList, premiumListEntries.keySet());
+    final Key<PremiumListRevision> newRevisionKey = Key.create(newRevision);
+    ImmutableSet<PremiumListEntry> parentedEntries =
+        parentPremiumListEntriesOnRevision(premiumListEntries.values(), newRevisionKey);
+
+    // Save the new child entities in a series of transactions.
+    for (final List<PremiumListEntry> batch : partition(parentedEntries, TRANSACTION_BATCH_SIZE)) {
+      ofyTm().transactNew(() -> ofy().save().entities(batch));
+    }
+
+    // Save the new PremiumList and revision itself.
+    return ofyTm()
+        .transactNew(
+            () -> {
+              DateTime now = ofyTm().getTransactionTime();
+              // Assert that the premium list hasn't been changed since we started this process.
+              Key<PremiumList> key =
+                  Key.create(getCrossTldKey(), PremiumList.class, premiumList.getName());
+              Optional<PremiumList> existing =
+                  ofyTm().loadByKeyIfPresent(VKey.createOfy(PremiumList.class, key));
+              checkOfyFieldsEqual(existing, oldPremiumList);
+              PremiumList newList =
+                  premiumList
+                      .asBuilder()
+                      .setLastUpdateTime(now)
+                      .setCreationTime(
+                          oldPremiumList.isPresent() ? oldPremiumList.get().creationTime : now)
+                      .setRevision(newRevisionKey)
+                      .build();
+              ofy().save().entities(newList, newRevision);
+              premiumListCache.invalidate(premiumList.getName());
+              return newList;
+            });
+  }
+
+  public static void delete(PremiumList premiumList) {
+    ofyTm().transactNew(() -> ofy().delete().entity(premiumList));
+    if (premiumList.getRevisionKey() == null) {
+      return;
+    }
+    for (final List<Key<PremiumListEntry>> batch :
+        partition(
+            ofy().load().type(PremiumListEntry.class).ancestor(premiumList.revisionKey).keys(),
+            TRANSACTION_BATCH_SIZE)) {
+      ofyTm().transactNew(() -> ofy().delete().keys(batch));
+      batch.forEach(premiumListEntriesCache::invalidate);
+    }
+    ofyTm().transactNew(() -> ofy().delete().key(premiumList.getRevisionKey()));
+    premiumListCache.invalidate(premiumList.getName());
+    premiumListRevisionsCache.invalidate(premiumList.getRevisionKey());
+  }
+
+  /** Re-parents the given {@link PremiumListEntry}s on the given {@link PremiumListRevision}. */
+  @VisibleForTesting
+  public static ImmutableSet<PremiumListEntry> parentPremiumListEntriesOnRevision(
+      Iterable<PremiumListEntry> entries, final Key<PremiumListRevision> revisionKey) {
+    return Streams.stream(entries)
+        .map((PremiumListEntry entry) -> entry.asBuilder().setParent(revisionKey).build())
+        .collect(toImmutableSet());
+  }
+
+  /**
+   * Returns all {@link PremiumListEntry PremiumListEntries} in the given {@code premiumList}.
+   *
+   * <p>This is an expensive operation and should only be used when the entire list is required.
+   */
+  public static Iterable<PremiumListEntry> loadPremiumListEntriesUncached(PremiumList premiumList) {
+    return ofy().load().type(PremiumListEntry.class).ancestor(premiumList.revisionKey).iterable();
+  }
+
+  private static Optional<PremiumList> getLatestRevisionUncached(String name) {
+    return Optional.ofNullable(
+        ofy().load().key(Key.create(getCrossTldKey(), PremiumList.class, name)).now());
+  }
+
+  private static void checkOfyFieldsEqual(
+      Optional<PremiumList> oneOptional, Optional<PremiumList> twoOptional) {
+    if (!oneOptional.isPresent()) {
+      checkState(!twoOptional.isPresent(), "Premium list concurrently deleted");
+      return;
+    } else {
+      checkState(twoOptional.isPresent(), "Premium list concurrently deleted");
+    }
+    PremiumList one = oneOptional.get();
+    PremiumList two = twoOptional.get();
+    checkState(
+        Objects.equals(one.revisionKey, two.revisionKey),
+        "Premium list revision key concurrently edited");
+    checkState(Objects.equals(one.name, two.name), "Premium list name concurrently edited");
+    checkState(Objects.equals(one.parent, two.parent), "Premium list parent concurrently edited");
+    checkState(
+        Objects.equals(one.creationTime, two.creationTime),
+        "Premium list creation time concurrently edited");
+  }
+
+  private static CheckResults checkStatus(PremiumListRevision premiumListRevision, String label) {
+    if (!premiumListRevision.getProbablePremiumLabels().mightContain(label)) {
+      return CheckResults.create(BLOOM_FILTER_NEGATIVE, Optional.empty());
+    }
+
+    Key<PremiumListEntry> entryKey =
+        Key.create(Key.create(premiumListRevision), PremiumListEntry.class, label);
+    try {
+      // getIfPresent() returns null if the key is not in the cache
+      Optional<PremiumListEntry> entry = premiumListEntriesCache.getIfPresent(entryKey);
+      if (entry != null) {
+        if (entry.isPresent()) {
+          return CheckResults.create(CACHED_POSITIVE, Optional.of(entry.get().getValue()));
+        } else {
+          return CheckResults.create(CACHED_NEGATIVE, Optional.empty());
+        }
+      }
+
+      entry = premiumListEntriesCache.get(entryKey);
+      if (entry.isPresent()) {
+        return CheckResults.create(UNCACHED_POSITIVE, Optional.of(entry.get().getValue()));
+      } else {
+        return CheckResults.create(UNCACHED_NEGATIVE, Optional.empty());
+      }
+    } catch (InvalidCacheLoadException | ExecutionException e) {
+      throw new RuntimeException("Could not load premium list entry " + entryKey, e);
+    }
+  }
+
+  /** Value type class used by {@link #checkStatus} to return the results of a premiumness check. */
+  @AutoValue
+  abstract static class CheckResults {
+    static CheckResults create(PremiumListCheckOutcome checkOutcome, Optional<Money> premiumPrice) {
+      return new AutoValue_PremiumListDatastoreDao_CheckResults(checkOutcome, premiumPrice);
+    }
+
+    abstract PremiumListCheckOutcome checkOutcome();
+
+    abstract Optional<Money> premiumPrice();
+  }
+
+  private PremiumListDatastoreDao() {}
+}
--- a/core/src/main/java/google/registry/model/registry/label/PremiumListDualDao.java
+++ b/core/src/main/java/google/registry/model/registry/label/PremiumListDualDao.java
@@ -0,0 +1,199 @@
+// Copyright 2021 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.model.registry.label;
+
+import static com.google.common.collect.ImmutableList.toImmutableList;
+import static google.registry.model.DatabaseMigrationUtils.suppressExceptionUnlessInTest;
+import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
+
+import com.google.common.collect.Streams;
+import google.registry.model.registry.Registry;
+import google.registry.model.registry.label.PremiumList.PremiumListEntry;
+import google.registry.schema.tld.PremiumListSqlDao;
+import java.util.List;
+import java.util.Optional;
+import org.joda.money.CurrencyUnit;
+import org.joda.money.Money;
+
+/**
+ * DAO for {@link PremiumList} objects that handles the branching paths for SQL and Datastore.
+ *
+ * <p>For write actions, this class will perform the action against the primary database then, after
+ * that success or failure, against the secondary database. If the secondary database fails, an
+ * error is logged (but not thrown).
+ *
+ * <p>For read actions, when retrieving a price, we will log if the primary and secondary databases
+ * have different values (or if the retrieval from the second database fails).
+ *
+ * <p>TODO (gbrodman): Change the isOfy() calls to the runtime selection of DBs when available
+ */
+public class PremiumListDualDao {
+
+  /**
+   * Retrieves from the appropriate DB and returns the most recent premium list with the given name,
+   * or absent if no such list exists.
+   */
+  public static Optional<PremiumList> getLatestRevision(String premiumListName) {
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      return PremiumListDatastoreDao.getLatestRevision(premiumListName);
+    } else {
+      return PremiumListSqlDao.getLatestRevision(premiumListName);
+    }
+  }
+
+  /**
+   * Returns the premium price for the specified label and registry.
+   *
+   * <p>Returns absent if the label is not premium or there is no premium list for this registry.
+   *
+   * <p>Retrieves the price from both primary and secondary databases, and logs in the event of a
+   * failure in the secondary (but does not throw an exception).
+   */
+  public static Optional<Money> getPremiumPrice(String label, Registry registry) {
+    if (registry.getPremiumList() == null) {
+      return Optional.empty();
+    }
+    String premiumListName = registry.getPremiumList().getName();
+    Optional<Money> primaryResult;
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      primaryResult =
+          PremiumListDatastoreDao.getPremiumPrice(premiumListName, label, registry.getTldStr());
+    } else {
+      primaryResult = PremiumListSqlDao.getPremiumPrice(premiumListName, label);
+    }
+    // Also load the value from the secondary DB, compare the two results, and log if different.
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      suppressExceptionUnlessInTest(
+          () -> {
+            Optional<Money> secondaryResult =
+                PremiumListSqlDao.getPremiumPrice(premiumListName, label);
+            if (!primaryResult.equals(secondaryResult)) {
+              throw new IllegalStateException(
+                  String.format(
+                      "Unequal prices for domain %s.%s from primary Datastore DB (%s) and "
+                          + "secondary SQL db (%s).",
+                      label, registry.getTldStr(), primaryResult, secondaryResult));
+            }
+          },
+          String.format(
+              "Error loading price of domain %s.%s from Cloud SQL.", label, registry.getTldStr()));
+    } else {
+      suppressExceptionUnlessInTest(
+          () -> {
+            Optional<Money> secondaryResult =
+                PremiumListDatastoreDao.getPremiumPrice(
+                    premiumListName, label, registry.getTldStr());
+            if (!primaryResult.equals(secondaryResult)) {
+              throw new IllegalStateException(
+                  String.format(
+                      "Unequal prices for domain %s.%s from primary SQL DB (%s) and secondary "
+                          + "Datastore db (%s).",
+                      label, registry.getTldStr(), primaryResult, secondaryResult));
+            }
+          },
+          String.format(
+              "Error loading price of domain %s.%s from Datastore.", label, registry.getTldStr()));
+    }
+    return primaryResult;
+  }
+
+  /**
+   * Saves the given list data to both primary and secondary databases.
+   *
+   * <p>Logs but doesn't throw an exception in the event of a failure when writing to the secondary
+   * database.
+   */
+  public static PremiumList save(String name, List<String> inputData) {
+    PremiumList result;
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      result = PremiumListDatastoreDao.save(name, inputData);
+      suppressExceptionUnlessInTest(
+          () -> PremiumListSqlDao.save(name, inputData), "Error when saving premium list to SQL.");
+    } else {
+      result = PremiumListSqlDao.save(name, inputData);
+      suppressExceptionUnlessInTest(
+          () -> PremiumListDatastoreDao.save(name, inputData),
+          "Error when saving premium list to Datastore.");
+    }
+    return result;
+  }
+
+  /**
+   * Deletes the premium list.
+   *
+   * <p>Logs but doesn't throw an exception in the event of a failure when deleting from the
+   * secondary database.
+   */
+  public static void delete(PremiumList premiumList) {
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      PremiumListDatastoreDao.delete(premiumList);
+      suppressExceptionUnlessInTest(
+          () -> PremiumListSqlDao.delete(premiumList),
+          "Error when deleting premium list from SQL.");
+    } else {
+      PremiumListSqlDao.delete(premiumList);
+      suppressExceptionUnlessInTest(
+          () -> PremiumListDatastoreDao.delete(premiumList),
+          "Error when deleting premium list from Datastore.");
+    }
+  }
+
+  /** Returns whether or not there exists a premium list with the given name. */
+  public static boolean exists(String premiumListName) {
+    // It may seem like overkill, but loading the list has ways been the way we check existence and
+    // given that we usually load the list around the time we check existence, we'll hit the cache
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      return PremiumListDatastoreDao.getLatestRevision(premiumListName).isPresent();
+    } else {
+      return PremiumListSqlDao.getLatestRevision(premiumListName).isPresent();
+    }
+  }
+
+  /**
+   * Returns all {@link PremiumListEntry PremiumListEntries} in the list with the given name.
+   *
+   * <p>This is an expensive operation and should only be used when the entire list is required.
+   */
+  public static Iterable<PremiumListEntry> loadAllPremiumListEntries(String premiumListName) {
+    PremiumList premiumList =
+        getLatestRevision(premiumListName)
+            .orElseThrow(
+                () ->
+                    new IllegalArgumentException(
+                        String.format("No premium list with name %s.", premiumListName)));
+    // TODO(gbrodman): Use Sarah's DB scheduler instead of this isOfy check
+    if (tm().isOfy()) {
+      return PremiumListDatastoreDao.loadPremiumListEntriesUncached(premiumList);
+    } else {
+      CurrencyUnit currencyUnit = premiumList.getCurrency();
+      return Streams.stream(PremiumListSqlDao.loadPremiumListEntriesUncached(premiumList))
+          .map(
+              premiumEntry ->
+                  new PremiumListEntry.Builder()
+                      .setPrice(Money.of(currencyUnit, premiumEntry.getPrice()))
+                      .setLabel(premiumEntry.getDomainLabel())
+                      .build())
+          .collect(toImmutableList());
+    }
+  }
+
+  private PremiumListDualDao() {}
+}
--- a/core/src/main/java/google/registry/model/registry/label/PremiumListUtils.java
+++ b/core/src/main/java/google/registry/model/registry/label/PremiumListUtils.java
@@ -1,255 +0,0 @@
-// Copyright 2017 The Nomulus Authors. All Rights Reserved.
-//
-// Licensed under the Apache License, Version 2.0 (the "License");
-// you may not use this file except in compliance with the License.
-// You may obtain a copy of the License at
-//
-//     http://www.apache.org/licenses/LICENSE-2.0
-//
-// Unless required by applicable law or agreed to in writing, software
-// distributed under the License is distributed on an "AS IS" BASIS,
-// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-// See the License for the specific language governing permissions and
-// limitations under the License.
-
-package google.registry.model.registry.label;
-
-import static com.google.common.base.Preconditions.checkState;
-import static com.google.common.collect.ImmutableSet.toImmutableSet;
-import static com.google.common.collect.Iterables.partition;
-import static google.registry.model.common.EntityGroupRoot.getCrossTldKey;
-import static google.registry.model.ofy.ObjectifyService.ofy;
-import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.BLOOM_FILTER_NEGATIVE;
-import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.CACHED_NEGATIVE;
-import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.CACHED_POSITIVE;
-import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.UNCACHED_NEGATIVE;
-import static google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome.UNCACHED_POSITIVE;
-import static google.registry.model.registry.label.PremiumList.cachePremiumListEntries;
-import static google.registry.model.registry.label.PremiumList.cachePremiumListRevisions;
-import static google.registry.model.registry.label.PremiumList.cachePremiumLists;
-import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
-import static org.joda.time.DateTimeZone.UTC;
-
-import com.google.auto.value.AutoValue;
-import com.google.common.annotations.VisibleForTesting;
-import com.google.common.cache.CacheLoader.InvalidCacheLoadException;
-import com.google.common.collect.ImmutableMap;
-import com.google.common.collect.ImmutableSet;
-import com.google.common.collect.Streams;
-import com.google.common.flogger.FluentLogger;
-import com.googlecode.objectify.Key;
-import google.registry.model.registry.Registry;
-import google.registry.model.registry.label.DomainLabelMetrics.PremiumListCheckOutcome;
-import google.registry.model.registry.label.PremiumList.PremiumListEntry;
-import google.registry.model.registry.label.PremiumList.PremiumListRevision;
-import google.registry.schema.tld.PremiumListDao;
-import java.util.List;
-import java.util.Objects;
-import java.util.Optional;
-import java.util.concurrent.ExecutionException;
-import org.joda.money.Money;
-import org.joda.time.DateTime;
-
-/** Static helper methods for working with {@link PremiumList}s. */
-public final class PremiumListUtils {
-
-  /** The number of premium list entry entities that are created and deleted per batch. */
-  private static final int TRANSACTION_BATCH_SIZE = 200;
-
-  private static final FluentLogger logger = FluentLogger.forEnclosingClass();
-
-  /** Value type class used by {@link #checkStatus} to return the results of a premiumness check. */
-  @AutoValue
-  abstract static class CheckResults {
-    static CheckResults create(PremiumListCheckOutcome checkOutcome, Optional<Money> premiumPrice) {
-      return new AutoValue_PremiumListUtils_CheckResults(checkOutcome, premiumPrice);
-    }
-
-    abstract PremiumListCheckOutcome checkOutcome();
-    abstract Optional<Money> premiumPrice();
-  }
-
-  /**
-   * Returns the premium price for the specified label and registry, or absent if the label is not
-   * premium.
-   */
-  public static Optional<Money> getPremiumPrice(String label, Registry registry) {
-    // If the registry has no configured premium list, then no labels are premium.
-    if (registry.getPremiumList() == null) {
-      return Optional.empty();
-    }
-    DateTime startTime = DateTime.now(UTC);
-    String listName = registry.getPremiumList().getName();
-    Optional<PremiumList> optionalPremiumList = PremiumList.getCached(listName);
-    checkState(optionalPremiumList.isPresent(), "Could not load premium list '%s'", listName);
-    PremiumList premiumList = optionalPremiumList.get();
-    PremiumListRevision revision;
-    try {
-      revision = cachePremiumListRevisions.get(premiumList.getRevisionKey());
-    } catch (InvalidCacheLoadException | ExecutionException e) {
-      throw new RuntimeException(
-          "Could not load premium list revision " + premiumList.getRevisionKey(), e);
-    }
-    checkState(
-        revision.getProbablePremiumLabels() != null,
-        "Probable premium labels Bloom filter is null on revision '%s'",
-        premiumList.getRevisionKey());
-
-    CheckResults checkResults = checkStatus(revision, label);
-    DomainLabelMetrics.recordPremiumListCheckOutcome(
-        registry.getTldStr(),
-        listName,
-        checkResults.checkOutcome(),
-        DateTime.now(UTC).getMillis() - startTime.getMillis());
-
-    // Also load the value from Cloud SQL, compare the two results, and log if different.
-    try {
-      Optional<Money> priceFromSql = PremiumListDao.getPremiumPrice(label, registry);
-      if (!priceFromSql.equals(checkResults.premiumPrice())) {
-        logger.atWarning().log(
-            "Unequal prices for domain %s.%s from Datastore (%s) and Cloud SQL (%s).",
-            label, registry.getTldStr(), checkResults.premiumPrice(), priceFromSql);
-      }
-    } catch (Throwable t) {
-      logger.atSevere().withCause(t).log(
-          "Error loading price of domain %s.%s from Cloud SQL.", label, registry.getTldStr());
-    }
-    return checkResults.premiumPrice();
-  }
-
-  private static CheckResults checkStatus(PremiumListRevision premiumListRevision, String label) {
-    if (!premiumListRevision.getProbablePremiumLabels().mightContain(label)) {
-      return CheckResults.create(BLOOM_FILTER_NEGATIVE, Optional.empty());
-    }
-
-    Key<PremiumListEntry> entryKey =
-        Key.create(Key.create(premiumListRevision), PremiumListEntry.class, label);
-    try {
-      // getIfPresent() returns null if the key is not in the cache
-      Optional<PremiumListEntry> entry = cachePremiumListEntries.getIfPresent(entryKey);
-      if (entry != null) {
-        if (entry.isPresent()) {
-          return CheckResults.create(CACHED_POSITIVE, Optional.of(entry.get().getValue()));
-        } else {
-          return CheckResults.create(CACHED_NEGATIVE, Optional.empty());
-        }
-      }
-
-      entry = cachePremiumListEntries.get(entryKey);
-      if (entry.isPresent()) {
-        return CheckResults.create(UNCACHED_POSITIVE, Optional.of(entry.get().getValue()));
-      } else {
-        return CheckResults.create(UNCACHED_NEGATIVE, Optional.empty());
-      }
-    } catch (InvalidCacheLoadException | ExecutionException e) {
-      throw new RuntimeException("Could not load premium list entry " + entryKey, e);
-    }
-  }
-
-  /**
-   * Persists a new or updated PremiumList object and its descendant entities to Datastore.
-   *
-   * <p>The flow here is: save the new premium list entries parented on that revision entity,
-   * save/update the PremiumList, and then delete the old premium list entries associated with the
-   * old revision.
-   *
-   * <p>This is the only valid way to save these kinds of entities!
-   */
-  public static PremiumList savePremiumListAndEntries(
-      final PremiumList premiumList,
-      ImmutableMap<String, PremiumListEntry> premiumListEntries) {
-    final Optional<PremiumList> oldPremiumList = PremiumList.getUncached(premiumList.getName());
-
-    // Create the new revision (with its Bloom filter) and parent the entries on it.
-    final PremiumListRevision newRevision =
-        PremiumListRevision.create(premiumList, premiumListEntries.keySet());
-    final Key<PremiumListRevision> newRevisionKey = Key.create(newRevision);
-    ImmutableSet<PremiumListEntry> parentedEntries =
-        parentPremiumListEntriesOnRevision(premiumListEntries.values(), newRevisionKey);
-
-    // Save the new child entities in a series of transactions.
-    for (final List<PremiumListEntry> batch : partition(parentedEntries, TRANSACTION_BATCH_SIZE)) {
-      tm().transactNew(() -> ofy().save().entities(batch));
-    }
-
-    // Save the new PremiumList and revision itself.
-    PremiumList updated = tm().transactNew(() -> {
-      DateTime now = tm().getTransactionTime();
-      // Assert that the premium list hasn't been changed since we started this process.
-      PremiumList existing = ofy().load()
-          .type(PremiumList.class)
-          .parent(getCrossTldKey())
-          .id(premiumList.getName())
-          .now();
-      checkState(
-          Objects.equals(existing, oldPremiumList.orElse(null)),
-          "PremiumList was concurrently edited");
-      PremiumList newList = premiumList.asBuilder()
-          .setLastUpdateTime(now)
-          .setCreationTime(oldPremiumList.isPresent() ? oldPremiumList.get().creationTime : now)
-          .setRevision(newRevisionKey)
-          .build();
-      ofy().save().entities(newList, newRevision);
-      return newList;
-    });
-
-    // Invalidate the cache on this premium list so the change will take effect instantly. This only
-    // clears the cache on the same instance that the update was run on, which will typically be the
-    // only tools instance.
-    PremiumList.cachePremiumLists.invalidate(premiumList.getName());
-
-    // TODO(b/79888775): Enqueue the oldPremiumList for deletion after at least
-    // RegistryConfig.getDomainLabelListCacheDuration() has elapsed.
-    return updated;
-  }
-
-  public static PremiumList savePremiumListAndEntries(
-      PremiumList premiumList, Iterable<String> premiumListLines) {
-    return savePremiumListAndEntries(premiumList, premiumList.parse(premiumListLines));
-  }
-
-  /** Re-parents the given {@link PremiumListEntry}s on the given {@link PremiumListRevision}. */
-  @VisibleForTesting
-  public static ImmutableSet<PremiumListEntry> parentPremiumListEntriesOnRevision(
-      Iterable<PremiumListEntry> entries, final Key<PremiumListRevision> revisionKey) {
-    return Streams.stream(entries)
-        .map((PremiumListEntry entry) -> entry.asBuilder().setParent(revisionKey).build())
-        .collect(toImmutableSet());
-  }
-
-  /** Deletes the PremiumList and all of its child entities. */
-  public static void deletePremiumList(final PremiumList premiumList) {
-    tm().transactNew(() -> ofy().delete().entity(premiumList));
-    deleteRevisionAndEntriesOfPremiumList(premiumList);
-    cachePremiumLists.invalidate(premiumList.getName());
-  }
-
-  static void deleteRevisionAndEntriesOfPremiumList(final PremiumList premiumList) {
-    if (premiumList.getRevisionKey() == null) {
-      return;
-    }
-    for (final List<Key<PremiumListEntry>> batch :
-        partition(
-            ofy().load().type(PremiumListEntry.class).ancestor(premiumList.revisionKey).keys(),
-            TRANSACTION_BATCH_SIZE)) {
-      tm().transactNew(() -> ofy().delete().keys(batch));
-    }
-    tm().transactNew(() -> ofy().delete().key(premiumList.getRevisionKey()));
-  }
-
-  /**
-   * Returns all {@link PremiumListEntry PremiumListEntries} in the given {@code premiumList}.
-   *
-   * <p>This is an expensive operation and should only be used when the entire list is required.
-   */
-  public static Iterable<PremiumListEntry> loadPremiumListEntries(PremiumList premiumList) {
-    return ofy().load().type(PremiumListEntry.class).ancestor(premiumList.revisionKey).iterable();
-  }
-
-  /** Returns whether a PremiumList of the given name exists, bypassing the cache. */
-  public static boolean doesPremiumListExist(String name) {
-    return ofy().load().key(Key.create(getCrossTldKey(), PremiumList.class, name)).now() != null;
-  }
-
-  private PremiumListUtils() {}
-}
--- a/core/src/main/java/google/registry/model/smd/SignedMarkRevocationList.java
+++ b/core/src/main/java/google/registry/model/smd/SignedMarkRevocationList.java
@@ -15,24 +15,13 @@
 package google.registry.model.smd;

 import static com.google.common.base.Preconditions.checkNotNull;
-import static com.google.common.base.Preconditions.checkState;
-import static com.google.common.collect.ImmutableList.toImmutableList;
-import static com.google.common.collect.Iterables.isEmpty;
 import static google.registry.model.CacheUtils.memoizeWithShortExpiration;
-import static google.registry.model.DatabaseMigrationUtils.suppressExceptionUnlessInTest;
 import static google.registry.model.common.EntityGroupRoot.getCrossTldKey;
-import static google.registry.model.ofy.ObjectifyService.allocateId;
-import static google.registry.model.ofy.ObjectifyService.ofy;
-import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
-import static google.registry.util.DateTimeUtils.START_OF_TIME;
 import static google.registry.util.DateTimeUtils.isBeforeOrAt;

 import com.google.common.annotations.VisibleForTesting;
 import com.google.common.base.Supplier;
 import com.google.common.collect.ImmutableMap;
-import com.google.common.collect.Iterables;
-import com.google.common.collect.MapDifference;
-import com.google.common.collect.Maps;
 import com.googlecode.objectify.Key;
 import com.googlecode.objectify.annotation.EmbedMap;
 import com.googlecode.objectify.annotation.Entity;
@@ -45,9 +34,7 @@ import google.registry.model.annotations.NotBackedUp;
 import google.registry.model.annotations.NotBackedUp.Reason;
 import google.registry.model.common.EntityGroupRoot;
 import google.registry.schema.replay.NonReplicatedEntity;
-import google.registry.util.CollectionUtils;
 import java.util.Map;
-import java.util.Optional;
 import javax.persistence.CollectionTable;
 import javax.persistence.Column;
 import javax.persistence.ElementCollection;
@@ -116,16 +103,7 @@ public class SignedMarkRevocationList extends ImmutableObject implements NonRepl
   * single {@link SignedMarkRevocationList} object.
   */
  private static final Supplier<SignedMarkRevocationList> CACHE =
-      memoizeWithShortExpiration(
-          () -> {
-            SignedMarkRevocationList datastoreList = loadFromDatastore();
-            suppressExceptionUnlessInTest(
-                () -> {
-                  loadAndCompareCloudSqlList(datastoreList);
-                },
-                "Error comparing signed mark revocation lists.");
-            return datastoreList;
-          });
+      memoizeWithShortExpiration(SignedMarkRevocationListDao::load);

  /** Return a single logical instance that combines all Datastore shards. */
  public static SignedMarkRevocationList get() {
@@ -159,98 +137,10 @@ public class SignedMarkRevocationList extends ImmutableObject implements NonRepl

  /** Save this list to Datastore in sharded form and to Cloud SQL. Returns {@code this}. */
  public SignedMarkRevocationList save() {
-    saveToDatastore();
-    SignedMarkRevocationListDao.trySave(this);
+    SignedMarkRevocationListDao.save(this);
    return this;
  }

-  /** Loads the shards from Datastore and combines them into one list. */
-  private static SignedMarkRevocationList loadFromDatastore() {
-    return tm().transactNewReadOnly(
-            () -> {
-              Iterable<SignedMarkRevocationList> shards =
-                  ofy().load().type(SignedMarkRevocationList.class).ancestor(getCrossTldKey());
-              DateTime creationTime =
-                  isEmpty(shards)
-                      ? START_OF_TIME
-                      : checkNotNull(Iterables.get(shards, 0).creationTime, "creationTime");
-              ImmutableMap.Builder<String, DateTime> revokes = new ImmutableMap.Builder<>();
-              for (SignedMarkRevocationList shard : shards) {
-                revokes.putAll(shard.revokes);
-                checkState(
-                    creationTime.equals(shard.creationTime),
-                    "Inconsistent creation times: %s vs. %s",
-                    creationTime,
-                    shard.creationTime);
-              }
-              return create(creationTime, revokes.build());
-            });
-  }
-
-  /** Save this list to Datastore in sharded form. */
-  private SignedMarkRevocationList saveToDatastore() {
-    tm().transact(
-            () -> {
-              ofy()
-                  .deleteWithoutBackup()
-                  .keys(
-                      ofy()
-                          .load()
-                          .type(SignedMarkRevocationList.class)
-                          .ancestor(getCrossTldKey())
-                          .keys());
-              ofy()
-                  .saveWithoutBackup()
-                  .entities(
-                      CollectionUtils.partitionMap(revokes, SHARD_SIZE).stream()
-                          .map(
-                              shardRevokes -> {
-                                SignedMarkRevocationList shard = create(creationTime, shardRevokes);
-                                shard.id = allocateId();
-                                shard.isShard =
-                                    true; // Avoid the exception in disallowUnshardedSaves().
-                                return shard;
-                              })
-                          .collect(toImmutableList()));
-            });
-    return this;
-  }
-
-  private static void loadAndCompareCloudSqlList(SignedMarkRevocationList datastoreList) {
-    // Lifted with some modifications from ClaimsListShard
-    Optional<SignedMarkRevocationList> maybeCloudSqlList =
-        SignedMarkRevocationListDao.getLatestRevision();
-    if (maybeCloudSqlList.isPresent()) {
-      SignedMarkRevocationList cloudSqlList = maybeCloudSqlList.get();
-      MapDifference<String, DateTime> diff =
-          Maps.difference(datastoreList.revokes, cloudSqlList.revokes);
-      if (!diff.areEqual()) {
-        if (diff.entriesDiffering().size() > 10) {
-          String message =
-              String.format(
-                  "Unequal SM revocation lists detected, Cloud SQL list with revision id %d has %d"
-                      + " different records than the current Datastore list.",
-                  cloudSqlList.revisionId, diff.entriesDiffering().size());
-          throw new RuntimeException(message);
-        } else {
-          StringBuilder diffMessage = new StringBuilder("Unequal SM revocation lists detected:\n");
-          diff.entriesDiffering()
-              .forEach(
-                  (label, valueDiff) ->
-                      diffMessage.append(
-                          String.format(
-                              "SMD %s has key %s in Datastore and key %s in Cloud SQL.\n",
-                              label, valueDiff.leftValue(), valueDiff.rightValue())));
-          throw new RuntimeException(diffMessage.toString());
-        }
-      }
-    } else {
-      if (datastoreList.size() != 0) {
-        throw new RuntimeException("Signed mark revocation list in Cloud SQL is empty.");
-      }
-    }
-  }
-
  /** As a safety mechanism, fail if someone tries to save this class directly. */
  @OnSave
  void disallowUnshardedSaves() {
--- a/core/src/main/java/google/registry/model/smd/SignedMarkRevocationListDao.java
+++ b/core/src/main/java/google/registry/model/smd/SignedMarkRevocationListDao.java
@@ -14,28 +14,142 @@

 package google.registry.model.smd;

-import static google.registry.model.CacheUtils.memoizeWithShortExpiration;
+import static com.google.common.base.Preconditions.checkNotNull;
+import static com.google.common.base.Preconditions.checkState;
+import static com.google.common.collect.ImmutableList.toImmutableList;
+import static com.google.common.collect.Iterables.isEmpty;
 import static google.registry.model.DatabaseMigrationUtils.suppressExceptionUnlessInTest;
+import static google.registry.model.common.DatabaseTransitionSchedule.PrimaryDatabase.DATASTORE;
+import static google.registry.model.common.EntityGroupRoot.getCrossTldKey;
+import static google.registry.model.ofy.ObjectifyService.allocateId;
+import static google.registry.model.ofy.ObjectifyService.ofy;
+import static google.registry.model.smd.SignedMarkRevocationList.SHARD_SIZE;
 import static google.registry.persistence.transaction.TransactionManagerFactory.jpaTm;
+import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
+import static google.registry.util.CollectionUtils.isNullOrEmpty;
+import static google.registry.util.DateTimeUtils.START_OF_TIME;

-import com.google.common.base.Supplier;
+import com.google.common.collect.ImmutableMap;
+import com.google.common.collect.Iterables;
+import com.google.common.collect.MapDifference;
+import com.google.common.collect.Maps;
 import com.google.common.flogger.FluentLogger;
+import google.registry.model.DatabaseMigrationUtils;
+import google.registry.model.common.DatabaseTransitionSchedule.PrimaryDatabase;
+import google.registry.model.common.DatabaseTransitionSchedule.TransitionId;
+import google.registry.util.CollectionUtils;
+import java.util.Map;
 import java.util.Optional;
 import javax.persistence.EntityManager;
+import org.joda.time.DateTime;

 public class SignedMarkRevocationListDao {

  private static final FluentLogger logger = FluentLogger.forEnclosingClass();

-  private static final Supplier<Optional<SignedMarkRevocationList>> CACHE =
-      memoizeWithShortExpiration(SignedMarkRevocationListDao::getLatestRevision);
-
-  /** Returns the most recent revision of the {@link SignedMarkRevocationList}, from cache. */
-  public static Optional<SignedMarkRevocationList> getLatestRevisionCached() {
-    return CACHE.get();
+  /**
+   * Loads the {@link SignedMarkRevocationList}.
+   *
+   * <p>Loads the list from the specified primary database, and attempts to load from the secondary
+   * database. If the load the secondary database fails, or the list from the secondary database
+   * does not match the list from the primary database, the error will be logged but no exception
+   * will be thrown.
+   */
+  static SignedMarkRevocationList load() {
+    PrimaryDatabase primaryDatabase =
+        tm().transactNew(
+                () ->
+                    DatabaseMigrationUtils.getPrimaryDatabase(
+                        TransitionId.SIGNED_MARK_REVOCATION_LIST));
+    Optional<SignedMarkRevocationList> primaryList =
+        primaryDatabase.equals(DATASTORE) ? loadFromDatastore() : loadFromCloudSql();
+    if (!primaryList.isPresent()) {
+      throw new IllegalStateException(
+          String.format(
+              "SignedMarkRevocationList not found in the primary database (%s).",
+              primaryDatabase.name()));
+    }
+    suppressExceptionUnlessInTest(
+        () -> loadAndCompare(primaryDatabase, primaryList.get()),
+        String.format(
+            "Error loading and comparing the SignedMarkRevocationList from the secondary database"
+                + " (%s).",
+            primaryDatabase.equals(DATASTORE) ? "Cloud SQL" : "Datastore"));
+    return primaryList.get();
  }

-  public static Optional<SignedMarkRevocationList> getLatestRevision() {
+  /**
+   * Loads the list from the secondary database and compares it to the list from the primary
+   * database.
+   */
+  private static void loadAndCompare(
+      PrimaryDatabase primaryDatabase, SignedMarkRevocationList primaryList) {
+    Optional<SignedMarkRevocationList> secondaryList =
+        primaryDatabase.equals(DATASTORE) ? loadFromCloudSql() : loadFromDatastore();
+    if (secondaryList.isPresent() && !isNullOrEmpty(secondaryList.get().revokes)) {
+      MapDifference<String, DateTime> diff =
+          Maps.difference(primaryList.revokes, secondaryList.get().revokes);
+      if (!diff.areEqual()) {
+        if (diff.entriesDiffering().size() > 10) {
+          String message =
+              String.format(
+                  "Unequal SignedMarkRevocationList detected, %s list with revision id"
+                      + " %d has %d different records than the current primary database list.",
+                  primaryDatabase.equals(DATASTORE) ? "Cloud SQL" : "Datastore",
+                  secondaryList.get().revisionId,
+                  diff.entriesDiffering().size());
+          throw new IllegalStateException(message);
+        } else {
+          StringBuilder diffMessage =
+              new StringBuilder("Unequal SignedMarkRevocationList detected:\n");
+          diff.entriesDiffering()
+              .forEach(
+                  (label, valueDiff) ->
+                      diffMessage.append(
+                          String.format(
+                              "SMD %s has key %s in %s and key %s in secondary database.\n",
+                              label,
+                              valueDiff.leftValue(),
+                              primaryDatabase.name(),
+                              valueDiff.rightValue())));
+          throw new IllegalStateException(diffMessage.toString());
+        }
+      }
+    } else {
+      if (primaryList.size() != 0) {
+        throw new IllegalStateException(
+            String.format(
+                "SignedMarkRevocationList in %s is empty while it is not empty in the primary"
+                    + " database.",
+                primaryDatabase.equals(DATASTORE) ? "Cloud SQL" : "Datastore"));
+      }
+    }
+  }
+
+  /** Loads the shards from Datastore and combines them into one list. */
+  private static Optional<SignedMarkRevocationList> loadFromDatastore() {
+    return tm().transactNewReadOnly(
+            () -> {
+              Iterable<SignedMarkRevocationList> shards =
+                  ofy().load().type(SignedMarkRevocationList.class).ancestor(getCrossTldKey());
+              DateTime creationTime =
+                  isEmpty(shards)
+                      ? START_OF_TIME
+                      : checkNotNull(Iterables.get(shards, 0).creationTime, "creationTime");
+              ImmutableMap.Builder<String, DateTime> revokes = new ImmutableMap.Builder<>();
+              for (SignedMarkRevocationList shard : shards) {
+                revokes.putAll(shard.revokes);
+                checkState(
+                    creationTime.equals(shard.creationTime),
+                    "Inconsistent creation times in Datastore shard: %s vs. %s",
+                    creationTime,
+                    shard.creationTime);
+              }
+              return Optional.of(SignedMarkRevocationList.create(creationTime, revokes.build()));
+            });
+  }
+
+  private static Optional<SignedMarkRevocationList> loadFromCloudSql() {
    return jpaTm()
        .transact(
            () -> {
@@ -54,24 +168,65 @@ public class SignedMarkRevocationListDao {
  }

  /**
-   * Try to save the given {@link SignedMarkRevocationList} into Cloud SQL. If the save fails, the
-   * error will be logged but no exception will be thrown.
+   * Save the given {@link SignedMarkRevocationList}
   *
-   * <p>This method is used during the dual-write phase of database migration as Datastore is still
-   * the authoritative database.
+   * <p>Saves the list to the specified primary database, and attempts to save to the secondary
+   * database. If the save to the secondary database fails, the error will be logged but no
+   * exception will be thrown.
   */
-  static void trySave(SignedMarkRevocationList signedMarkRevocationList) {
-    suppressExceptionUnlessInTest(
-        () -> {
-          SignedMarkRevocationListDao.save(signedMarkRevocationList);
-          logger.atInfo().log(
-              "Inserted %,d signed mark revocations into Cloud SQL.",
-              signedMarkRevocationList.revokes.size());
-        },
-        "Error inserting signed mark revocations into Cloud SQL.");
+  static void save(SignedMarkRevocationList signedMarkRevocationList) {
+    PrimaryDatabase primaryDatabase =
+        tm().transactNew(
+                () ->
+                    DatabaseMigrationUtils.getPrimaryDatabase(
+                        TransitionId.SIGNED_MARK_REVOCATION_LIST));
+    if (primaryDatabase.equals(DATASTORE)) {
+      saveToDatastore(signedMarkRevocationList.revokes, signedMarkRevocationList.creationTime);
+      suppressExceptionUnlessInTest(
+          () -> SignedMarkRevocationListDao.saveToCloudSql(signedMarkRevocationList),
+          "Error inserting signed mark revocations into secondary database (Cloud SQL).");
+    } else {
+      SignedMarkRevocationListDao.saveToCloudSql(signedMarkRevocationList);
+      suppressExceptionUnlessInTest(
+          () ->
+              saveToDatastore(
+                  signedMarkRevocationList.revokes, signedMarkRevocationList.creationTime),
+          "Error inserting signed mark revocations into secondary database (Datastore).");
+    }
  }

-  private static void save(SignedMarkRevocationList signedMarkRevocationList) {
+  private static void saveToCloudSql(SignedMarkRevocationList signedMarkRevocationList) {
    jpaTm().transact(() -> jpaTm().getEntityManager().persist(signedMarkRevocationList));
+    logger.atInfo().log(
+        "Inserted %,d signed mark revocations into Cloud SQL.",
+        signedMarkRevocationList.revokes.size());
+  }
+
+  private static void saveToDatastore(Map<String, DateTime> revokes, DateTime creationTime) {
+    tm().transact(
+            () -> {
+              ofy()
+                  .deleteWithoutBackup()
+                  .keys(
+                      ofy()
+                          .load()
+                          .type(SignedMarkRevocationList.class)
+                          .ancestor(getCrossTldKey())
+                          .keys());
+              ofy()
+                  .saveWithoutBackup()
+                  .entities(
+                      CollectionUtils.partitionMap(revokes, SHARD_SIZE).stream()
+                          .map(
+                              shardRevokes -> {
+                                SignedMarkRevocationList shard =
+                                    SignedMarkRevocationList.create(creationTime, shardRevokes);
+                                shard.id = allocateId();
+                                shard.isShard =
+                                    true; // Avoid the exception in disallowUnshardedSaves().
+                                return shard;
+                              })
+                          .collect(toImmutableList()));
+            });
  }
 }
--- a/core/src/main/java/google/registry/model/transfer/DomainTransferData.java
+++ b/core/src/main/java/google/registry/model/transfer/DomainTransferData.java
@@ -144,6 +144,16 @@ public class DomainTransferData extends TransferData<DomainTransferData.Builder>
            rootKey, serverApproveAutorenewPollMessage, serverApproveAutorenewPollMessageHistoryId);
  }

+  /**
+   * Fix the VKey "kind" for the PollMessage keys.
+   *
+   * <p>For use by DomainBase/DomainHistory OnLoad methods ONLY.
+   */
+  public void convertVKeys() {
+    serverApproveAutorenewPollMessage =
+        PollMessage.Autorenew.convertVKey(serverApproveAutorenewPollMessage);
+  }
+
  @SuppressWarnings("unused") // For Hibernate.
  private void loadServerApproveBillingEventHistoryId(
      @AlsoLoad("serverApproveBillingEvent") VKey<BillingEvent.OneTime> val) {
--- a/core/src/main/java/google/registry/model/transfer/TransferData.java
+++ b/core/src/main/java/google/registry/model/transfer/TransferData.java
@@ -76,6 +76,7 @@ public abstract class TransferData<
   * be deleted.
   */
  @Transient
+  @DoNotCompare
  @IgnoreSave(IfNull.class)
  Set<VKey<? extends TransferServerApproveEntity>> serverApproveEntities;

@@ -93,6 +94,9 @@ public abstract class TransferData<
  // the transfer request flow, when the instance is loaded from Datastore, we cannot make this
  // distinction because they are just VKeys. Also, the only way we use serverApproveEntities is to
  // just delete all the entities referenced by the VKeys, so we don't need to make the distinction.
+  //
+  // In addition, there may be a third poll message for the autorenew poll message on domain
+  // transfer if applicable.
  @Ignore
  @Column(name = "transfer_poll_message_id_1")
  Long pollMessageId1;
@@ -101,6 +105,10 @@ public abstract class TransferData<
  @Column(name = "transfer_poll_message_id_2")
  Long pollMessageId2;

+  @Ignore
+  @Column(name = "transfer_poll_message_id_3")
+  Long pollMessageId3;
+
  public abstract boolean isEmpty();

  @Nullable
@@ -175,6 +183,10 @@ public abstract class TransferData<
      Key<PollMessage> ofyKey = Key.create(historyEntryKey, PollMessage.class, pollMessageId2);
      entityKeysBuilder.add(PollMessage.createVKey(ofyKey));
    }
+    if (pollMessageId3 != null) {
+      Key<PollMessage> ofyKey = Key.create(historyEntryKey, PollMessage.class, pollMessageId3);
+      entityKeysBuilder.add(PollMessage.createVKey(ofyKey));
+    }
    serverApproveEntities = entityKeysBuilder.build();
  }

@@ -187,6 +199,7 @@ public abstract class TransferData<
      transferData.repoId = null;
      transferData.pollMessageId1 = null;
      transferData.pollMessageId2 = null;
+      transferData.pollMessageId3 = null;
      return;
    }
    // Each element in serverApproveEntities should have the exact same Key<HistoryEntry> as its
@@ -202,6 +215,9 @@ public abstract class TransferData<
    if (sortedPollMessageIds.size() >= 2) {
      transferData.pollMessageId2 = sortedPollMessageIds.get(1);
    }
+    if (sortedPollMessageIds.size() >= 3) {
+      transferData.pollMessageId3 = sortedPollMessageIds.get(2);
+    }
  }

  /**
--- a/core/src/main/java/google/registry/module/backend/BackendComponent.java
+++ b/core/src/main/java/google/registry/module/backend/BackendComponent.java
@@ -24,6 +24,8 @@ import google.registry.dns.writer.VoidDnsWriterModule;
 import google.registry.export.DriveModule;
 import google.registry.export.datastore.DatastoreAdminModule;
 import google.registry.export.sheet.SheetsServiceModule;
+import google.registry.flows.ServerTridProviderModule;
+import google.registry.flows.custom.CustomLogicFactoryModule;
 import google.registry.gcs.GcsServiceModule;
 import google.registry.groups.DirectoryModule;
 import google.registry.groups.GroupsModule;
@@ -54,6 +56,7 @@ import javax.inject.Singleton;
      BigqueryModule.class,
      ConfigModule.class,
      CredentialModule.class,
+      CustomLogicFactoryModule.class,
      DatastoreAdminModule.class,
      DatastoreServiceModule.class,
      DirectoryModule.class,
@@ -68,6 +71,7 @@ import javax.inject.Singleton;
      KeyringModule.class,
      KmsModule.class,
      NetHttpTransportModule.class,
+      ServerTridProviderModule.class,
      SheetsServiceModule.class,
      StackdriverModule.class,
      URLFetchServiceModule.class,
--- a/core/src/main/java/google/registry/module/backend/BackendRequestComponent.java
+++ b/core/src/main/java/google/registry/module/backend/BackendRequestComponent.java
@@ -22,6 +22,7 @@ import google.registry.backup.DeleteOldCommitLogsAction;
 import google.registry.backup.ExportCommitLogDiffAction;
 import google.registry.batch.BatchModule;
 import google.registry.batch.DeleteContactsAndHostsAction;
+import google.registry.batch.DeleteExpiredDomainsAction;
 import google.registry.batch.DeleteLoadTestDataAction;
 import google.registry.batch.DeleteProberDataAction;
 import google.registry.batch.ExpandRecurringBillingEventsAction;
@@ -52,6 +53,7 @@ import google.registry.export.UpdateSnapshotViewAction;
 import google.registry.export.UploadDatastoreBackupAction;
 import google.registry.export.sheet.SheetModule;
 import google.registry.export.sheet.SyncRegistrarsSheetAction;
+import google.registry.flows.FlowComponent;
 import google.registry.mapreduce.MapreduceModule;
 import google.registry.monitoring.whitebox.WhiteboxModule;
 import google.registry.rdap.UpdateRegistrarRdapBaseUrlsAction;
@@ -127,6 +129,8 @@ interface BackendRequestComponent {

  DeleteContactsAndHostsAction deleteContactsAndHostsAction();

+  DeleteExpiredDomainsAction deleteExpiredDomainsAction();
+
  DeleteLoadTestDataAction deleteLoadTestDataAction();

  DeleteOldCommitLogsAction deleteOldCommitLogsAction();
@@ -143,6 +147,8 @@ interface BackendRequestComponent {

  ExportReservedTermsAction exportReservedTermsAction();

+  FlowComponent.Builder flowComponentBuilder();
+
  GenerateInvoicesAction generateInvoicesAction();

  GenerateSpec11ReportAction generateSpec11ReportAction();
--- a/core/src/main/java/google/registry/persistence/PersistenceModule.java
+++ b/core/src/main/java/google/registry/persistence/PersistenceModule.java
@@ -46,6 +46,7 @@ import java.lang.annotation.Documented;
 import java.sql.Connection;
 import java.util.HashMap;
 import java.util.Map;
+import java.util.Objects;
 import java.util.Optional;
 import javax.annotation.Nullable;
 import javax.inject.Provider;
@@ -123,6 +124,28 @@ public abstract class PersistenceModule {
  @Config("beamIsolationOverride")
  abstract TransactionIsolationLevel bindBeamIsolationOverride();

+  /**
+   * Optionally overrides the maximum connection pool size for JPA.
+   *
+   * <p>If present, this binding overrides the {@code HIKARI_MAXIMUM_POOL_SIZE} value set in {@link
+   * #provideDefaultDatabaseConfigs()}. The default value is tuned for the Registry server on
+   * AppEngine. Other applications such as the Nomulus tool and the BEAM pipeline, should override
+   * it.
+   */
+  @BindsOptionalOf
+  @Config("jpaMaxPoolSizeOverride")
+  abstract Integer bindJpaMaxPoolSizeOverride();
+
+  /**
+   * Optionally overrides the Cloud SQL database instance's connection name.
+   *
+   * <p>This allows connections to alternative database instances, e.g., the read-only replica or a
+   * test database.
+   */
+  @BindsOptionalOf
+  @Config("instanceConnectionNameOverride")
+  abstract String instanceConnectionNameOverride();
+
  @Provides
  @Singleton
  @BeamPipelineCloudSqlConfigs
@@ -162,13 +185,42 @@ public abstract class PersistenceModule {
      @PartialCloudSqlConfigs ImmutableMap<String, String> cloudSqlConfigs,
      Clock clock) {
    HashMap<String, String> overrides = Maps.newHashMap(cloudSqlConfigs);
-    overrides.put(Environment.USER, username);
-    overrides.put(Environment.PASS, kmsKeyring.getCloudSqlPassword());
-    validateCredentialStore(
+    validateAndSetCredential(
        credentialStore,
        new RobotUser(RobotId.NOMULUS),
-        overrides.get(Environment.USER),
-        overrides.get(Environment.PASS));
+        overrides,
+        username,
+        kmsKeyring.getCloudSqlPassword());
+    return new JpaTransactionManagerImpl(create(overrides), clock);
+  }
+
+  @Provides
+  @Singleton
+  @BeamJpaTm
+  static JpaTransactionManager provideBeamJpaTm(
+      SqlCredentialStore credentialStore,
+      @Config("instanceConnectionNameOverride")
+          Optional<Provider<String>> instanceConnectionNameOverride,
+      @Config("jpaMaxPoolSizeOverride") Optional<Integer> jpaMaxConnectionPoolSizeOverride,
+      @Config("beamIsolationOverride")
+          Optional<Provider<TransactionIsolationLevel>> isolationOverride,
+      @PartialCloudSqlConfigs ImmutableMap<String, String> cloudSqlConfigs,
+      Clock clock) {
+    HashMap<String, String> overrides = Maps.newHashMap(cloudSqlConfigs);
+    // TODO(b/175700623): make sql username configurable from config file.
+    SqlCredential credential = credentialStore.getCredential(new RobotUser(RobotId.NOMULUS));
+    overrides.put(Environment.USER, credential.login());
+    overrides.put(Environment.PASS, credential.password());
+    instanceConnectionNameOverride
+        .map(Provider::get)
+        .ifPresent(
+            instanceConnectionName ->
+                overrides.put(HIKARI_DS_CLOUD_SQL_INSTANCE, instanceConnectionName));
+    jpaMaxConnectionPoolSizeOverride.ifPresent(
+        maxPoolSize -> overrides.put(HIKARI_MAXIMUM_POOL_SIZE, String.valueOf(maxPoolSize)));
+    isolationOverride
+        .map(Provider::get)
+        .ifPresent(isolation -> overrides.put(Environment.ISOLATION, isolation.name()));
    return new JpaTransactionManagerImpl(create(overrides), clock);
  }

@@ -184,13 +236,12 @@ public abstract class PersistenceModule {
      Clock clock) {
    CloudSqlCredentialSupplier.setupCredentialSupplier(credential);
    HashMap<String, String> overrides = Maps.newHashMap(cloudSqlConfigs);
-    overrides.put(Environment.USER, username);
-    overrides.put(Environment.PASS, kmsKeyring.getToolsCloudSqlPassword());
-    validateCredentialStore(
+    validateAndSetCredential(
        credentialStore,
        new RobotUser(RobotId.TOOL),
-        overrides.get(Environment.USER),
-        overrides.get(Environment.PASS));
+        overrides,
+        username,
+        kmsKeyring.getToolsCloudSqlPassword());
    return new JpaTransactionManagerImpl(create(overrides), clock);
  }

@@ -205,15 +256,25 @@ public abstract class PersistenceModule {
      @BeamPipelineCloudSqlConfigs ImmutableMap<String, String> cloudSqlConfigs,
      Clock clock) {
    HashMap<String, String> overrides = Maps.newHashMap(cloudSqlConfigs);
+    overrides.put(HIKARI_MAXIMUM_POOL_SIZE, String.valueOf(hikariMaximumPoolSize));
    overrides.put(Environment.USER, username);
    overrides.put(Environment.PASS, password);
-    overrides.put(HIKARI_MAXIMUM_POOL_SIZE, String.valueOf(hikariMaximumPoolSize));
    // TODO(b/175700623): consider assigning different logins to pipelines
-    validateCredentialStore(
-        credentialStore,
-        new RobotUser(RobotId.NOMULUS),
-        overrides.get(Environment.USER),
-        overrides.get(Environment.PASS));
+    // TODO(b/179839014): Make SqlCredentialStore injectable in BEAM
+    // Note: the logs below appear in the pipeline's Worker logs, not the Job log.
+    try {
+      SqlCredential credential = credentialStore.getCredential(new RobotUser(RobotId.NOMULUS));
+      if (!Objects.equals(username, credential.login())) {
+        logger.atWarning().log(
+            "Wrong username for nomulus. Expecting %s, found %s.", username, credential.login());
+      } else if (!Objects.equals(password, credential.password())) {
+        logger.atWarning().log("Wrong password for nomulus.");
+      } else {
+        logger.atWarning().log("Credentials in the kerying and the secret manager match.");
+      }
+    } catch (Exception e) {
+      logger.atWarning().withCause(e).log("Failed to get SQL credential from Secret Manager.");
+    }
    return new JpaTransactionManagerImpl(create(overrides), clock);
  }

@@ -258,27 +319,36 @@ public abstract class PersistenceModule {
    return emf;
  }

-  /** Verifies that the credential from the Secret Manager matches the one currently in use.
+  /**
+   * Verifies that the credential from the Secret Manager matches the one currently in use, and
+   * configures JPA with the credential from the Secret Manager.
   *
-   * <p>This is a helper for the transition to the Secret Manager, and will be removed once data
-   * and permissions are properly set up for all projects.
-   **/
-  private static void validateCredentialStore(
-      SqlCredentialStore credentialStore, SqlUser sqlUser, String login, String password) {
+   * <p>This is a helper for the transition to the Secret Manager, and will be removed once data and
+   * permissions are properly set up for all projects.
+   */
+  private static void validateAndSetCredential(
+      SqlCredentialStore credentialStore,
+      SqlUser sqlUser,
+      Map<String, String> overrides,
+      String expectedLogin,
+      String expectedPassword) {
    try {
      SqlCredential credential = credentialStore.getCredential(sqlUser);
-      if (!credential.login().equals(login)) {
-        logger.atWarning().log(
-            "Wrong login for %s. Expecting %s, found %s.",
-            sqlUser.geUserName(), login, credential.login());
-        return;
-      }
-      if (!credential.password().equals(password)) {
-        logger.atWarning().log("Wrong password for %s.", sqlUser.geUserName());
-      }
+      checkState(
+          credential.login().equals(expectedLogin),
+          "Wrong login for %s. Expecting %s, found %s.",
+          sqlUser.geUserName(),
+          expectedLogin,
+          credential.login());
+      checkState(
+          credential.password().equals(expectedPassword),
+          "Wrong password for %s.",
+          sqlUser.geUserName());
+      overrides.put(Environment.USER, credential.login());
+      overrides.put(Environment.PASS, credential.password());
      logger.atWarning().log("Credentials in the kerying and the secret manager match.");
    } catch (Throwable e) {
-      logger.atWarning().log(e.getMessage());
+      logger.atSevere().withCause(e).log("Failed to get SQL credential from Secret Manager");
    }
  }

@@ -318,6 +388,12 @@ public abstract class PersistenceModule {
  @Documented
  @interface AppEngineJpaTm {}

+  /** Dagger qualifier for {@link JpaTransactionManager} used inside BEAM pipelines. */
+  // Note: @SocketFactoryJpaTm will be phased out in favor of this qualifier.
+  @Qualifier
+  @Documented
+  public @interface BeamJpaTm {}
+
  /** Dagger qualifier for {@link JpaTransactionManager} used for Nomulus tool. */
  @Qualifier
  @Documented
--- a/core/src/main/java/google/registry/persistence/transaction/CriteriaQueryBuilder.java
+++ b/core/src/main/java/google/registry/persistence/transaction/CriteriaQueryBuilder.java
@@ -0,0 +1,97 @@
+// Copyright 2021 The Nomulus Authors. All Rights Reserved.
+//
+// Licensed under the Apache License, Version 2.0 (the "License");
+// you may not use this file except in compliance with the License.
+// You may obtain a copy of the License at
+//
+//     http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package google.registry.persistence.transaction;
+
+import static google.registry.persistence.transaction.TransactionManagerFactory.jpaTm;
+
+import com.google.common.collect.ImmutableList;
+import java.util.Collection;
+import javax.persistence.criteria.CriteriaBuilder;
+import javax.persistence.criteria.CriteriaQuery;
+import javax.persistence.criteria.Expression;
+import javax.persistence.criteria.Order;
+import javax.persistence.criteria.Predicate;
+import javax.persistence.criteria.Root;
+
+/**
+ * An extension of {@link CriteriaQuery} that uses a Builder-style pattern when adding "WHERE"
+ * and/or "ORDER BY" clauses.
+ *
+ * <p>{@link CriteriaQuery}, as is, requires that all clauses must be passed in at once -- if one
+ * calls "WHERE" multiple times, the later call overwrites the earlier call.
+ */
+public class CriteriaQueryBuilder<T> {
+
+  /** Functional interface that defines the 'where' operator, e.g. {@link CriteriaBuilder#equal}. */
+  public interface WhereClause<U> {
+    Predicate predicate(Expression<U> expression, U object);
+  }
+
+  /** Functional interface that defines the order-by operator, e.g. {@link CriteriaBuilder#asc}. */
+  public interface OrderByClause<U> {
+    Order order(Expression<U> expression);
+  }
+
+  private final CriteriaQuery<T> query;
+  private final Root<T> root;
+  private final ImmutableList.Builder<Predicate> predicates = new ImmutableList.Builder<>();
+  private final ImmutableList.Builder<Order> orders = new ImmutableList.Builder<>();
+
+  private CriteriaQueryBuilder(CriteriaQuery<T> query, Root<T> root) {
+    this.query = query;
+    this.root = root;
+  }
+
+  /** Adds a WHERE clause to the query, given the specified operation, field, and value. */
+  public <V> CriteriaQueryBuilder<T> where(WhereClause<V> whereClause, String fieldName, V value) {
+    Expression<V> expression = root.get(fieldName);
+    return where(whereClause.predicate(expression, value));
+  }
+
+  /** Adds a WHERE clause to the query specifying that a value must be in the given collection. */
+  public CriteriaQueryBuilder<T> whereFieldIsIn(String fieldName, Collection<?> values) {
+    return where(root.get(fieldName).in(values));
+  }
+
+  /** Orders the result by the given operation applied to the given field. */
+  public <U> CriteriaQueryBuilder<T> orderBy(OrderByClause<U> orderByClause, String fieldName) {
+    Expression<U> expression = root.get(fieldName);
+    return orderBy(orderByClause.order(expression));
+  }
+
+  /** Builds and returns the query, applying all WHERE and ORDER BY clauses at once. */
+  public CriteriaQuery<T> build() {
+    Predicate[] predicateArray = predicates.build().toArray(new Predicate[0]);
+    return query.where(predicateArray).orderBy(orders.build());
+  }
+
+  private CriteriaQueryBuilder<T> where(Predicate predicate) {
+    predicates.add(predicate);
+    return this;
+  }
+
+  private CriteriaQueryBuilder<T> orderBy(Order order) {
+    orders.add(order);
+    return this;
+  }
+
+  /** Creates a query builder that will SELECT from the given class. */
+  public static <T> CriteriaQueryBuilder<T> create(Class<T> clazz) {
+    CriteriaQuery<T> query = jpaTm().getEntityManager().getCriteriaBuilder().createQuery(clazz);
+    Root<T> root = query.from(clazz);
+    query = query.select(root);
+    return new CriteriaQueryBuilder<>(query, root);
+  }
+}
--- a/core/src/main/java/google/registry/persistence/transaction/JpaTransactionManagerImpl.java
+++ b/core/src/main/java/google/registry/persistence/transaction/JpaTransactionManagerImpl.java
@@ -458,6 +458,7 @@ public class JpaTransactionManagerImpl implements JpaTransactionManager {
    assertInTransaction();
    EntityType<?> entityType = getEntityType(key.getKind());
    ImmutableSet<EntityId> entityIds = getEntityIdsFromSqlKey(entityType, key.getSqlKey());
+    // TODO(b/179158393): use Criteria for query to leave not doubt about sql injection risk.
    String sql =
        String.format("DELETE FROM %s WHERE %s", entityType.getName(), getAndClause(entityIds));
    Query query = getEntityManager().createQuery(sql);
--- a/core/src/main/java/google/registry/persistence/transaction/Transaction.java
+++ b/core/src/main/java/google/registry/persistence/transaction/Transaction.java
@@ -86,7 +86,7 @@ public class Transaction extends ImmutableObject implements Buildable {
    }
  }

-  static Transaction deserialize(byte[] serializedTransaction) throws IOException {
+  public static Transaction deserialize(byte[] serializedTransaction) throws IOException {
    ObjectInputStream in = new ObjectInputStream(new ByteArrayInputStream(serializedTransaction));

    // Verify that the data is what we expect.
--- a/core/src/main/java/google/registry/persistence/transaction/TransactionEntity.java
+++ b/core/src/main/java/google/registry/persistence/transaction/TransactionEntity.java
@@ -34,9 +34,9 @@ public class TransactionEntity implements SqlEntity {

  @Id
  @GeneratedValue(strategy = GenerationType.IDENTITY)
-  long id;
+  private long id;

-  byte[] contents;
+  private byte[] contents;

  TransactionEntity() {}

@@ -48,4 +48,12 @@ public class TransactionEntity implements SqlEntity {
  public Optional<DatastoreEntity> toDatastoreEntity() {
    return Optional.empty(); // Not persisted in Datastore per se
  }
+
+  public long getId() {
+    return id;
+  }
+
+  public byte[] getContents() {
+    return contents;
+  }
 }
--- a/core/src/main/java/google/registry/persistence/transaction/TransactionManagerFactory.java
+++ b/core/src/main/java/google/registry/persistence/transaction/TransactionManagerFactory.java
@@ -101,6 +101,16 @@ public class TransactionManagerFactory {
    jpaTm = Suppliers.memoize(jpaTmSupplier::get);
  }

+  /**
+   * Makes {@link #jpaTm()} return the {@link JpaTransactionManager} instance provided by {@code
+   * jpaTmSupplier} from now on. This method should only be called by an implementor of {@link
+   * org.apache.beam.sdk.harness.JvmInitializer}.
+   */
+  public static void setJpaTmOnBeamWorker(Supplier<JpaTransactionManager> jpaTmSupplier) {
+    checkNotNull(jpaTmSupplier, "jpaTmSupplier");
+    jpaTm = Suppliers.memoize(jpaTmSupplier::get);
+  }
+
  /** Sets the return of {@link #tm()} to the given instance of {@link TransactionManager}. */
  @VisibleForTesting
  public static void setTm(TransactionManager newTm) {
--- a/core/src/main/java/google/registry/rdap/RdapActionBase.java
+++ b/core/src/main/java/google/registry/rdap/RdapActionBase.java
@@ -17,6 +17,7 @@ package google.registry.rdap;
 import static com.google.common.base.Charsets.UTF_8;
 import static com.google.common.base.Preconditions.checkArgument;
 import static com.google.common.net.HttpHeaders.ACCESS_CONTROL_ALLOW_ORIGIN;
+import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
 import static google.registry.request.Actions.getPathForAction;
 import static google.registry.util.DomainNameUtils.canonicalizeDomainName;
 import static javax.servlet.http.HttpServletResponse.SC_BAD_REQUEST;
@@ -28,7 +29,10 @@ import com.google.common.net.MediaType;
 import com.google.gson.Gson;
 import com.google.gson.GsonBuilder;
 import google.registry.config.RegistryConfig.Config;
+import google.registry.model.DatabaseMigrationUtils;
 import google.registry.model.EppResource;
+import google.registry.model.common.DatabaseTransitionSchedule.PrimaryDatabase;
+import google.registry.model.common.DatabaseTransitionSchedule.TransitionId;
 import google.registry.model.registrar.Registrar;
 import google.registry.rdap.RdapMetrics.EndpointType;
 import google.registry.rdap.RdapObjectClasses.ErrorResponse;
@@ -256,4 +260,11 @@ public abstract class RdapActionBase implements Runnable {
  DateTime getRequestTime() {
    return rdapJsonFormatter.getRequestTime();
  }
+
+  static boolean isDatastore() {
+    return tm().transact(
+        () ->
+            DatabaseMigrationUtils.getPrimaryDatabase(TransitionId.REPLAYED_ENTITIES)
+                .equals(PrimaryDatabase.DATASTORE));
+  }
 }
--- a/core/src/main/java/google/registry/rdap/RdapEntityAction.java
+++ b/core/src/main/java/google/registry/rdap/RdapEntityAction.java
@@ -14,7 +14,8 @@

 package google.registry.rdap;

-import static google.registry.model.ofy.ObjectifyService.ofy;
+import static google.registry.persistence.transaction.TransactionManagerFactory.tm;
+import static google.registry.persistence.transaction.TransactionManagerUtil.transactIfJpaTm;
 import static google.registry.rdap.RdapUtils.getRegistrarByIanaIdentifier;
 import static google.registry.rdap.RdapUtils.getRegistrarByName;
 import static google.registry.request.Action.Method.GET;
@@ -23,9 +24,9 @@ import static google.registry.request.Action.Method.HEAD;
 import com.google.common.collect.ImmutableSet;
 import com.google.common.primitives.Longs;
 import com.google.re2j.Pattern;
-import com.googlecode.objectify.Key;
 import google.registry.model.contact.ContactResource;
 import google.registry.model.registrar.Registrar;
+import google.registry.persistence.VKey;
 import google.registry.rdap.RdapJsonFormatter.OutputDataType;
 import google.registry.rdap.RdapMetrics.EndpointType;
 import google.registry.rdap.RdapObjectClasses.RdapEntity;
@@ -69,13 +70,14 @@ public class RdapEntityAction extends RdapActionBase {
    // RDAP Technical Implementation Guide 2.3.1 - MUST support contact entity lookup using the
    // handle
    if (ROID_PATTERN.matcher(pathSearchString).matches()) {
-      Key<ContactResource> contactKey = Key.create(ContactResource.class, pathSearchString);
-      ContactResource contactResource = ofy().load().key(contactKey).now();
+      VKey<ContactResource> contactVKey = VKey.create(ContactResource.class, pathSearchString);
+      Optional<ContactResource> contactResource =
+          transactIfJpaTm(() -> tm().loadByKeyIfPresent(contactVKey));
      // As per Andy Newton on the regext mailing list, contacts by themselves have no role, since
      // they are global, and might have different roles for different domains.
-      if (contactResource != null && isAuthorized(contactResource)) {
+      if (contactResource.isPresent() && isAuthorized(contactResource.get())) {
        return rdapJsonFormatter.createRdapContactEntity(
-            contactResource, ImmutableSet.of(), OutputDataType.FULL);
+            contactResource.get(), ImmutableSet.of(), OutputDataType.FULL);
      }
    }

--- a/Show More
+++ b/Show More
Author	SHA1	Message	Date
Michael Muller	b75eb0ad95	Replay Cloud SQL transactions against datastore (#738 ) * Replay Cloud SQL transactions against datastore Implement the ReplicateToDatastore cron job that will apply all Cloud SQL transactions to the datastore. The last transaction id is stored in a LastSqlTransaction entity in datastore. Note that this will not be activated in production until a) the cron configuration is updated and b) the cloudSql.replicateTransactions flag is set to true in the nomulus config file. * Post-review changes Fixed immutability issues with LastSqlTransaction, write a single transaction at a time to datastore. * Changes requested in review * Get a batch of SQL transactions Read a batch of SQL transactions at a time and then process them transactionally against datastore. * Bring this up-to-date with the codebase * Changes requested in review * Fixed date in copyright	2021-03-05 10:35:30 -05:00
Weimin Yu	63f8fcef18	Clean up Gradle Flyway tasks in :db (#990 ) * Clean up Gradle Flyway tasks in :db Simplified the command line by revising the semantics of some properties. Added examples of Flyway task invocations. This script still uses the GCS file-based credential. We will migrate it to the Secret Manager soon.	2021-03-04 19:58:09 -05:00
Michael Muller	8d563c4516	Add replay & compare to more flow tests (#975 ) * Add replay & compare to more flow tests Add replay and comparison testing to another batch of flow tests, apply fixes as needed.	2021-03-04 08:25:47 -05:00
Lai Jiang	a58c4a6492	Log forbidden HTTP request method at warning (#983 ) * Log forbidden HTTP request method at warning This seems like more reasonable. It will potential issues with how requests are generated more discoverable in the log.	2021-03-03 21:02:06 -05:00
Weimin Yu	e59475a5f6	Allow AppEngine deployment to qa environment (#986 ) * Allow AppEngine deployment to qa environment	2021-03-03 19:31:08 -05:00
sarahcaseybot	c35f92f54b	Reject handshakes with bad TLS protocols and ciphers (#970 ) * Reject handshakes with bad TLS protocols and ciphers * Fix protocols * make cipher suite list static and fix tests * Delete unnecessary line * Add start time configuration for enforcement * small format fix * Add multiple ciphersuite test * fix gradle lint * fix indentation	2021-03-03 15:47:42 -05:00
Ben McIlwain	cd415fe846	Actually log the error in DeleteExpiredDomainsAction (#985 ) * Actually log the error in DeleteExpiredDomainsAction	2021-03-03 15:21:13 -05:00
Lai Jiang	4ca2c11b20	Use fanout action to run ICANN report upload job in cron (#984 ) GAE cron only issuse HTTP GET requests to the endpoint in question. This particular only allows POSTs. As a result this cron job never succeeded. This is not a big problem as this job is meant to catch up any unforeseen upload failures and in case it needs to catch up but fails, every month the staging job (which is enqueued corrected by cron) will eventually catch everything to date.	2021-03-03 09:00:34 -05:00
Lai Jiang	4e44a98139	Update a few plugins for Java 11 compatibility (#966 ) * Update a few plugins for Java 11 compatibility Guice 5.0.1 is now compatible with Java 11. However we don't directly depend on Guice. Rather Soy depends on Guice. So I added a direct dependency on Guice 5.0 just before Soy in order to frontload Soy and pull in the newer version. Mockito 3.7.7 is now compatible with Java 11. The complication is that we need to use the inline version of Mockito, which among other things also allows mocking for final classes (hooray!). It will eventually become the default Mockito mock maker but for now it needs to be manually activated. Note that the inline version now introduces another warning: ``` OpenJDK 64-Bit Server VM warning: Sharing is only supported for boot loader classes because bootstrap classpath has been appended ``` Which I think is WAI due to how the inline mock maker works. Waiting on the author to confirm. After these to changes the only illegal reflective access is caused by App Engine SDK tools, which we will rid ourselves of when we migrate off of GAE. * Restore package-lock.json	2021-03-02 21:01:30 -05:00
gbrodman	d4371a880e	Add GetPremiumListCommand (#972 ) * Add GetPremiumListCommand When testing the premium list refactor, it would have been nice and convenient to have this. Currently we have no way of inspecting premium list contents that I'm aware of.	2021-03-02 19:59:12 -05:00
gbrodman	7312bc9e60	Add SQL searching to RdapEntitySearchAction and RdapSearchActionBase (#969 ) - Adds a CriteriaQueryBuilder class that allows us to build CriteriaQuery objects with sane and modular WHERE and ORDER BY clauses. CriteriaQuery requires that all WHERE and ORDER BY clauses be specified at the same time (else later ones will overwrite the earlier ones) so in order to have a proper builder pattern we need to wait to build the query object until we are done adding clauses. - In addition, encapsulating the query logic in the CriteriaQueryBuilder class means that we don't need to deal with the complicated Root/Path branching, otherwise we'd have to keep track of CriteriaQuery and Root objects everywhere. - Added a REPLAYED_ENTITIES TransitionId that will represent all replayed entities, e.g. EppResources. Also sets this, by default, to always be CLOUD_SQL if we're using the SQL transaction manager in tests. - Added branching logic in RdapEntitySearchAction based on that transition ID that determines whether we do the existing ofy query logic or JPA logic.	2021-03-02 13:13:55 -05:00
Michael Muller	83ca9d82df	Add replay & compare to ContactCreateFlowTest test (#976 ) * Add replay & compare to ContactCreateFlowTest test This test exposed a write priority issue between ContactResource and ContactHistory entries.	2021-03-02 11:50:03 -05:00
Lai Jiang	8724ef6c70	Upgrade to Gradle 6.8.3 (#979 ) * Upgrade to Gradle 6.8.3	2021-03-01 21:11:06 -05:00
gbrodman	31bf4bd76d	Add a third poll message column in TransferData for domain transfers (#974 ) Because we don't store serverApproveEntities specifically as a set in the SQL world, we need to make sure that the entities are all separated and stored if they exist. For domain transfers, there exist three separate poll messages (client losing, client gaining, autorenew) so we need to store and retrieve that one. Founnd this while converting domain transfer flows to SQL.	2021-02-25 17:22:53 -05:00
gbrodman	cc69d63802	Fix a few Java 9+isms and ignore IML files (#973 ) This allows us to run tests in IDEA which is significantly quicker. We shouldn't be using anything past Java 8 anyway since that's what GAE runs with.	2021-02-25 14:59:00 -05:00
gbrodman	d73a15c697	Partially convert RDAP ofy calls to tm calls (#964 ) * Partially convert RDAP ofy calls to tm calls This converts the simple retrieval actions but does not touch the more complicated search actions -- those use some ofy() query searching logic and will likely end up being significantly more complicated than this change. Here, though, we are just changing the calls that can be converted easily to tm() lookups. To change in future PRs: - RdapDomainSearchAction - RdapEntitySearchAction - RdapNameserverSearchAction - RdapSearchActionBase	2021-02-23 11:28:10 -05:00
gbrodman	f35eda6dc1	Update NPM plugin and hardcode versions of Node / NPM to use (#971 ) * Update NPM plugin and hardcode versions of Node / NPM to use The plugin we were using before was a bit old (last updated in March 2019) and this one is newer, updated, and updates the package-lock file with the new dependency upgrades	2021-02-23 11:27:34 -05:00
gbrodman	a07fbb27c5	Refactor PremiumList storage and retrieval for dual-database setup (#950 ) * Refactor PremiumList storage and retrieval for dual-database setup Previously, the storage and retrieval code was scattered across various places haphazardly and there was no good way to set up dual database access. This reorganizes the code so that retrieval is simpler and it allows for dual-write and dual-read. This includes the following changes: - Move all static / object retrieval code out of PremiumList -- the class should solely consist of its data and methods on its data and it shouldn't have to worry about complicated caching or retrieval - Split all PremiumList retrieval methods into PremiumListDatastoreDao and PremiumListSqlDao that handle retrieval of the premium list entry objects from the corresponding databases (since the way the actual data itself is stored is not the same between the two - Create a dual-DAO for PremiumList retrieval that branches between SQL/Datastore depending on which is appropriate -- it will read from and write to both but only log errors for the secondary DB - Cache the mapping from name to premium list in the dual-DAO. This is a common code path regardless of database so we can cache it at a high level - Cache the ways to go from premium list -> premium entries in the Datastore and SQL DAOs. These caches are specific to the corresponding DB and should thus be stored in the corresponding DAO. - Moves the database-choosing code from the actions to the lower-level dual-DAO. This is because we will often wish to access this premium list data in flows and all accesses should use the proper DB-selecting code	2021-02-22 21:19:48 -05:00
Weimin Yu	ffe3124ee1	Properly set up JPA in BEAM workers (#965 ) * Properly set up JPA in BEAM workers Sets up a singleton JpaTransactionManger on each worker JVM for all pipeline nodes to share. Also added/updated relevant dependencies. The BEAM SDK version change caused the InitSqlPipeline's graph to change.	2021-02-22 18:11:32 -05:00
Michael Muller	8f90b5746a	Fix ContactTransferData SQL loads (#967 ) * Fix ContactTransferData SQL loads ContactTransferData is currently loaded back from SQL as an unspecialized TransferData object. Replace it with the ContactTransferData object that we use it to reconstitute. It's likely that this could be done more straightforwardly with a schema change. * Changes requested in review	2021-02-22 13:42:20 -05:00
Ben McIlwain	a26905d39a	Note that immediate deletion is for exceptional circumstances only (#962 ) * Note that immediate deletion is for exceptional circumstances only	2021-02-17 13:10:12 -05:00
Ben McIlwain	4ce790d29e	Fix obscure bug when checking restore prices of duplicate domain names (#968 ) * Fix obscure bug when checking restore prices of duplicate domain names There were instances of "java.lang.IllegalArgumentException: Multiple entries with same key" in the logs, caused by attempting to construct an ImmutableMap containing duplicate keys. It turns out this was happening in the domain check flow when the following conditions were all simultaneously met: 1. The older v06 fee extension is used 2. The same domain name is being queried multiple times in a single check command (which is valid per the spec but doesn't actually make any sense) 3. Said domain exists 4. The cost of a restore (an uncommon operation) is being checked When all of those conditions were met, an error was being thrown when the dupe-containing list of domain names was used as the keys of a new Map. This fixes that bug by calling .distinct() first. Give enough registrars enough typewriters ... BUG=179052195	2021-02-17 12:09:19 -05:00
sarahcaseybot	bcc1924b24	Refactor SignedMarkRevocationListDao for easy primary database cutover (#943 ) * Refactor SignedMarkRevocationListDao for easy primary database cutover * Fix javadoc comments * Use PrimaryDatabase enum * format fix * fix up tests * Fix punctuation * Remove unnecessary else ifs * Fix error messages * spell out class name	2021-02-14 09:58:08 -05:00
Weimin Yu	f86936788e	Revert BEAM pipeline back to SQL credential file (#961 ) * Revert BEAM pipeline back to SQL credential file Stop using the SecretManager for SQL credential in BEAM for now. The SecretManager cannot be injected into the code on pipeline workers because RegistryEnvironment is not set. See b/179839014 for details.	2021-02-11 14:06:13 -05:00
sarahcaseybot	13f61dd7b9	Add string constants for HTTP header names (#956 ) * Add string constants for HTTP header names * revert package-lock changes * Clarify names * add CONTENT_TYPE * Fix formatting * Move X-FORWARDED-FOR to ProxyHttpHeaders	2021-02-11 12:02:51 -05:00
Michael Muller	17cd9ba4f1	Add db-compare tests to three more flows (#963 ) * Add db-compare tests to three more flows Add database comparison to the replay tests for DomainDeleteFlowTest, DomainRenewFlowTest and DomainUpdateFlowTest.	2021-02-11 11:35:13 -05:00
Weimin Yu	f983d564f8	Use Cloud SQL passwords from the Secret Manager (#959 ) * Use Cloud SQL passwords from the Secret Manager Continue fetching passwords from Keyring until this change is deployed.	2021-02-08 21:59:00 -05:00
sarahcaseybot	bdf9124e87	Add databaseTransitionSchedule entity and tool for updating (#926 ) * Add databaseTransitionSchedule entitiy * add UpdateDatabaseTransitionScheduleCommand * small fixes * change entity structure to no longer be singleton * add get command * fix getCache * Change id to TransitionId enum * more fixes * Cleanup tests * Add link to javadoc * Add lastUpdateTime * fix datatype of getCached	2021-02-08 17:22:00 -05:00
Ben McIlwain	d73e557acc	Rename some overlooked uses of "white-list" and "blacklist" (#960 ) * Rename some overlooked uses of "white-list" and "blacklist"	2021-02-08 16:01:18 -05:00
Lai Jiang	0e74df82df	Update testcontainers to 1.51.1 (#958 ) Per release note (https://github.com/testcontainers/testcontainers-java/releases/tag/1.15.1), this version is needed to support docker version 20.10 and above.	2021-02-08 14:31:17 -05:00
Lai Jiang	b59d2ae419	Upgrade to Gradle 6.8.2 (#957 )	2021-02-08 09:35:43 -05:00
Weimin Yu	d7e65d95e6	Add a presubmit check to require use of templated SQL string literals (#954 ) * Add a presubmit check to require use of templated SQL string literals This PR proposes a coding style convention that helps prevent SQL-injection attacks, and is easy to enforce in the presubmit check. SQL-injections can be effectively prevented if all parameterized queries are generated using the proper param-binding methods. In our project which uses Hibernate exclusively, this can be achieved if we all follow a simple convention: only use constant sql templates assigned to static final String variables as the first parameter to creat(Native)Query methods. This PR adds a presubmit check to enforce the proposed rule, and modified one class as a demo. If the team agrees with this proposal, we will change all other use cases.	2021-02-06 19:28:38 -05:00
Michael Muller	1d96de98c9	Remove dual-write of registrar from tool commands (#952 ) * Remove dual-write of registrar from tool commands As discussed, we're keeping registrar in the "replicated" category.	2021-02-05 11:06:14 -05:00
Michael Muller	29bf0f3965	Make BiqueryPollJobAction endpoint internal only (#955 ) * Make BiqueryPollJobAction endpoint internal only This endpoint makes use of java object deserialization, which allows a malicious actor to craft a request that can initiate overly broad actions on the server. Since this endpoint is not widely used for operational purposes, limit its authorization to "internal only" so that no user agents (even with admin privs) can access it.	2021-02-05 07:50:51 -05:00
sarahcaseybot	5100057dd5	Add cert enforcement in production start date (#953 ) * Add start date for cert enforcement in production * Add TODO to remove start date check after start date * revert changes to package-lock.json * Make start time a constant	2021-02-04 16:30:23 -05:00
Ben McIlwain	1e7260e022	Wire up DeleteExpiredDomainsAction so that it can actually be called (#951 ) * Wire up DeleteExpiredDomainsAction so that it can actually be called For now I'm just going to be calling it manually (and on sandbox for starters), but in a few weeks, if all looks good, I'll add the cron job to regularly call it in production, and this feature will thus be done.	2021-02-03 17:34:36 -05:00