1
0
mirror of https://github.com/google/nomulus synced 2026-05-13 11:21:46 +00:00
Commit Graph

5244 Commits

Author SHA1 Message Date
sharma1210
76131fbd4e Add -J to --add-opens for Kythe extraction (#3028) 2026-04-29 08:15:27 +00:00
sharma1210
1196cd163b Fix Kythe extraction failure caused by Error Prone access to JDK internals (#3026) nomulus-20260429-RC00 2026-04-28 06:45:22 +00:00
gbrodman
4a412546f9 Upgrade beam deps (#3027)
https://docs.cloud.google.com/dataflow/docs/support/beam-runtime-support
looks like we need a later version for java 25
nomulus-20260427-RC01 nomulus-20260428-RC00
2026-04-27 19:40:10 +00:00
Ben McIlwain
6be0a32741 Migrate core, billing, and history to java.time (#3020)
Migrated core entity primitives (GracePeriod, RegistryLock, TimeOfYear), transfer objects (BaseTransferObject, DomainTransferData, TransferResponse), and HostBase from Joda-Time DateTime to java.time.Instant as Phases 5 and 7.
Migrated the Billing Ecosystem (BillingBase, BillingEvent, BillingRecurrence, BillingCancellation) and associated Beam pipelines (ExpandBillingRecurrencesPipeline, InvoicingPipeline) to java.time.Instant as Phase 6.
Migrated PollMessage event times and all associated Poll flow utilities (PollAckFlow, PollRequestFlow) to use Instant natively.
Migrated core timestamp tracking on EppResource (creationTime, lastEppUpdateTime, deletionTime) as well as CreateAutoTimestamp and UpdateAutoTimestamp to Instant, shedding deprecated DateTime accessors.
Migrated the entire HistoryEntry reporting ecosystem (HistoryEntry, DomainTransactionRecord, HistoryEntryDao) completely to java.time.Instant.
Updated all associated EPP flows, tools, and testing helpers to handle Instants directly where supported.
nomulus-20260425-RC00 nomulus-20260426-RC00 nomulus-20260427-RC00 proxy-20260427-RC00
2026-04-24 19:50:55 +00:00
gbrodman
8cf222d1c9 Add Jedis (for Valkey) caches for domains and hosts (#3013)
We add optional Valkey caching of hosts and domains for future use. Eventually, this will allow us to pre-warm large amounts of data in Valkey for quick retrieval during actions like RDAP.

Note: this doesn't actually use the caches yet.

We use Jedis instead of Redisson for speed purposes
(https://www.instaclustr.com/blog/redis-java-clients-and-client-side-caching/)
which means that we have to implement our own multilayer cache but
that's not the worst thing in the world.

Tested on crash with logging and RDAP code that's not included in this
PR -- it behaves as you'd expect, where the local cache works for
immediate re-lookups and the remote cache works after a restart.
2026-04-24 19:50:01 +00:00
gbrodman
903414c76b Add Errorprone plugin for removing FQCNs (#3021)
These annoy me and AI loves to add them. Let's automatically remove them.
nomulus-20260424-RC00
2026-04-23 20:17:19 +00:00
Ben McIlwain
925482ea58 Migrate TMCH, SMD, and Fee models to java.time (#3019)
Continues the project-wide migration from Joda-Time's DateTime to java.time.Instant, focusing on Trademark Clearinghouse (TMCH), Signed Mark Data (SMD), and Fee extension models.

Key updates:
- TMCH & SMD: Updated SmdRevocationList and domain check/create flows to use Instant for sunrise validations and revocation checks.
- Fee Extension Ecosystem: Refactored FeeCheckRequest, FeeCreateCommandExtension, and BaseFee to use Instant for effective dates and period calculations.
- EPP Objects: Updated DomainInfoData, TransferResponse, and PollMessage objects to use Instant for event timestamps.
- Pricing Logic: DomainPricingLogic methods now accept Instant for cost calculations.

Additionally, DateTimeUtils was enhanced with Instant compatibility methods for plusMonths and minusMonths to safely handle leap years.

Redundant conversions between DateTime and Instant were eliminated throughout the flows and tests. DomainFlowUtils leverages Instant natively to avoid inline casting, and test assertions now utilize Truth's Instant subjects for cleaner validation.
nomulus-20260423-RC00
2026-04-22 16:44:47 +00:00
Juan Celhay
653704811b Add RDAP latency metrics (#3015)
* RDAP latency metrics

* refactor code

* refactors

* refactor

* record latency in RdapMetricInformation object

* lint

* fix tests

* add for tests

* formatter
nomulus-20260422-RC00
2026-04-21 19:00:25 +00:00
Weimin Yu
3de790fb00 Enable new errorprone checks and fix violations (#3018) nomulus-20260421-RC00 2026-04-20 21:03:36 +00:00
Weimin Yu
9d5650132b Add missing commands to RegistryToolComponent (#3017)
They worked in the past unexpectedly but no longer.
2026-04-20 18:03:03 +00:00
Ben McIlwain
30b507cc79 Update GEMINI.md with advanced Java idioms and source control instructions (#3016) 2026-04-20 16:57:53 +00:00
Ben McIlwain
ea1ad7901c Delete RemoveAllDomainContactsAction (#2872)
We no longer need this now that all domain contacts have been successfully
removed in sandbox and production, and additionally, we are removing all
contacts entirely soon enough.
2026-04-20 14:03:20 +00:00
Ben McIlwain
c427f2cc9f Migrate core temporal models and related entities to java.time.Instant (#3001)
This comprehensive refactor continues the migration from Joda-Time to java.time (Instant), focusing on core timestamp models, transition properties, and their integration across the codebase.

Key changes:
- Migrated CreateAutoTimestamp and UpdateAutoTimestamp to use Instant internally, providing Joda-Time bridge methods for backward compatibility.
- Updated TimedTransitionProperty to handle Instant-based transition maps and updated corresponding Hibernate UserTypes (TimedTransitionBaseUserType).
- Migrated GracePeriod, BillingBase, BillingEvent, PollMessage, and PendingActionNotificationResponse fields (e.g., expirationTime, eventTime) to Instant.
- Migrated additional core entities (DomainBase, Registrar, HostBase, LaunchNotice, BsaLabel, DomainTransactionRecord) to use Instant for registrationExpirationTime, lastTransferTime, creationTime, etc.
- Updated Tld and FeatureFlag models to use Instant for claimsPeriodEnd, bsaEnrollStartTime, and status transitions.
- Enhanced CLI tools and parameters (TransitionListParameter, InstantParameter, RequestParameters) to support Instant-based input and output.
- Updated EntityYamlUtils with custom Instant serializers/deserializers to maintain format consistency (e.g., .SSSZ precision) required for YAML-based tests.
- Implemented UtcInstantAdapter to ensure JAXB XML serialization maintains millisecond accuracy, matching legacy Joda-Time behavior.
- Resolved Hibernate 6 type mismatches in JPQL and Native queries by ensuring consistent use of Instant for comparisons.
- Updated GEMINI.md with project-specific engineering standards, including the 'one commit per PR' mandate, full-build validation requirement, and commit message style rules.
- Cleaned up unnecessary @JsonIgnore and @JsonProperty annotations that were previously added to methods with parameters or redundant fields.
- Refactored DateTimeUtils to use strongly-typed overloads and standardized naming (earliestOf, latestOf) while avoiding type erasure clashes.
- Cleaned up fully qualified calls to toDateTime and toInstant by adding static imports across core model and flow files.
- Refactored test suites to use clock.now() (Instant) instead of nowUtc() (DateTime) and removed custom Truth subjects in favor of standard assertions.
2026-04-20 14:03:20 +00:00
gbrodman
db733aa50f Fix XML parsing issues that occur on dependency update (#3012)
We want to make sure that we use the same XML factories no matter what,
so we use "newDefaultFactory" instead of "newFactory" (to avoid picking
up some random thing on the classpath).

This also fixes an exception that occurs if you haven't synced the
internal repo with the public repo.
nomulus-20260417-RC00 nomulus-20260418-RC00 nomulus-20260419-RC00 nomulus-20260420-RC00 proxy-20260420-RC00
2026-04-16 20:15:02 +00:00
Weimin Yu
409a7ba66f Change language and bytecode levels to Java 25 (#3009)
Release/Build tested in alpha.

Deployed in crash.
nomulus-20260416-RC00
2026-04-15 16:34:52 +00:00
Weimin Yu
e85f48beba Fix urs command after DomainUpdateFlow change (#3008)
PR 2930 forbids adding statuses that already exist on a domain.
This PR updates the uniform_rapid_suspension command to conform.

PR 2930 also forbids removing non-existent statuses, but it does
not apply to this command.
nomulus-20260414-RC00 nomulus-20260415-RC00
2026-04-13 20:52:29 +00:00
gbrodman
b78d12e73f Add a DelegatingReplicaJpaTransactionManager to handle multiple replicas (#3005)
This will allow us to spread the load across multiple Postgres replica
instances which should help with latency and stability.
nomulus-20260411-RC00 nomulus-20260412-RC00 nomulus-20260413-RC00 proxy-20260413-RC00
2026-04-10 20:46:06 +00:00
Weimin Yu
4a1d0609f3 Support Fee-1.0 XML parser in all environments (#3007)
Add the Fee-1.0 schema in production, allowing the requests with this
extension to be parsed. This allows us to test this extension before hand.

The announcement of this extension in greeting is controlled by a
feature flag in ProtocolDefinition.java. As long as it is not announced,
we do not expect real customers to use this extension.
nomulus-20260410-RC00
2026-04-09 20:45:36 +00:00
gbrodman
61b121f464 Fix Gradle issues when running devTool (#3006)
I think this may have been introduced as part of Gradle 9? Not sure why
it's not showing up in the remote builds but without this, I can't run
any "devTool" commands.

Note: the fixes were suggested by gemini-cli
2026-04-09 20:11:44 +00:00
Weimin Yu
074f78cfb3 Fix docker client api version on CloudBuild (#3004)
The docker engine provided by CloudBuild only supports up to 1.41.

Explicitly set API version for downloaded client for now.
nomulus-20260408-RC02 nomulus-20260409-RC00
2026-04-08 18:13:26 +00:00
Weimin Yu
7be5fe4c01 Fix Flyway script (#3003)
Removing the obsolete command line argument `community`.
nomulus-20260408-RC00 nomulus-20260408-RC01
2026-04-07 20:40:04 +00:00
Weimin Yu
1876e2c3e8 Fix Kyeth for Java 25 (#3002) nomulus-20260407-RC00 2026-04-06 21:42:11 +00:00
Ben McIlwain
49f14b5e1b Set clock precision to milliseconds for Datetime->Instant migration (#2999)
Our existing precision is milliseconds so we want to stick with that for
Instants. If we want to increase the precision globally after that we can do so
all in one go post-migration, but for now, it would be a bad thing to have mixed
precision going on just depending on whether a class happens to be migrated yet
or not.

This PR also migrates all existing DateTime.nowUtc() calls to use the Clock
interface, so that when they are migrated they will get the benefit of this
precision-setting as well.

BUG= http://b/496985355
nomulus-20260404-RC00 nomulus-20260405-RC00 nomulus-20260406-RC00 proxy-20260406-RC00
2026-04-03 20:38:26 +00:00
Weimin Yu
d2881b47dc Upgrade to Java 25 (#3000)
Error-prone introduced many more checks in Java 25. We fixed a few
and suppressed most. A follow-up bug is opened to clean this up.
An ai agent should be able to clean up most of it.

This PR is created with gemini-cli. Summary of experience:

* The good: AI caught most compatibility issues, and with permission,
  suppressed them through compiler flags and errorprone options.
  It also caught many versio references in scripts.

* Where it didn't shine:
  - It did not find and update the target version spec in the custome
    VKey annotation processor source file.
  - It did not flag eclipse-temurin:21 docker image for upgrade.
  - When running into failure, its first instinct is to disable checks
    e.g., -Werror instead of fixing them.
nomulus-20260403-RC00
2026-04-02 21:23:00 +00:00
gbrodman
9f3dfec118 Default to skipping optional domain RDAP events (#2995)
We don't need these, so there's no point in adding database load (but we
leave the option to include them in the future). Note that these are,
and were, only ever included for domains so we don't need to worry about
hosts.
2026-04-02 19:12:17 +00:00
Ben McIlwain
60e84e72d7 Begin migration of joda DateTime to java.time.Instant (#2992)
java.time has been around since Java 8 and was based on joda DateTime, so this
is an overdue migration.  We're migrating specifically to Instant in most places
rather than ZonedDateTime because we were always using DateTimes in UTC to
reference a specific instant, which is exactly what Instants are
for. ZonedDateTime set to UTC may still be useful in some places that are heavy
on date math (especially in tests).

There is a lot more work to be done after this, but I wanted to put together a
manual PR showing my overall approach for how to do the migration that I can
then hopefully follow along with AI to continue making these changes throughout
the codebase. The basic approach is to migrate a small number of methods at a
time, marking the old methods as @Deprecated when possible (not always possible
because of @InlineMe restrictions). This PR doesn't yet migrate any DateTime
fields in the model classes, so that's the one remaining type of refactor to
figure out after this. We won't be changing how any of the data is actually
stored in the database.

BUG= http://b/496985355
nomulus-20260401-RC00 nomulus-20260402-RC00
2026-03-31 20:30:29 +00:00
gbrodman
aedfdd47f1 Use caching for host loads in RDAP domain queries (#2996) 2026-03-31 15:57:56 +00:00
gbrodman
9ca75b2294 Install graphviz package in Cloud Build machines (#2997)
The bumped dependency uses the system utility rather than the Java
package, so we need to make sure that it's installed.
nomulus-20260331-RC00
2026-03-30 22:03:04 +00:00
Weimin Yu
03b3f9f5a0 Upgrade to Gradle 9 (#2993) 2026-03-30 17:15:55 +00:00
Pavlo Tkach
193ccb5ad3 Increase GKE resources for servicing pubapi (#2994) 2026-03-30 16:50:28 +00:00
gbrodman
a129a0dc21 Use the cheapest default token when multiple are available (#2990)
Previously we would just use the first one we found. This is a valid
behavior, but we want to change it so that we apply the cheapest default
if multiple are available (this way we avoid having to go back after the
fact and give refunds).
nomulus-20260328-RC00 nomulus-20260329-RC00 proxy-20260330-RC00 nomulus-20260330-RC00
2026-03-27 17:19:38 +00:00
Weimin Yu
3513364c97 Upgrade to Gradle 8.14.3 (#2988)
* More Gradle 9 preparations

Fix additional compatibility warnings after upgrading to Gradle 8.14.3
from 8.13.

* More Gradle 9 compatibility fix

More fixes after upgrading Gradle from 8.13 to 8.14.3.

Upgraded the gradle-license-report plugin, and handled config leaking
issues.

Researched using gemini web and manually applied the fixes. Gemini-cli
could not find the right solution.
nomulus-20260327-RC00
2026-03-26 17:55:05 +00:00
gbrodman
59b44b60df Update Hibernate and various other dependencies (#2986)
This ended up being wayyyy more complicated than expected due to
issues with Hibernate, various dependencies having conflicts with the
proto dependency version, and other breaking changes.

Notes:
- Hibernate 7 switches up the user type / converter system and for us,
  this means we must be / want to be more explicit with how we convert
and store things. For example, we need to add Postgres types to @Column
definitions.
- Hibernate 7.3 has an issue with generic MappedSuperclasses -- we have
  issues with BaseDomainLabelList. I'll investigate that, but for now
let's stick with 7.2.x
- H7 is more strict with annotations and prevents us from storing mapped
  superclasses embedded within other objects. This kinda makes sense but
makes the History objects a bit more difficult. We had to add "concrete"
embeddable DomainBase and HostBase objects that we can store/retrieve
from the DB.
- We convert some of the calls to "Query" to "TypedQuery" -- in
  Hibernate 8 / JPA 4.0 these will be super-deprecated and we'll need to
shift everything over, so this is necessary.
- You aren't supposed to put callback listeners on embedded entities
  (because it can be not obvious what's happening). We don't like that,
so we add our own annotations that are processed recursively for
embedded entities, so we get things like the update / create
timestamps.
- Hibernate doesn't allow for multiple converters to be auto-applied to
  the same "type" and it counts all VKey converters as one type.
Unfortunately, this means we have to explicitly mark each one.
- A bunch of other dependency changes were required to keep from having
  the proto 3/4 conflict
nomulus-20260326-RC00
2026-03-25 20:10:50 +00:00
Weimin Yu
8c9b38e6af Include fee:class in all Fee-1.0 responses (#2987)
Previously we omit the fee class in responses if the class is standard.

After a rereading of Section 3.7 of RFC 8748, we determined that the fee
class element should be included in all cases.

Note: the `collison` class now becomes `standard-collision`.
nomulus-20260324-RC01 nomulus-20260325-RC00
2026-03-24 14:39:16 +00:00
Weimin Yu
e5c0c27458 Prepare for Gradle 9 upgrade (#2985)
Refactor Gradle scripts to replace usages incompatible with Gradle 9.

PR prepared mostly with gemini-cli, with one issue (project.exec)
researched with gemini web and manually applied.

The actual upgrade to Gradle 9 will be in another PR.

Verified: none of the issues reported in build/reports/problems/problems-report.html
is related to Gradle 9.
nomulus-20260321-RC00 nomulus-20260322-RC00 proxy-20260323-RC00 nomulus-20260323-RC00 nomulus-20260324-RC00
2026-03-20 14:15:12 +00:00
Ben McIlwain
301a6681f5 Add test confirming that login works without contact obj URI (#2983)
This is a follow-up to PR #2954.
nomulus-20260320-RC00
2026-03-19 19:47:03 +00:00
Weimin Yu
2dd7cee3e5 Remove dangling shell script: rollback_tool (#2984)
Underlying python lib for AppEngine rollback is already gone.
nomulus-20260318-RC00 nomulus-20260319-RC00
2026-03-17 19:29:26 +00:00
Weimin Yu
497874eaa2 Revert "Add RST support in Sandbox (#2917)" (#2982)
PR 2917 added two `get(tld)` methods to ClaimsListDao and
SignedMarkRevocationList so that RST test TLDs can have separate claims
and smdr lists.

RST tests are completed and this functionality is no longer needed. we
are replaceing all invocations of the above to `get()`.
nomulus-20260317-RC00
2026-03-16 20:24:45 +00:00
gbrodman
f2cfd36b73 Always allow both TLS 1.2 and 1.3 (#2978)
The JDK version of SSL has long supported TLS v1.3 (since version 11) so
fortunately we can use TLS v1.3 regardless if which implementation of
SSL we're using.

We prefer OpenSSL in general so I'm not entirely sure why we were using
the JDK version of SSL on the proxy before, but this should work and be
a good idea regardless.

Tested on alpha by running

```
$ openssl s_client -connect epp.registryalpha.foo:700 -tls1_3 -ciphersuites "TLS_AES_128_GCM_SHA256"
```

Previously we'd get a failure, now it returns the proper cert data.
nomulus-20260310-RC00 nomulus-20260311-RC00 nomulus-20260312-RC00 nomulus-20260313-RC00 nomulus-20260314-RC00 nomulus-20260315-RC00 proxy-20260316-RC00 nomulus-20260316-RC00
2026-03-09 22:51:17 +00:00
Weimin Yu
8ea5fe3774 Enable Fee-1.0 extension in prod (#2975)
This extension has been in Sandbox for more than a month.
nomulus-20260306-RC00 nomulus-20260307-RC00 nomulus-20260308-RC00 nomulus-20260309-RC00 proxy-20260309-RC00
2026-03-05 20:22:33 +00:00
gbrodman
9544d70048 Remove whois networking from the proxy (#2976) nomulus-20260305-RC00 2026-03-04 20:14:42 +00:00
gbrodman
50a639937a Remove Contact and ContactHistory SQL tables (#2977)
We no longer use or reference these anywhere in the codebase.
2026-03-04 18:49:06 +00:00
gbrodman
72016b1e5f Update more of the documentation (#2974)
We should be at least at a "good enough" state after this -- I'm sure
there are many updates we could make that would improve the
documentation but this is definitely much improved from before and
should hopefully be good enough to get people started.
nomulus-20260304-RC00
2026-03-03 20:25:30 +00:00
gbrodman
25fcef8a5b Fix typo in a command (#2973) nomulus-20260303-RC00 2026-03-02 18:15:44 +00:00
Pavlo Tkach
186dd80567 Enable password reset for registrars (#2971) nomulus-20260228-RC00 nomulus-20260301-RC00 nomulus-20260302-RC00 proxy-20260302-RC00 2026-02-27 20:02:51 +00:00
gbrodman
c52983fb61 Update some Nomulus documentation (#2970)
This doesn't update everything -- it leaves out some of the more
complicated changes (architecture, code-structure, configuration,
install, and proxy-setup). Those will require more complete rewrites, so
I'm punting them to a future PR.
nomulus-20260227-RC00
2026-02-26 19:05:22 +00:00
Weimin Yu
8a3ab00e58 Apply Fee tag normalization in production (#2968)
Feature verified in Sandbox.
nomulus-20260226-RC00
2026-02-25 20:02:37 +00:00
Pavlo Tkach
49df9c325a Update angular @21 (#2965) nomulus-20260225-RC00 2026-02-24 20:08:27 +00:00
gbrodman
929dccbfe3 Remove the concept of a TransferData abstract class (#2966)
The only type of thing that can be transferred now is a domain, so
there's no point in having this abstract class / redirection.

This does not include deletion of the contact-response-related XML
classes; that can come next.
nomulus-20260224-RC00
2026-02-23 16:08:27 +00:00
gbrodman
ee8746c857 Remove Contact and ContactHistory Java objects and related code (#2964)
This doesn't remove everything -- there are still other contact-related
objects that we'll need to remove (e.g.
ContactPendingActionNotificationResponse) and simplifications we'll need to make
(e.g. only domains can be transferred now, so all transfer data can move
there instead of being generic)

But this removes the bulk of the remaining contact-related code. We'll
keep around the XML request objects, since it's still nice to route them
to the appropriate (exception-throwing but logging) flow class.
nomulus-20260221-RC00 nomulus-20260222-RC00 nomulus-20260223-RC00 proxy-20260223-RC00
2026-02-20 16:22:29 +00:00