Files
versitygw/tests/integration/iam_update_user.go
T
niksis02 3227a629dc feat: add AWS-compatible standalone IAM service
Closes #1640

Add a standalone AWS IAM Query API implementation for managing IAM users through standard AWS SDKs and the AWS CLI.

Server usage

Start the IAM server with internal file-backed storage:

    mkdir -p /tmp/versitygw-iam
    ./versitygw --port 127.0.0.1:7070 --access user --secret pass iam --dir /tmp/versitygw-iam

Start the IAM server with Vault KV v2 storage using AppRole:

    VGW_IAM_VAULT_ROLE_SECRET=<role-secret> ./versitygw --port 127.0.0.1:7070 --access user --secret pass iam --vault-endpoint-url http://127.0.0.1:8200 --vault-auth-method approle --vault-role-id <role-id> --vault-mount-path kv --vault-secret-storage-path iam

Vault authentication also supports root tokens, separate authentication and secret-storage namespaces, custom mount paths, server certificate validation, and mutual TLS client certificates.

Configure the AWS CLI credentials used by the IAM server:

    export AWS_ACCESS_KEY_ID=user
    export AWS_SECRET_ACCESS_KEY=pass
    export AWS_DEFAULT_REGION=us-east-1

Implemented IAM actions

CreateUser creates an IAM user with an AWS-compatible ARN, generated AIDA user ID, creation timestamp, optional path, and tags. It validates usernames, paths, tag limits, reserved tag prefixes, duplicate tag keys, and existing users.

    aws --endpoint-url http://127.0.0.1:7070 iam create-user --user-name bob

    aws --endpoint-url http://127.0.0.1:7070 iam create-user --user-name bob --path /engineering/ --tags Key=team,Value=storage

GetUser returns a stored user or the root identity when requested without a username through the IAM Query API.

    aws --endpoint-url http://127.0.0.1:7070 iam get-user --user-name bob

ListUsers returns users in deterministic username order and supports path filtering, marker-based pagination, and MaxItems limits.

    aws --endpoint-url http://127.0.0.1:7070 iam list-users

    aws --endpoint-url http://127.0.0.1:7070 iam list-users --path-prefix /engineering/ --max-items 100

UpdateUser updates the username and/or path, recalculates the user ARN, and rejects conflicts with existing users.

    aws --endpoint-url http://127.0.0.1:7070 iam update-user --user-name bob --new-user-name robert --new-path /platform/

DeleteUser permanently removes an IAM user and returns AWS-compatible errors for missing users.

    aws --endpoint-url http://127.0.0.1:7070 iam delete-user --user-name robert

IAM protocol and authentication

- Support the AWS IAM Query protocol version 2010-05-08 over GET and POST form requests.
- Return AWS-compatible XML responses, error documents, status codes, request IDs, user metadata, and pagination fields.
- Authenticate root credentials with AWS Signature Version 4 for the IAM service in us-east-1.
- Support both Authorization-header and query-string SigV4 authentication.
- Validate credential scope, signed headers, timestamps, clock skew, content length, signatures, and unsupported signature or session-token modes.
- Add IAM-specific validation and error mapping for malformed requests, invalid actions, duplicate entities, missing users, throttling, and internal failures.

Storage implementations

- Add an internal JSON-backed store using iam.json and iam.json.backup with atomic temporary-file replacement, concurrent access protection, stable ordering, pagination, and persistence across restarts.
- Add a Vault KV v2 store with one secret per user, CAS-based duplicate protection, permanent deletion, AppRole reauthentication, namespace support, configurable authentication and KV mounts, root-token authentication, and TLS/mTLS configuration.
- Introduce a common Storer interface and require exactly one storage backend to be configured.

Server and embedding support

- Register the new `versitygw iam` command with environment-variable and CLI configuration for both storage backends.
- Add `embedgw.RunIAMAPI` and `IAMConfig` for embedding the IAM service in Go applications.

Gateway-level internal packages

- Add `internal/iamstore` as a reusable generic file-backed IAM persistence engine and migrate the existing gateway internal IAM service to it.
- Add `internal/sigv4auth` for shared SigV4 header and presigned-query parsing, canonical request generation, signature verification, and structured authentication errors.
- Refactor the S3 authentication paths to use the shared SigV4 implementation while preserving S3-specific error responses.
- Add `internal/httpctx` for shared Fiber context keys and AWS-style request ID handling.
- Add `internal/routekit` for shared query, form, and header route matchers.
- Add `internal/netutil` for reusable certificate storage, hostname-aware listeners, multi-address serving, TLS listeners, and UNIX socket handling.
- Update the custom SigV4 signer to honor an explicitly supplied signed-header list so unrelated headers do not alter IAM signatures.

Testing and CI

- Add AWS IAM SDK-based integration coverage for all supported user actions, header authentication, query authentication, validation, errors, filtering, and pagination.
- Split standalone IAM tests into `versitygw test iam` and retain existing gateway IAM tests under `versitygw test gw-iam`.
- Add unit coverage for controllers, authentication, routing, storage, embedding, listeners, request matching, persistence, and signing behavior.
- Add `runiamtests.sh` to exercise internal storage over HTTP and HTTPS plus Vault storage through AppRole.
- Add a dedicated IAM functional-test workflow with a Vault service and merged runtime coverage reporting.
- Include the IAM test runner in shellcheck and add the AWS IAM SDK dependency.
2026-08-15 17:38:14 +04:00

202 lines
7.3 KiB
Go

// Copyright 2026 Versity Software
// This file is licensed under the Apache License, Version 2.0
// (the "License"); you may not use this file except in compliance
// with the License. You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
package integration
import (
"context"
"fmt"
"strings"
"github.com/aws/aws-sdk-go-v2/aws"
awsmiddleware "github.com/aws/aws-sdk-go-v2/aws/middleware"
"github.com/aws/aws-sdk-go-v2/service/iam"
"github.com/versity/versitygw/iamapi/iamerr"
)
func IAMUpdateUser_invalid_user_name(s *S3Conf) error {
testName := "IAMUpdateUser_invalid_user_name"
return iamActionHandler(s, testName, func(client *iam.Client) error {
_, err := updateIAMUser(client, &iam.UpdateUserInput{UserName: aws.String("invalid/user")})
return checkIAMApiErr(err, iamerr.InvalidUserName("userName"))
})
}
func IAMUpdateUser_long_user_name(s *S3Conf) error {
testName := "IAMUpdateUser_long_user_name"
return iamActionHandler(s, testName, func(client *iam.Client) error {
_, err := updateIAMUser(client, &iam.UpdateUserInput{UserName: aws.String(strings.Repeat("a", 129))})
return checkIAMApiErr(err, iamerr.UserNameTooLong("userName", 128))
})
}
func IAMUpdateUser_invalid_new_user_name(s *S3Conf) error {
testName := "IAMUpdateUser_invalid_new_user_name"
return iamActionHandler(s, testName, func(client *iam.Client) error {
_, err := updateIAMUser(client, &iam.UpdateUserInput{
UserName: aws.String("asdfadsf"),
NewUserName: aws.String("invalid/user"),
})
return checkIAMApiErr(err, iamerr.InvalidUserName("newUserName"))
})
}
func IAMUpdateUser_long_new_user_name(s *S3Conf) error {
testName := "IAMUpdateUser_long_new_user_name"
return iamActionHandler(s, testName, func(client *iam.Client) error {
_, err := updateIAMUser(client, &iam.UpdateUserInput{
UserName: aws.String("asdfadsf"),
NewUserName: aws.String(strings.Repeat("a", 65)),
})
return checkIAMApiErr(err, iamerr.UserNameTooLong("newUserName", 64))
})
}
func IAMUpdateUser_non_existing_user(s *S3Conf) error {
testName := "IAMUpdateUser_non_existing_user"
return iamActionHandler(s, testName, func(client *iam.Client) error {
const userName = "asdfadsf"
_, err := updateIAMUser(client, &iam.UpdateUserInput{UserName: aws.String(userName)})
return checkIAMApiErr(err, iamerr.NoSuchEntityUser(userName))
})
}
func IAMUpdateUser_invalid_new_path(s *S3Conf) error {
testName := "IAMUpdateUser_invalid_new_path"
return iamActionHandler(s, testName, func(client *iam.Client) error {
_, err := updateIAMUser(client, &iam.UpdateUserInput{
UserName: aws.String("asdfadsf"),
NewPath: aws.String("invalid"),
})
return checkIAMApiErr(err, iamerr.InvalidPath("newPath"))
})
}
func IAMUpdateUser_long_new_path(s *S3Conf) error {
testName := "IAMUpdateUser_long_new_path"
return iamActionHandler(s, testName, func(client *iam.Client) error {
_, err := updateIAMUser(client, &iam.UpdateUserInput{
UserName: aws.String("asdfadsf"),
NewPath: aws.String("/" + strings.Repeat("a", 511) + "/"),
})
return checkIAMApiErr(err, iamerr.PathTooLong("newPath", 512))
})
}
func IAMUpdateUser_new_user_name_already_exists(s *S3Conf) error {
testName := "IAMUpdateUser_new_user_name_already_exists"
return iamActionHandler(s, testName, func(client *iam.Client) error {
userName := newIAMUserName()
existingUserName := newIAMUserName()
if _, err := createIAMUser(client, &iam.CreateUserInput{UserName: &userName}); err != nil {
return err
}
if _, err := createIAMUser(client, &iam.CreateUserInput{UserName: &existingUserName}); err != nil {
deleteErr := deleteIAMUser(client, userName)
if deleteErr != nil {
return fmt.Errorf("create second user: %v; delete first user: %w", err, deleteErr)
}
return err
}
_, updateErr := updateIAMUser(client, &iam.UpdateUserInput{
UserName: &userName,
NewUserName: &existingUserName,
})
checkErr := checkIAMApiErr(updateErr, iamerr.EntityAlreadyExistsUser(existingUserName))
firstDeleteErr := deleteIAMUser(client, userName)
secondDeleteErr := deleteIAMUser(client, existingUserName)
if checkErr != nil {
return checkErr
}
if firstDeleteErr != nil {
return firstDeleteErr
}
return secondDeleteErr
})
}
func IAMUpdateUser_success(s *S3Conf) error {
testName := "IAMUpdateUser_success"
return iamActionHandler(s, testName, func(client *iam.Client) error {
userName := newIAMUserName()
created, err := createIAMUser(client, &iam.CreateUserInput{UserName: &userName})
if err != nil {
return err
}
newUserName := newIAMUserName()
newPath := "/updated/"
out, err := updateIAMUser(client, &iam.UpdateUserInput{
UserName: &userName,
NewUserName: &newUserName,
NewPath: &newPath,
})
if err != nil {
deleteErr := deleteIAMUser(client, userName)
if deleteErr != nil {
return fmt.Errorf("update user: %v; delete user: %w", err, deleteErr)
}
return err
}
checkErr := func() error {
if out == nil {
return fmt.Errorf("expected UpdateUser output")
}
if requestID, ok := awsmiddleware.GetRequestIDMetadata(out.ResultMetadata); !ok || requestID == "" {
return fmt.Errorf("expected UpdateUser response request id")
}
ctx, cancel := context.WithTimeout(context.Background(), shortTimeout)
updated, err := client.GetUser(ctx, &iam.GetUserInput{UserName: &newUserName})
cancel()
if err != nil {
return err
}
if updated == nil || updated.User == nil || created == nil || created.User == nil {
return fmt.Errorf("expected created and updated users")
}
if aws.ToString(updated.User.UserName) != newUserName || aws.ToString(updated.User.Path) != newPath {
return fmt.Errorf("expected updated user name/path %q/%q, instead got %q/%q", newUserName, newPath, aws.ToString(updated.User.UserName), aws.ToString(updated.User.Path))
}
expectedARN := "arn:aws:iam::000000000000:user" + newPath + newUserName
if aws.ToString(updated.User.Arn) != expectedARN {
return fmt.Errorf("expected updated user ARN %q, instead got %q", expectedARN, aws.ToString(updated.User.Arn))
}
if updated.User.CreateDate == nil || created.User.CreateDate == nil {
return fmt.Errorf("expected created and updated user create dates")
}
if aws.ToString(updated.User.UserId) != aws.ToString(created.User.UserId) || !updated.User.CreateDate.Equal(*created.User.CreateDate) {
return fmt.Errorf("expected UpdateUser to preserve user id and create date")
}
ctx, cancel = context.WithTimeout(context.Background(), shortTimeout)
defer cancel()
_, err = client.GetUser(ctx, &iam.GetUserInput{UserName: &userName})
return checkIAMApiErr(err, iamerr.NoSuchEntityUser(userName))
}()
deleteErr := deleteIAMUser(client, newUserName)
if checkErr != nil {
return checkErr
}
return deleteErr
})
}
func updateIAMUser(client *iam.Client, input *iam.UpdateUserInput) (*iam.UpdateUserOutput, error) {
ctx, cancel := context.WithTimeout(context.Background(), shortTimeout)
defer cancel()
return client.UpdateUser(ctx, input)
}