mirror of
https://github.com/versity/versitygw.git
synced 2026-08-18 21:26:27 +00:00
Closes #1640 Add a standalone AWS IAM Query API implementation for managing IAM users through standard AWS SDKs and the AWS CLI. Server usage Start the IAM server with internal file-backed storage: mkdir -p /tmp/versitygw-iam ./versitygw --port 127.0.0.1:7070 --access user --secret pass iam --dir /tmp/versitygw-iam Start the IAM server with Vault KV v2 storage using AppRole: VGW_IAM_VAULT_ROLE_SECRET=<role-secret> ./versitygw --port 127.0.0.1:7070 --access user --secret pass iam --vault-endpoint-url http://127.0.0.1:8200 --vault-auth-method approle --vault-role-id <role-id> --vault-mount-path kv --vault-secret-storage-path iam Vault authentication also supports root tokens, separate authentication and secret-storage namespaces, custom mount paths, server certificate validation, and mutual TLS client certificates. Configure the AWS CLI credentials used by the IAM server: export AWS_ACCESS_KEY_ID=user export AWS_SECRET_ACCESS_KEY=pass export AWS_DEFAULT_REGION=us-east-1 Implemented IAM actions CreateUser creates an IAM user with an AWS-compatible ARN, generated AIDA user ID, creation timestamp, optional path, and tags. It validates usernames, paths, tag limits, reserved tag prefixes, duplicate tag keys, and existing users. aws --endpoint-url http://127.0.0.1:7070 iam create-user --user-name bob aws --endpoint-url http://127.0.0.1:7070 iam create-user --user-name bob --path /engineering/ --tags Key=team,Value=storage GetUser returns a stored user or the root identity when requested without a username through the IAM Query API. aws --endpoint-url http://127.0.0.1:7070 iam get-user --user-name bob ListUsers returns users in deterministic username order and supports path filtering, marker-based pagination, and MaxItems limits. aws --endpoint-url http://127.0.0.1:7070 iam list-users aws --endpoint-url http://127.0.0.1:7070 iam list-users --path-prefix /engineering/ --max-items 100 UpdateUser updates the username and/or path, recalculates the user ARN, and rejects conflicts with existing users. aws --endpoint-url http://127.0.0.1:7070 iam update-user --user-name bob --new-user-name robert --new-path /platform/ DeleteUser permanently removes an IAM user and returns AWS-compatible errors for missing users. aws --endpoint-url http://127.0.0.1:7070 iam delete-user --user-name robert IAM protocol and authentication - Support the AWS IAM Query protocol version 2010-05-08 over GET and POST form requests. - Return AWS-compatible XML responses, error documents, status codes, request IDs, user metadata, and pagination fields. - Authenticate root credentials with AWS Signature Version 4 for the IAM service in us-east-1. - Support both Authorization-header and query-string SigV4 authentication. - Validate credential scope, signed headers, timestamps, clock skew, content length, signatures, and unsupported signature or session-token modes. - Add IAM-specific validation and error mapping for malformed requests, invalid actions, duplicate entities, missing users, throttling, and internal failures. Storage implementations - Add an internal JSON-backed store using iam.json and iam.json.backup with atomic temporary-file replacement, concurrent access protection, stable ordering, pagination, and persistence across restarts. - Add a Vault KV v2 store with one secret per user, CAS-based duplicate protection, permanent deletion, AppRole reauthentication, namespace support, configurable authentication and KV mounts, root-token authentication, and TLS/mTLS configuration. - Introduce a common Storer interface and require exactly one storage backend to be configured. Server and embedding support - Register the new `versitygw iam` command with environment-variable and CLI configuration for both storage backends. - Add `embedgw.RunIAMAPI` and `IAMConfig` for embedding the IAM service in Go applications. Gateway-level internal packages - Add `internal/iamstore` as a reusable generic file-backed IAM persistence engine and migrate the existing gateway internal IAM service to it. - Add `internal/sigv4auth` for shared SigV4 header and presigned-query parsing, canonical request generation, signature verification, and structured authentication errors. - Refactor the S3 authentication paths to use the shared SigV4 implementation while preserving S3-specific error responses. - Add `internal/httpctx` for shared Fiber context keys and AWS-style request ID handling. - Add `internal/routekit` for shared query, form, and header route matchers. - Add `internal/netutil` for reusable certificate storage, hostname-aware listeners, multi-address serving, TLS listeners, and UNIX socket handling. - Update the custom SigV4 signer to honor an explicitly supplied signed-header list so unrelated headers do not alter IAM signatures. Testing and CI - Add AWS IAM SDK-based integration coverage for all supported user actions, header authentication, query authentication, validation, errors, filtering, and pagination. - Split standalone IAM tests into `versitygw test iam` and retain existing gateway IAM tests under `versitygw test gw-iam`. - Add unit coverage for controllers, authentication, routing, storage, embedding, listeners, request matching, persistence, and signing behavior. - Add `runiamtests.sh` to exercise internal storage over HTTP and HTTPS plus Vault storage through AppRole. - Add a dedicated IAM functional-test workflow with a Vault service and merged runtime coverage reporting. - Include the IAM test runner in shellcheck and add the AWS IAM SDK dependency.
232 lines
6.1 KiB
Go
232 lines
6.1 KiB
Go
// Copyright 2026 Versity Software
|
|
// This file is licensed under the Apache License, Version 2.0
|
|
// (the "License"); you may not use this file except in compliance
|
|
// with the License. You may obtain a copy of the License at
|
|
//
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
//
|
|
// Unless required by applicable law or agreed to in writing, software
|
|
// distributed under the License is distributed on an "AS IS" BASIS,
|
|
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
// See the License for the specific language governing permissions and
|
|
// limitations under the License.
|
|
|
|
package sigv4auth
|
|
|
|
import (
|
|
"crypto/sha256"
|
|
"encoding/hex"
|
|
"fmt"
|
|
"strings"
|
|
"time"
|
|
"unicode"
|
|
)
|
|
|
|
const (
|
|
AlgorithmHMACSHA256 = "AWS4-HMAC-SHA256"
|
|
Terminal = "aws4_request"
|
|
ServiceS3 = "s3"
|
|
ServiceIAM = "iam"
|
|
|
|
ISO8601Format = "20060102T150405Z"
|
|
YYYYMMDD = "20060102"
|
|
)
|
|
|
|
type ParseErrorKind string
|
|
|
|
const (
|
|
ErrInvalidAuthorizationHeader ParseErrorKind = "invalid_authorization_header"
|
|
ErrUnsupportedAuthorizationVersion ParseErrorKind = "unsupported_authorization_version"
|
|
ErrInvalidAuthorizationType ParseErrorKind = "invalid_authorization_type"
|
|
ErrMissingComponents ParseErrorKind = "missing_components"
|
|
ErrMissingCredential ParseErrorKind = "missing_credential"
|
|
ErrMissingSignedHeaders ParseErrorKind = "missing_signed_headers"
|
|
ErrMissingSignature ParseErrorKind = "missing_signature"
|
|
ErrMalformedComponent ParseErrorKind = "malformed_component"
|
|
ErrMalformedCredential ParseErrorKind = "malformed_credential"
|
|
ErrIncorrectService ParseErrorKind = "incorrect_service"
|
|
ErrIncorrectTerminal ParseErrorKind = "incorrect_terminal"
|
|
ErrInvalidDateFormat ParseErrorKind = "invalid_date_format"
|
|
)
|
|
|
|
type ParseError struct {
|
|
Kind ParseErrorKind
|
|
Input string
|
|
Value string
|
|
Expected string
|
|
Actual string
|
|
}
|
|
|
|
func (e *ParseError) Error() string {
|
|
if e == nil {
|
|
return ""
|
|
}
|
|
switch e.Kind {
|
|
case ErrIncorrectService, ErrIncorrectTerminal:
|
|
return fmt.Sprintf("sigv4 %s: expected %q, got %q", e.Kind, e.Expected, e.Actual)
|
|
case ErrInvalidAuthorizationType, ErrMalformedComponent, ErrInvalidDateFormat:
|
|
return fmt.Sprintf("sigv4 %s: %q", e.Kind, e.Value)
|
|
default:
|
|
return string(e.Kind)
|
|
}
|
|
}
|
|
|
|
// AuthData is the parsed authorization data from an AWS SigV4 Authorization header.
|
|
type AuthData struct {
|
|
Algorithm string
|
|
Access string
|
|
Region string
|
|
Service string
|
|
SignedHeaders string
|
|
Signature string
|
|
Date string
|
|
}
|
|
|
|
type CredentialsScope struct {
|
|
Access string
|
|
Date string
|
|
Region string
|
|
Service string
|
|
}
|
|
|
|
// HexBytes returns the hex byte representation used by AWS-style diagnostic
|
|
// signature mismatch errors.
|
|
func HexBytes(s string) string {
|
|
b := []byte(s)
|
|
|
|
parts := make([]string, len(b))
|
|
for i, v := range b {
|
|
parts[i] = fmt.Sprintf("%02x", v)
|
|
}
|
|
|
|
return strings.Join(parts, " ")
|
|
}
|
|
|
|
func PayloadSHA256Hex(payload []byte) string {
|
|
hashedPayload := sha256.Sum256(payload)
|
|
return hex.EncodeToString(hashedPayload[:])
|
|
}
|
|
|
|
// ParseAuthorization parses and validates an AWS SigV4 Authorization header.
|
|
// The credential scope service must match expectedService.
|
|
func ParseAuthorization(authorization, expectedService string) (AuthData, error) {
|
|
a := AuthData{}
|
|
|
|
authParts := strings.SplitN(authorization, " ", 2)
|
|
for i, el := range authParts {
|
|
if strings.Contains(el, " ") {
|
|
authParts[i] = removeSpace(el)
|
|
}
|
|
}
|
|
|
|
if len(authParts) < 2 {
|
|
return a, &ParseError{Kind: ErrInvalidAuthorizationHeader, Input: authorization}
|
|
}
|
|
|
|
algo := authParts[0]
|
|
if algo == "AWS" {
|
|
return a, &ParseError{Kind: ErrUnsupportedAuthorizationVersion, Value: algo}
|
|
}
|
|
if algo != AlgorithmHMACSHA256 {
|
|
return a, &ParseError{Kind: ErrInvalidAuthorizationType, Value: algo}
|
|
}
|
|
|
|
kvPairs := strings.Split(authParts[1], ",")
|
|
if len(kvPairs) != 3 {
|
|
return a, &ParseError{Kind: ErrMissingComponents, Input: authorization}
|
|
}
|
|
|
|
var access, region, service, signedHeaders, signature, date string
|
|
for i, kv := range kvPairs {
|
|
keyValue := strings.Split(kv, "=")
|
|
if len(keyValue) != 2 {
|
|
return a, &ParseError{Kind: ErrMalformedComponent, Value: kv}
|
|
}
|
|
key, value := keyValue[0], keyValue[1]
|
|
switch i {
|
|
case 0:
|
|
if key != "Credential" {
|
|
return a, &ParseError{Kind: ErrMissingCredential}
|
|
}
|
|
case 1:
|
|
if key != "SignedHeaders" {
|
|
return a, &ParseError{Kind: ErrMissingSignedHeaders}
|
|
}
|
|
case 2:
|
|
if key != "Signature" {
|
|
return a, &ParseError{Kind: ErrMissingSignature}
|
|
}
|
|
}
|
|
|
|
switch key {
|
|
case "Credential":
|
|
creds, err := ParseCredentials(value, expectedService)
|
|
if err != nil {
|
|
return a, err
|
|
}
|
|
access = creds.Access
|
|
date = creds.Date
|
|
region = creds.Region
|
|
service = creds.Service
|
|
case "SignedHeaders":
|
|
signedHeaders = value
|
|
case "Signature":
|
|
signature = value
|
|
}
|
|
}
|
|
|
|
return AuthData{
|
|
Algorithm: algo,
|
|
Access: access,
|
|
Region: region,
|
|
Service: service,
|
|
SignedHeaders: signedHeaders,
|
|
Signature: signature,
|
|
Date: date,
|
|
}, nil
|
|
}
|
|
|
|
func ParseCredentials(input, expectedService string) (*CredentialsScope, error) {
|
|
creds := strings.Split(input, "/")
|
|
if len(creds) != 5 {
|
|
return nil, &ParseError{Kind: ErrMalformedCredential, Input: input}
|
|
}
|
|
if creds[3] != expectedService {
|
|
return nil, &ParseError{
|
|
Kind: ErrIncorrectService,
|
|
Input: input,
|
|
Expected: expectedService,
|
|
Actual: creds[3],
|
|
}
|
|
}
|
|
if creds[4] != Terminal {
|
|
return nil, &ParseError{
|
|
Kind: ErrIncorrectTerminal,
|
|
Input: input,
|
|
Expected: Terminal,
|
|
Actual: creds[4],
|
|
}
|
|
}
|
|
if _, err := time.Parse(YYYYMMDD, creds[1]); err != nil {
|
|
return nil, &ParseError{Kind: ErrInvalidDateFormat, Input: input, Value: creds[1]}
|
|
}
|
|
|
|
return &CredentialsScope{
|
|
Access: creds[0],
|
|
Date: creds[1],
|
|
Region: creds[2],
|
|
Service: creds[3],
|
|
}, nil
|
|
}
|
|
|
|
func removeSpace(str string) string {
|
|
var b strings.Builder
|
|
b.Grow(len(str))
|
|
for _, ch := range str {
|
|
if !unicode.IsSpace(ch) {
|
|
b.WriteRune(ch)
|
|
}
|
|
}
|
|
return b.String()
|
|
}
|