Commit Graph
30 Commits
Author SHA1 Message Date
chrislu 1b64a0f034 add generic logging and implement it for balancing task 2025-07-27 11:04:51 -07:00
chrislu 7c4e44875f refactor 2025-07-27 02:10:03 -07:00
chrislu 74146870c5 remove v2 reference 2025-07-27 00:50:17 -07:00
chrislu 1b40075d2a use new framework 2025-07-27 00:43:02 -07:00
chrislu 165cf79b35 refactor 2025-07-27 00:28:15 -07:00
chrislu 49338df3e2 remove unused 2025-07-26 23:48:42 -07:00
chrislu 8187020096 each task register its schema 2025-07-26 22:31:23 -07:00
chrislu b80971e85e refactor to use BaseUIProvider 2025-07-26 22:22:50 -07:00
chrislu f7140d4577 reduce duplication 2025-07-26 22:16:24 -07:00
chrislu 6659c213c3 config 2025-07-26 22:06:31 -07:00
chrislu 638ab0d6f4 Update ui.go 2025-07-26 19:06:31 -07:00
chrislu 965ec4f51b garbage percentage threshold 2025-07-26 13:28:52 -07:00
chrislu 019de6dc7a interval field UI component 2025-07-26 09:22:59 -07:00
chrislu 3b2c75d2bd ec is mostly working now
* distribution of ec shards needs improvement
* need configuration to enable ec
2025-07-25 22:02:28 -07:00
chrislu 379d585cc7 local copy, ec. Need to distribute. 2025-07-25 20:49:48 -07:00
chrislu 41cbbefb0b move ec task logic 2025-07-25 16:49:12 -07:00
chrislu ffd91383c6 worker can run ec work and report status
but:
1. one volume should not be repeatedly worked on.
2. ec shards needs to be distributed and source data should be deleted.
2025-07-25 15:24:31 -07:00
chrislu 19df3fcc5d worker register itself first 2025-07-25 13:22:33 -07:00
chrislu a3d727034a clean up logs 2025-07-25 13:16:59 -07:00
chrislu c557ec0062 worker reconnect to admin 2025-07-25 02:12:51 -07:00
chrislu afdca513ac sticky worker id 2025-07-25 01:59:22 -07:00
chrislu 01e8cc4600 worker retries connecting to admin 2025-07-24 23:24:01 -07:00
chrislu 16a29b57f9 compiles, detection uses volumeSizeLimitMB from master 2025-07-24 22:37:09 -07:00
chrislu a1966e9692 working worker and admin. Task detection is not working yet. 2025-07-24 21:58:08 -07:00
chrislu cd28ce7786 admin start wtih grpc port. worker has its own working directory 2025-07-24 19:43:10 -07:00
chrislu a4cf55a741 remove "enhanced" reference 2025-07-24 08:07:50 -07:00
chrislu 30ad65bb5f integration test. ec worker task 2025-07-24 07:50:03 -07:00
Chris LuandGitHub 69553e5ba6 convert error fromating to %w everywhere (#6995) 2025-07-16 23:39:27 -07:00
Chris LuandGitHub 687a6a6c1d Admin UI: Add policies (#6968)
* add policies to UI, accessing filer directly

* view, edit policies

* add back buttons for "users" page

* remove unused

* fix ui dark mode when modal is closed

* bucket view details button

* fix browser buttons

* filer action button works

* clean up masters page

* fix volume servers action buttons

* fix collections page action button

* fix properties page

* more obvious

* fix directory creation file mode

* Update file_browser_handlers.go

* directory permission
2025-07-12 01:13:11 -07:00
Chris LuandGitHub aa66852304 Admin UI add maintenance menu (#6944)
* add ui for maintenance

* valid config loading. fix workers page.

* refactor

* grpc between admin and workers

* add a long-running bidirectional grpc call between admin and worker
* use the grpc call to heartbeat
* use the grpc call to communicate
* worker can remove the http client
* admin uses http port + 10000 as its default grpc port

* one task one package

* handles connection failures gracefully with exponential backoff

* grpc with insecure tls

* grpc with optional tls

* fix detecting tls

* change time config from nano seconds to seconds

* add tasks with 3 interfaces

* compiles reducing hard coded

* remove a couple of tasks

* remove hard coded references

* reduce hard coded values

* remove hard coded values

* remove hard coded from templ

* refactor maintenance package

* fix import cycle

* simplify

* simplify

* auto register

* auto register factory

* auto register task types

* self register types

* refactor

* simplify

* remove one task

* register ui

* lazy init executor factories

* use registered task types

* DefaultWorkerConfig remove hard coded task types

* remove more hard coded

* implement get maintenance task

* dynamic task configuration

* "System Settings" should only have system level settings

* adjust menu for tasks

* ensure menu not collapsed

* render job configuration well

* use templ for ui of task configuration

* fix ordering

* fix bugs

* saving duration in seconds

* use value and unit for duration

* Delete WORKER_REFACTORING_PLAN.md

* Delete maintenance.json

* Delete custom_worker_example.go

* remove address from workers

* remove old code from ec task

* remove creating collection button

* reconnect with exponential backoff

* worker use security.toml

* start admin server with tls info from security.toml

* fix "weed admin" cli description
2025-07-06 13:57:02 -07:00