summaryrefslogtreecommitdiff
path: root/procedures/runv1.md
diff options
context:
space:
mode:
Diffstat (limited to 'procedures/runv1.md')
-rw-r--r--procedures/runv1.md107
1 files changed, 107 insertions, 0 deletions
diff --git a/procedures/runv1.md b/procedures/runv1.md
new file mode 100644
index 0000000..6c78a31
--- /dev/null
+++ b/procedures/runv1.md
@@ -0,0 +1,107 @@
+๐Ÿ“œ Genesis Radio Mission Control Runbook (v1)
+๐Ÿ›ก๏ธ Genesis Radio Mission Control: Ops Runbook
+
+ Purpose:
+ Quickly diagnose and fix common Genesis Radio infrastructure issues without guesswork, even under pressure.
+
+๐Ÿšจ If a Mount is Lost (Q:\ or R:)
+
+Symptoms:
+
+ Station playback errors
+
+ Skipping or dead air after a Station ID
+
+ Log shows: Audio Engine Timeout on Q:\ or R:\ paths
+
+Immediate Actions:
+
+ Check if drives Q:\ and R:\ are visible in Windows Explorer.
+
+ Open C:\genesis_rclone_mount.log and check last 10 lines.
+
+ Run Mount Guardian manually:
+
+ powershell.exe -ExecutionPolicy Bypass -File "C:\scripts\mount_guardian.ps1"
+
+ Wait 15 seconds.
+
+ Verify that Q:\ and R:\ reappear.
+
+ If re-mounted, check logs for successful โœ… mount entry.
+
+If Mount Guardian fails to remount:
+
+ Check if rclone.exe is missing or updated incorrectly.
+
+ Check disk space on L:\ and X:\ cache drives.
+
+ Manually run rclone mounts with correct flags (see below).
+
+๐Ÿ› ๏ธ Manual Rclone Mount Commands (Emergency)
+
+rclone mount genesisassets:genesisassets Q:\ --vfs-cache-mode writes --vfs-cache-max-size 3T --vfs-cache-max-age 48h --vfs-read-ahead 1G --buffer-size 1G --cache-dir L:\assetcache --cache-dir X:\cache --no-traverse --rc --rc-addr :5572
+
+rclone mount genesislibrary:genesislibrary R:\ --vfs-cache-mode writes --vfs-cache-max-size 3T --vfs-cache-max-age 48h --vfs-read-ahead 1G --buffer-size 1G --cache-dir L:\assetcache --cache-dir X:\cache --no-traverse --rc --rc-addr :5572
+
+โœ… Always mount assets (Q:) first, then library (R:).
+๐Ÿ“ฌ If Mastodon DMs a Mount Failure Alert
+
+Message example:
+
+ ๐Ÿšจ Genesis Radio Ops: Failed to mount Q:\ after recovery attempt!
+
+Actions:
+
+ Immediately check C:\genesis_rclone_mount.log
+
+ Verify if the mount succeeded after retry
+
+ If not: manually run Mount Guardian
+
+ Escalate if disk space or critical cache drive failure suspected
+
+๐Ÿ“Š If Dashboard Data Looks Broken
+
+Symptoms:
+
+ Health dashboard empty
+
+ No refresh
+
+ Tables missing
+
+Actions:
+
+ Check that healthcheck HTML generator is still scheduled.
+
+ SSH into Krang:
+
+systemctl status healthcheck.timer
+
+Restart healthcheck if necessary:
+
+ systemctl restart healthcheck.timer
+
+ Check /var/www/html/healthcheck.html timestamp.
+
+๐Ÿงน Log Rotation and Space
+
+ Logfile is rotated automatically weekly if over 5MB.
+
+ If needed manually:
+
+ powershell.exe -ExecutionPolicy Bypass -File "C:\scripts\rotate_mount_logs.ps1"
+
+๐Ÿข Critical Reminders (Go Slow to Go Fast)
+
+ Breathe. Double-check before restarting services.
+
+ Don't panic-restart Windows unless all mount attempts fail.
+
+ Document what you changed. Always.
+
+๐Ÿ›ก๏ธ Mission: Keep Genesis Radio running, clean, and stable.
+
+Scripters are smarter than panickers.
+Calm is contagious.