blob: 6c78a31cc3a483e50ab14aed47c3a2f5bf47f9b2 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
|
๐ Genesis Radio Mission Control Runbook (v1)
๐ก๏ธ Genesis Radio Mission Control: Ops Runbook
Purpose:
Quickly diagnose and fix common Genesis Radio infrastructure issues without guesswork, even under pressure.
๐จ If a Mount is Lost (Q:\ or R:)
Symptoms:
Station playback errors
Skipping or dead air after a Station ID
Log shows: Audio Engine Timeout on Q:\ or R:\ paths
Immediate Actions:
Check if drives Q:\ and R:\ are visible in Windows Explorer.
Open C:\genesis_rclone_mount.log and check last 10 lines.
Run Mount Guardian manually:
powershell.exe -ExecutionPolicy Bypass -File "C:\scripts\mount_guardian.ps1"
Wait 15 seconds.
Verify that Q:\ and R:\ reappear.
If re-mounted, check logs for successful โ
mount entry.
If Mount Guardian fails to remount:
Check if rclone.exe is missing or updated incorrectly.
Check disk space on L:\ and X:\ cache drives.
Manually run rclone mounts with correct flags (see below).
๐ ๏ธ Manual Rclone Mount Commands (Emergency)
rclone mount genesisassets:genesisassets Q:\ --vfs-cache-mode writes --vfs-cache-max-size 3T --vfs-cache-max-age 48h --vfs-read-ahead 1G --buffer-size 1G --cache-dir L:\assetcache --cache-dir X:\cache --no-traverse --rc --rc-addr :5572
rclone mount genesislibrary:genesislibrary R:\ --vfs-cache-mode writes --vfs-cache-max-size 3T --vfs-cache-max-age 48h --vfs-read-ahead 1G --buffer-size 1G --cache-dir L:\assetcache --cache-dir X:\cache --no-traverse --rc --rc-addr :5572
โ
Always mount assets (Q:) first, then library (R:).
๐ฌ If Mastodon DMs a Mount Failure Alert
Message example:
๐จ Genesis Radio Ops: Failed to mount Q:\ after recovery attempt!
Actions:
Immediately check C:\genesis_rclone_mount.log
Verify if the mount succeeded after retry
If not: manually run Mount Guardian
Escalate if disk space or critical cache drive failure suspected
๐ If Dashboard Data Looks Broken
Symptoms:
Health dashboard empty
No refresh
Tables missing
Actions:
Check that healthcheck HTML generator is still scheduled.
SSH into Krang:
systemctl status healthcheck.timer
Restart healthcheck if necessary:
systemctl restart healthcheck.timer
Check /var/www/html/healthcheck.html timestamp.
๐งน Log Rotation and Space
Logfile is rotated automatically weekly if over 5MB.
If needed manually:
powershell.exe -ExecutionPolicy Bypass -File "C:\scripts\rotate_mount_logs.ps1"
๐ข Critical Reminders (Go Slow to Go Fast)
Breathe. Double-check before restarting services.
Don't panic-restart Windows unless all mount attempts fail.
Document what you changed. Always.
๐ก๏ธ Mission: Keep Genesis Radio running, clean, and stable.
Scripters are smarter than panickers.
Calm is contagious.
|
