|
|
@@ -49,6 +49,32 @@ ClickHouse keeldub mõlemast korraga (Code 516). **Lahendus:** hoia ühenduse
|
|
|
- **Konteinerid:** CPU, mälu (working set/usage), võrk (cadvisor).
|
|
|
- **Mudel:** llama.cpp — prompt/ predicted tokens, requests_processing, kv_cache (`--metrics`).
|
|
|
|
|
|
+## Dashboardid (retseptid)
|
|
|
+HyperDX UI-s: **Dashboards → New dashboard → Add tile**. Kasuta allolevaid metrikaid
|
|
|
+(Metrics source) või "SQL" diagrammi. Ajatelje jaoks sobib `TimeUnix`.
|
|
|
+
|
|
|
+| Paneel | Mõõdik / SQL |
|
|
|
+|---|---|
|
|
|
+| RAM vaba | `node_memory_MemAvailable_bytes` (gauge) |
|
|
|
+| Swap vaba | `node_memory_SwapFree_bytes` (gauge) |
|
|
|
+| Load | `node_load1` (gauge) |
|
|
|
+| Konteineri mälu | `container_memory_working_set_bytes` (group: `Attributes['name']`) |
|
|
|
+| Konteineri CPU | `container_cpu_usage_seconds_total` (rate) |
|
|
|
+| **Llama tokeneid/s** | `rate(llamacpp:tokens_predicted_total)` või pika aja trend |
|
|
|
+| **Llama päringud** | `llamacpp:requests_processing` (gauge), `llamacpp:tokens_predicted_total` (sum) |
|
|
|
+| **Llama KV-cache** | `llamacpp:kv_cache_usage_ratio` (gauge) |
|
|
|
+| **Teenus üleval** | `ohmu_service_up` (group: `Attributes['service']`) |
|
|
|
+| **Restardid** | `ohmu_container_restarts` (group: `Attributes['name']`) |
|
|
|
+
|
|
|
+Näidis-SQL (ClickHouse):
|
|
|
+```sql
|
|
|
+-- Teenuste seis viimase 10 min jooksul
|
|
|
+SELECT toStartOfMinute(TimeUnix) AS t, Attributes['service'] AS service, avg(Value) AS up
|
|
|
+FROM default.otel_metrics_gauge
|
|
|
+WHERE MetricName = 'ohmu_service_up' AND TimeUnix > now() - INTERVAL 10 MINUTE
|
|
|
+GROUP BY t, service ORDER BY t;
|
|
|
+```
|
|
|
+
|
|
|
## Seotud
|
|
|
- Vahejuhtumite audit: `../LOEMIND_seisevad_konteinerid.md`
|
|
|
- Serveri mudelid: `~/servers/LOEMIND/llama-server.md`
|
ardo