No Witnesses
The service had crashed. We had the alert. We had the timestamp down to the second. We had Loki open and a query ready. What we didn’t have was any logs from the five minutes before the crash. Promtail was running. It was healthy. It had been collecting logs from every other service without issue. But for this one, in the window that mattered, there was nothing. The service had crashed without leaving a trace. ...