IN-356 Intermittent Data Routing Fault Affecting Display of WARP Status & Dashboard Readings

Incident Report for Checkit

Resolved

Logging for all affected sites has now been restored, and the data backfill process has been initiated to recover data that was not successfully recorded during the incident.

The issue was not immediately detected by our monitoring systems because the service health checks continued to report as healthy.

The monitoring checks are designed to confirm that sessions are being processed within expected timeframes. In this instance, the component responsible for managing session information continued to use an existing database connection that had been established before the network change. As a result, the health checks continued to operate successfully and did not identify the underlying connectivity issue.

At the same time, data collection services remained operational and continued attempting to collect data. However, they were unable to establish the new database connections required to store this data in the relevant caching and logging systems.

This resulted in a partial service degradation where the data collection processes themselves remained operational, but some of the collected data could not be successfully stored. Because the services did not enter a failed state, the issue was not immediately identified by automated monitoring and was subsequently detected through operational indicators and further investigation.

We are reviewing the monitoring and health-check mechanisms as part of our follow-up actions to improve our ability to detect similar partial service degradation in the future.

Services Not Impacted

The following services remained operational throughout the incident:
Alarm processing and alarm reception.
All other core services.

Next Steps
Continue monitoring the backfill process and validate recovered data.
Review and enhance monitoring to improve detection of partial service degradation.
Posted Aug 28, 2026 - 11:19 UTC

Identified

We've implemented a fix for this issue, and a mass backfill of missing data is now underway. Data logging will resume shortly, and in turn, the 'Fault' status will clear from both the CAM+ website and WARP panels. Thank you for your patience while we work to resolve.
Posted Aug 27, 2026 - 10:58 UTC

Investigating

We're aware that some customers are currently experiencing unexpected WARP statuses and dashboard readings. This has been raised as a priority, and our team is working to resolve it - we'll provide a further update as soon as possible.
Posted Aug 27, 2026 - 10:01 UTC
This incident affected: CAM+.