Dashboards

Real-time analytics: how fresh does your data need to be?

A frequently updated dashboard can be valuable for someone making decisions during the working day. The same design can add unnecessary cost to a monthly results meeting. Start with how quickly the decision needs to happen, then investigate how fresh the available data can be.

Real-time analytics means analysing data with a sufficiently short delay to use the result while events are still unfolding. That depends on the complete path from an event in the source system to a figure on screen. A moving chart or frequent page reload tells you very little about that path.

Which decision gets worse if it waits?

Ask who will act, what they can change and how long the information remains useful. A manager reallocating staff to handle incoming calls may need current queue information. A finance manager reviewing last month's margin mainly needs reconciled figures that can be compared consistently.

Make the requirement concrete: if waiting times rise during the day, the responsible manager should be able to see the trend and consider changing staffing. You can then discuss an acceptable delay. A general request for everything to be in real time provides much less useful direction when designing the solution.

Scheduled updates, near real time or real time?

Different measures can use different update schedules within the same BI solution. You might follow today's orders frequently while updating accounting results overnight. Display the reporting period and data freshness for each part so readers understand the difference.

Vendors use these terms differently. Agree a measurable acceptable delay for your own use case. The examples below are a starting point for that discussion, rather than technical guarantees about a particular platform.

Examples of requirements that can guide refresh frequency
ApproachPossible use caseQuestion to resolve
Scheduled batchBudget reviews and weekly reportingWhen is the evidence ready and when is it read?
Near real timeToday's bookings, orders or call volumesCan the team act effectively with some delay?
Low-latency real timeOperational monitoring requiring an immediate responseWhat delay and availability must the flow support?

Measure the time from event to usable figure

Suppose a booking is recorded at 10:00, appears in an export at 10:15 and is collected for analysis at 10:20. A dashboard loaded at 10:21 is showing that event with a delay of 21 minutes. Reloading the page every minute does not change when the export becomes available.

Record when the event occurred, when the source made it available, when collection succeeded and when processing finished. Those timestamps answer different questions. A successful collection can still contain old information if the provider's underlying export has not been updated.

Agree how to handle late events, corrections and duplicates. Today's figure may be provisional and change later. A relevant status label and reconciliation against the source help readers understand the confidence they can place in what they see at that moment.

  • Show the period each measure covers and when its evidence last updated.
  • Distinguish zero recorded events from a source that stopped delivering.
  • Define when a delay triggers a warning and who receives it.

Frequent updates affect the whole solution

The options depend on the source system's API, exports, event support and permitted request volume. Processing and analysis also need capacity. More users and more charts can increase demand when every view requests fresh values.

For Power BI, Microsoft explains that automatic page refresh depends on connection type and capacity settings. Check the selected interval in the published environment. Investigate the source's response times and workload as part of choosing the design, too.

Ask for an assessment of both initial delivery and ongoing operation. A simpler option may be to collect changes at an agreed interval and send a signal when a threshold is crossed. That may meet the operational need without refreshing every historical report at the same frequency. Keep the decision and its required response time central to the discussion.

Give your BI consultant a useful starting brief

Describe the operational question before selecting technology. Bring an example of the current view, the systems holding the relevant records and the person responsible for access. A focused test using real data can establish the delay you can achieve and the cost of maintaining that level.

PVBC can help investigate source availability and build a dashboard with an update schedule, validation and status suited to its use. We start with a specific measure and the person who needs to act on it. That gives you evidence for deciding what is worth extending after the first delivery.

  • Decision: what should someone be able to change during the day?
  • Freshness: how old can the evidence be when that decision is made?
  • Sources: when do the relevant events actually become available?
  • Operation: what should happen when data is late, missing or incorrect?
  • Evaluation: how will we check delay, calculations and usefulness?
Good to know

Common questions

Can all our systems support real-time analytics?

Each source needs assessment. One system may expose events as they occur, another may offer an API with request limits and a third may provide a daily export. Access, provider terms and the point at which records become available determine the freshness you can achieve.

Is near real time enough for sales reporting?

It may be. Start with what sales management will do with the information and how promptly deal statuses are updated in the CRM. A daily refresh may support a weekly meeting, while staffing or order handling during the day may require more frequent updates.

How can readers tell whether dashboard figures are current?

Show freshness per source or measure, including its reporting period, latest successful update and a clear status when delayed. Check the source's own update time as well. A timestamp for when the web page opened only tells readers when the page loaded.

Sources and further reading

Start here

Which decision needs fresher figures?

Tell us what you want to monitor, where the records live and how quickly someone needs to act. We can help assess a reasonable update schedule and a useful first step.

Discuss your dashboard with Viktor

Keep reading

All insights