Data freshness
When new answers arrive each day, and when to fetch them.
When new answers arrive
Lumirank asks each active prompt once a day. The day's answers arrive between 00:00 and about 12:00 UTC. A slow engine can take longer. Until all answers arrive, today's numbers are not complete.
The data_through field
GET /v1/brand and the meta of every report have a data_through field. It is the time of the newest completed answer. In a report, it is the newest answer inside the report's date range. It is null until the brand has its 1st answer.
On /v1/brand, data_through counts the answers of every prompt, archived prompts included, so archiving a prompt never moves it back. In a report, data_through counts archived prompts only when you send include_archived=true.
When to fetch new data
- For daily numbers, run your job once a day after 12:00 UTC, and read the data up to yesterday.
- To fetch new answers soon after they arrive, compare
data_throughwith the value your last run saw. Fetch only when it has changed. - v1 has no webhooks, so the API cannot call you when new data arrives.
An answer counts on the day it is completed. So an answer that finishes after midnight UTC counts for the new day, not the day before. The numbers of a past day can still change when a prompt is archived or unarchived, or when a competitor's status changes, because lists and reports use the current status for every date.