Why have I lost smart half hourly usage data on Daily usage section of online account?

@Tim_OVO , @Transparent ,@SianiAnni , @RichH , @Blastoise186 
I must admit that I haven’t been following this particular topic since my HH gas readings became available again, which was from 00:30 on 1st December 2020, over two weeks before everyone else on here? 

Which confirms my suspicion that we have several bugs with similar symptoms, @TheBatsWhiskers 

Are you telling us that you now have Usage graphs with every gas reading correctly displayed for each day of the month? I’ve never had a full month like that!

If I can be any help at all, I’m in.

In the 2 weeks of being on the new account platform & the way usage data is displayed now, I haven’t noticed any dropped data at all. 

On the old platform I had missing data quite regular, day’s / hh readings being averaged out was quite normal.

The only thing I know for sure, is my hh gas usage graph runs 1hr behind my actual usage & any gaps in my daily graph are due to no demand on the boiler. Although there are not many gaps during the day due to the cold weather of late.

I don’t think I keep any screenshots of my erroneous gas data usage from the old platform, but if I can find any, i will compare how it is now reported by the new system.

Tom...

Excellent. I will admit though Tom, you were already on the invite list anyway. 

I will also give you a clue as to what to look for. Once this particular Treehouse has been created… Look for an icon that seems unusually different from all the others...

@Blastoise186wrote

Look for an icon that seems unusually different from all the others…

because it will be an icon with lots of missing data! 

@TomThumb wrote

my hh gas usage graph runs 1hr behind my actual usage

Well that’s a new symptom. I can think of a couple of logical reasons why this might be…. and several illogical ones as well. 

My padlocks aren’t that badly drawn you know!

But I guess the cat’s out of the bag now. So I guess I can reveal a sneak peek…

Hehehe. This was actually my first attempt at drawing a padlock. The real one is actually a lot better looking...

@Transparent

Other than the 2 or 3 times since I became an OVO customer back in July 2018 when my account didn’t show any HH gas readings for several days in succession and the most recent outage last year from 19th August until midnight on 30th November a data dropout only appeared to happen every now and then. 

The HH readings shown on the graphs since “normal” operation was resumed at 00:30 on 1st December look OK, but other than an obvious false reading how can you tell if they are incorrect? 

The HH readings for a day do seem to correlate with the daily totals.  I say “seem to” because if you sum the individual HH readings they rarely, if ever, match the daily totals.  The differences aren’t huge, usually less than 1kWh, and they don’t appear to be due to truncation or rounding errors so could be a correction factor applied to the daily total.

I appreciate that feedback @TheBatsWhiskers 

I’m loathe to explain further on the open Forum how I’m finding the various kinds of Missing Data bugs.

Not only does it take a lot of time to do this, but it really needs doing in a Private Area where members of the three relevant technical teams in OVO can join in and help to differentiate which fault lies where within the data paths.

We’ve already spent 11 months writing about Missing Data on the Forum, and there’s a few hundred posts where several of us have presented evidence. But we’re still largely working blind because we don’t know the fixes that have been applied behind the scenes. All this has done is to make our reporting less distinct. Symptoms are changing and we have no idea why.

Thanks @Transparent 

I believe the “correction factor” I mentioned could well be the application of the gas’s daily calorific value (CV) to generate the total daily kWh reading. I presume the previous day’s CV is used to calculate the HH readings, though as neither HH or daily readings are available until after midnight I don’t see why a day’s correct CV can’t be applied to both “on the fly” as it were.

You’ve just referred to a concept which is about to change anyway @TheBatsWhiskers !

Also:

a: the day’s CV for your area isn’t “published” until 10:30 the following morning. You can download it here

b: The combining of the CV with the HH readings is done the other way around.

And this is another reason why we need that discussion in a Private Area rather than out here. I’m not going to ask Kaluza to reveal here how their software is constructed!