pub plots script changes through time

[durack1]

@mauzey1 I was just running the mauzey1/esgf-utils/cmip6_pub_history/update-reports/esgf_data_pub_plots.py file and curiously there are differences which begin at 2019-02-17, see the previous file
esgf_dataset_publication_cumulative_counts_CMIP6_CMIP_20180701-20200404.txt
And the latest file generated today
esgf_dataset_publication_cumulative_counts_CMIP6_CMIP_20180701-20200408.txt

The differences begin at line 76, with the old file:

74 2019-02-14 00:00:00,14583
75 2019-02-15 00:00:00,14641
76 2019-02-17 00:00:00,49111
77 2019-02-18 00:00:00,49600
78 2019-02-19 00:00:00,50453
79 2019-02-21 00:00:00,50916
...

And the new:

74 2019-02-14 00:00:00,14583
75 2019-02-15 00:00:00,14641
76 2019-02-17 00:00:00,48573
77 2019-02-18 00:00:00,49062
78 2019-02-19 00:00:00,49915
79 2019-02-21 00:00:00,50378
...

Just wondering what is going on here?

[mauzey1]

I suspect that 538 datasets that had a timestamp within 2019-02-17 got listed as deprecated (latest=false). The same thing happened for other dates.

@sashakames @nathanlcarlson is there a way to confirm this?

[durack1]

@mauzey1 thanks for the heads up, the new lists 268548 and old 269441 (diff 893) for 2020-04-03 so more than just a single deprecation must have taken place.

The totals exclude replicas right?

[mauzey1]

@durack1 Yes, replicas are excluded.