Skip to content

One monolithic factory-entries data product#429

Merged
mambelli merged 2 commits intoHEPCloud:masterfrom
knoepfel:one-factory-entries-product
Sep 15, 2022
Merged

One monolithic factory-entries data product#429
mambelli merged 2 commits intoHEPCloud:masterfrom
knoepfel:one-factory-entries-product

Conversation

@knoepfel
Copy link
Contributor

@knoepfel knoepfel commented Aug 8, 2022

Instead of one data product for each factory entry type, this PR merges all of those products into a monolithic data product called "Factory_Entries".

@codecov
Copy link

codecov bot commented Aug 8, 2022

Codecov Report

Base: 47.41% // Head: 47.36% // Decreases project coverage by -0.05% ⚠️

Coverage data is based on head (8f95d49) compared to base (f2057d1).
Patch coverage: 94.73% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #429      +/-   ##
==========================================
- Coverage   47.41%   47.36%   -0.06%     
==========================================
  Files          54       54              
  Lines        2902     2903       +1     
  Branches      523      523              
==========================================
- Hits         1376     1375       -1     
- Misses       1426     1427       +1     
- Partials      100      101       +1     
Flag Coverage Δ
python-3.6 47.27% <94.73%> (-0.06%) ⬇️
python-3.9 47.36% <94.73%> (-0.06%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...modules/glideinwms/publishers/fe_group_classads.py 89.09% <88.88%> (-3.22%) ⬇️
...nengine_modules/GCE/transforms/GceFigureOfMerit.py 87.17% <100.00%> (ø)
...ine_modules/NERSC/transforms/NerscFigureOfMerit.py 100.00% <100.00%> (ø)
...gine_modules/glideinwms/sources/factory_entries.py 86.00% <100.00%> (-0.54%) ⬇️
...ules/glideinwms/transforms/grid_figure_of_merit.py 89.65% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@knoepfel knoepfel force-pushed the one-factory-entries-product branch 2 times, most recently from bebae67 to 20751f3 Compare August 8, 2022 21:38
@knoepfel knoepfel marked this pull request as draft August 8, 2022 21:57
@StevenCTimm
Copy link
Contributor

Should also check glideinwms/glide_frontend_element.py to make sure there's nothing in there. Otherwise this looks good.

@knoepfel knoepfel marked this pull request as ready for review August 25, 2022 15:11
@knoepfel knoepfel force-pushed the one-factory-entries-product branch from 20751f3 to bd5131b Compare September 1, 2022 15:45
requests_df = datablock.get("glideclient_manifests")
if requests_df.empty:
return pandas.DataFrame()

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not a blocker, but is it fairly trivial to add a test to make sure that if the glideclient_manifests data block is empty, we get an empty pandas.DataFrame()?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I'll find a way to cover this.

shreyb
shreyb previously approved these changes Sep 6, 2022
Copy link
Contributor

@shreyb shreyb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved, but I had one comment to see if it's possible to increase coverage for the lines added in fe_group_classads.py.

Copy link
Contributor

@shreyb shreyb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Thanks!

@mambelli mambelli merged commit ea02fc8 into HEPCloud:master Sep 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants