Resolve missing terms used in CIViC

[jsstevenson]

CIViC currently captures a bunch of NCIt terms that we're maybe missing. We should figure out what the deal is.

civic_missing.csv

[korikuzma]

I just chose a random row

and we do have it:

http://normalize.cancervariants.org/therapy/search?q=ncit:C166444&incl=ncit

Update: Searching on others and haven't had a miss yet...

[jsstevenson]

@korikuzma well now we have 2 problems.

[korikuzma]

@jsstevenson I think it would help to see how this file was generated

[jsstevenson]

This was a dump of CIViC terms that failed to group in DGIdb. The ones I sampled were indeed outside of the normalizer's grasp, but looks like there must be some false negatives too so I'll circle around and update this list.

[jsstevenson]

Pending resolution of this ^ we should make sure that we are importing everything that CIViC imports. Their logic is here: https://github.com/griffithlab/civic-v2/blob/main/server/app/lib/importer/nci_thesaurus_mirror.rb

[jsstevenson]

Okay, updated (hopefully correct-er) list of CIViC terms that we aren't catching (this is by virtue of whether they're getting sorted into DGIdb groups, there might be some small edge cases added in but it should mostly reflect what the normalizer can pick up)

null drugs.csv

at first glance, there are some things like combo regimens that are a little tricky philosophically, but still worth looking into this at some point