I removed the mods in game but realized there were still old files of deleted mods in the file explorer located here:
C:\Users\rache\OneDrive\Documents\inZOI\Mods\88849
&
C:\Program Files (x86)\Steam\steamapps\common\inZOI\BlueClient\Content\Paks~mods
I deleted the mods files in these folders, and it seems to have significantly fixed the issue regarding crashing in CAZ because of insufficient memory.