There doesn't seem to be a way to toggle off the citadel buff '50% resources gather skill plot'.
Reason for wanting to turn off is due to more experience point from Summoning Plot. (50% more to be exact. E.g. If 66 cap normal, 99 cap with buff | 99 - 66 = 33 | 33/66 = 50%. E.g. 50% more exp without buff or 33% less with buff, both statements are precisely the same math wise.