I don't have the same set-up but I had a similar situation with filter feeding food getting taken out of the system by the skimmer.
Now I just turn off my powerheads and skimmer while I spott fead my tank and then after a few minutes turn the powerheads back on, but I keep the skimmer off for the next hour or so...