I assume that by saying "pulled back to the filter" you mean to the pick up tube? I'm not sure, but I doubt the filter could provide that much suction. They may get caught a little in the current, but I wouldn't worry too much.
I use Marineland Penguin 100's on my 10g tanks (Approx. twice as much filter as is needed), so far no real problems, and excellent filtration.