Hi Kelly
Yes, transferring the filter and rock will probably help, you just have to be sure to test the water every day until it settles down, in case it isn't enough, and do water changes if the levels are too high. Even if your tank ends up cycling, the fish will be fine as long as you monitor the levels and keep up with the water changes