You could probably put him with a couple Oto Cats...all they ever want to do is eat, so they likely wouldn't even bother with the betta, and I can't see the betta having a problem with them.
As for shrimp, you may want to try glass shrimp. Don't quote me on this, but they may have an advantage of staying alive due to the fact that they're hard to see.