Are we supposed to take out the 2s, 3s, and 4s when we play Rook?

This depends on which version of Rook you are playing.  I personally prefer to include the 2s, 3s, and 4s, as it makes for a slightly more challenging game.  But beware, bidding 150 is much more challenging.