The House Ethics Committee is expanding its investigation of Rep. Charlie Rangel, D-N.Y.

This comes after his late financial disclosure of hundreds of thousands of dollars in previously unreported assets.

Rangel is the Chairman of the House Tax Writing Committee -- but failed to pay all of his taxes.

Republicans have failed three times in their attempts to have him removed from that committee.

"I think there's a great deal of challenge that the House Ethics Committee has in that they've not acted," Rep. Peter Roskam, R-Ill., said.

"It's been over 12 months and it's reached the point we've gotta think, are they really serious about engaging this, or are they just in a stall pattern? And I think ultimately it hurts the institution and I think it hurts the Speaker," Roskam added.

House Speaker Nancy Pelosi, D-Calif., has said she will not remove Rangel as committee chair while he's being investigated.