US speaker ousted