Mirror drive device capable of high-speed driving and image pickup apparatus

A mirror drive device capable of achieving lower torque and higher speed in mirror driving without necessitating reversing of an urging direction of an urging member during the mirror driving and improve durability thereof at the same time. A main mirror holder holding a main mirror is movable between a mirror-down position is a photographing optical path and a mirror-up position retracted from the photographing optical path. A sub mirror holder holding a sub mirror and rotatably attached to the main mirror bolder is movable between a mirror-down position and a mirror-up position. The sub mirror holder is moved by a driving member from the mirror-down position to the mirror-up position, whereby the main mirror holder is moved from the mirror-down position to the mirror-up position.