If you withdraw part of the money you deposited into a Certificate of Deposit (CD) before the maturity date, you will not have to pay a penalty.