Can I withdraw money from my certificate of deposit? Early withdrawal before the maturity date is penalized. However, you are allowed to withdraw dividends on crediting dates. Contact Us For more information about certificates of deposit, contact the Brownsville branch of Valley Federal Credit Union at 956-546-3108.