The renew exchange server certificate function within the exchange server console provides you with a binary request file. Your (Windows) CA accepts only a base64 request file. Convert the binary to base64 the following easy way:
certutil -encode binary.req base64.txt
