In concept removing directories is somewhat similar to removing files--you want the directory to not exist in your current working directories, but you also want to be able to retrieve old releases in which the directory existed.
The way that you remove a directory is to remove all the files in it. You don"t remove the directory itself; there is no way to do that. Instead you specify the "-P" option to cvs update, cvs checkout, or cvs export, which will cause CVS to remove empty directories from working directories. Probably the best way to do this is to always specify "-P"; if you want an empty directory then put a dummy file (for example ".keepme") in it to prevent "-P" from removing it.
Note that "-P" is implied by the "-r" or "-D" options of checkout and export. This way CVS will be able to correctly create the directory or not depending on whether the particular version you are checking out contains any files in that directory.
courtesy: a site