(for future reference)
To remove a tag and file:
cvs tag -d "tagname" filename
cvs remove -f filename
cvs commit -m "message" filename
To tag an entire folder:
cvs tag -F "tagname" foldername
I started using command line cvs more frequently. These are reminders for myself. In addition to the cvs help.