(for future reference)

To remove a tag and file:

cvs tag -d "tagname" filename

cvs remove -f filename

cvs commit -m "message" filename

To tag an entire folder:

cvs tag -F "tagname" foldername

I started using command line cvs more frequently. These are reminders for myself. In addition to the cvs help.