Quarantined Items

My anti-virus has quarantined several viruses which is great and all but is there a way to permanently remove them from my computer? I don't want to click on the wrong thing and loose them back out into the rest of my files. Should I just delete them, export, or submit? Do I need to directly to the program and uninstall/delete it that way? I'm really confused, is it okay to leave them in quarantine? I would really appreciate any advice, thank you.