If you ever want to completely delete some files without having to go though Window’s Recycle Bin, try hitting the Shift Key before the Delete key.
This will delete the file permanently instead of just moving it to the Recycle Bin.
Likewise, you can make this happen all the time by going to the Recycle Bin’s properties [Right-Click] and checking the “Remove files immediately when deleted” radio button.