Hi Jesse Pinkman,
So when you right click a file, you do not see the Delete option? That is odd. If you have important file on the pendrive, back the up and format the USB drive. Open Disk Management and right click the drive. Select the format option. Once it is done, check if the deleting problem persists. I strongly recommend you to update your anti virus and do complete systems scan.
Hope this helps