You can use the One-by-one feature to delete individual records. When One-by-One is selected, you will be given an additional link button above the survey title labeled "Delete Record". Click this button and confirm your desire to delete the record to permanently remove the record from the database.
While you should probably never delete records for active surveys to avoid skewing results, this feature is useful for deleting bogus survey submissions.