You can remove all of the contacts you imported at once, or you can manage your contacts using this list.
Although Facebook can't retract invitations that have already been sent, you can delete contacts from your Invite History list. This will prevent any future invitation reminders from being sent to these people.