In the Stock Module, receive the goods as if they were going to arrive.

Then change the quantity to 0 and click out of the box.

It will then ask whether these products are on back order. Say 'No' to this question and then click receive goods.

The system will then mark that product as removed from the purchase order and will no longer think that it is on order waiting for delivery.