After discussing internally we agreed that it is a bug and should be registered as such. The reasoning can be explained more by a developer when he will attend this bug.
Hello!
You can mark it as closed as option. If document is connected with other documents you can not delete it so you will not be able to delete PO, as you will not be able to remove Goods receipt...