Let me break this down for you :
1.I own physical property
2.My rights of ownership over that physical property give me the natural right to arrange that physical property in any way I see fit so long as it does not aggress upon another person (e.g. building a spotlight and shining it on your neighbors property).
3.Imaginary property is a violation of physical property rights. How can one truly claim to own physical property when simply arranging that physical property in a certain fashion subjects you to government-sanctioned violence and property seizure?
4.However hard someone worked on something is irrelevant. That is a utilitarian argument in which you are trying to justify an inherently unethical action (the act of committing violence against someone for arranging their property in a certain manner) on the basis that the consequences of the action are somehow beneficial.
The situation, obviously, is not that simple.