Assume that you went on vacation for the weekend and returned to find someone in your house. You attempt to enter but they have changed the locks. When you try to break in, the new occupants call the police who charge you with breaking and entering.
That is the situation with Israel and the Palestinians who became refugees in 1948. The problem is simply one of property rights. Ever heard of the Palestinian "right of return"?