The former owners of a demolished casino still own a chunk of the site and have leased it to developers for more than two decades.