Some character degree sets imply direct product