If all other methods have failed then this may be your only option. To place a castle under siege is usually a last resort and is used to starve the occupants of the castle into surrender. You need to surround the castle with soldiers and catapults and victory can take some time. Have you looked at other options?
Back to the game!