In my case I am trying to remove the Corrupted Search Service Application.
1. I tried removing thru Central Admin. It took time and got timed out. No Luck.
2. Tried to remove using Powershell script, no luck.
$spapp = Get-SPServiceApplication -Name "Search Service Application"
Remove-SPServiceApplication $spapp -RemoveData
STSADM.EXE -o deleteconfigurationobject -id "b90b7108-b808-4186-8d86-1ed1da72f3d0"
NOTE: Please Open the Powershell with "Run as Administrator"