The 56-year-old Swiss has lost the support of many associations in his bid to be re-elected to a fourth and final term since he launched and then hastily shelved his plan to allow private investment into the World Cup.