Removes the given configurationProvider.
The given configurationProvider must have been configured already.