If the Team Explorer is installed right after TFS has been installed the following error might occur:
This error can be ignored as long as it still says Succesfully installed in the end dialog. It seems to be related to the setup process running and some files still locked from the TFS install.