It will be helpful for the customers who automate Xamarin apps, to be informed that the automatic configuration tool cannot successfully configure Xamarin apps. Currently the tool reports that configuration is successful and the failure occur when a test recording is initiated. 
Adding such warning in the automatic tool UI or in the logging will smooth the user experience.