by H.G.Muller » 02 Jun 2011, 19:04
Well, the primary reason for the existence of the debug file is to debug WinBoard. Not to debug engines. If people run into problems, they can send us the debug file, and we should be able to deduce from them what went wrong. For this it is often important to not only see what WinBoard received from the engine, but also how it reacted to it, and not only what it sent, but also why.
I do admit that I am a bit tardy in removing messages related to features that by now should be considered fully debugged, though. Especially in versions that have been declared 'stable', most of the debug output should simply be removed.
However, I am not sure there is that much to save, in terms of space. There might be a lot of lines, but they are mostly quite short. My impression is always that the bulk of the contents is the engine thinking output. These grow to very long lines, and some engine print multiple lines per iteration (e.g. each time they overturn the best-so-far root move). When I want to step through the debug file for the purpose of seeing what an engine did, I simply search for the words 'first' or 'second'. Just deleting the lines that you don't need, like every line not containing these lines, seems a very competative option, if the storage overhead of initially writing those lines is only minor.
Why would you want to save 1000 debug files from a tournament anyway? If you were testing an engine that was faulty, you should know it already after far fewer games, I would think.