How do ensure fair test?

[Aaron]

Geschrieben von:/Posted by: Aaron am 29 Januar 2000 11:37:08:
How do you ensure a fiar test for programs that have a setting for pawn Hash?
For example Crafty..Say you give 16 Mb Hash to another program, than crafty should get a total hash of 16 right? So how should you divide this? So far I've being cheating a little has crafty gets another 2Mb pawn Hash free..Is this biasing the result too much?

[Pete Galati]

Geschrieben von:/Posted by: Pete Galati am 29 Januar 2000 23:54:57:
Als Antwort auf:/As an answer to: How do ensure fair test? geschrieben von:/posted by: Aaron am 29 Januar 2000 11:37:08:

How do you ensure a fiar test for programs that have a setting for pawn Hash?
For example Crafty..Say you give 16 Mb Hash to another program, than crafty should get a total hash of 16 right? So how should you divide this? So far I've being cheating a little has crafty gets another 2Mb pawn Hash free..Is this biasing the result too much?

This is only what _I've_ done, and that doesn't mean that it's the best way to do it. I try to get a general similar total size as far as the hashtables go.
Part of the problem as you allready realize is that every program is different as to what it'll let you do. In Crafty for example, if you specify a hashtable setting, it will probably round that down to something that it has as a preset amount, so if you put hash=8m in your crafty.rc file, it won't give you 8 mb of hashtable, it'll give you 6 mb.
If you run Crafty (not in Winboard) and use the info command, then it'll give you a rundown of what Crafty is actually set at:
White(1): info
Crafty version 17.6
hash table memory = 6M bytes.
pawn hash table memory = 1M bytes.
EGTB cache memory = 1M bytes.
60 moves/30 minutes 0 seconds primary time control
30 moves/15 minutes 0 seconds secondary time control
frequency (freq)..............1.00
static evaluation (eval)......0.10
learning (learn)..............0.30
CAP (CAP score)...............1.00
White(1):
that's the result of this crafty.rc file:
log=off
tbpath=c:\tablebse
hash=6m
hashp=1m
But then several programs like Inmichess and Gromit both have several hash settings, and unfortunatly if you're someone like me and don't have mountains of memory on your computer (and prices are rather high at the moment too) then you're stuck trying to balance them, and I always need to turn them down from how the program comes as a download, and for me unfortunatly this _often_ involves guess work.
Pete



my page