Lower is better... as long as your not getting read/write/wait errors.
Also if you happen to be sharing IRQ's and getting some problems from it... then higher PCI latency can help fix it.
Like I said thou lower is better. Stick with 32-64 and you should be fine. You can use PowerStrip to adjust your AGP and each PCI slots latency from within windows also.