Researchers in influential psycholinguistics labs often use the DMDX application to collect data: its free, its flexible, and its well supported by its authors. The fact that it is free ensures we remove one barrier to the reproducibility of our research (the need to pay a software licence to run our scripts), but the flexibility and the support are also important virtues.
A good place to start is here, at Matt Davis’s DMDX resources page.
I have collated the research group’s resources here:
Dropbox\resources DMDX\notes on test methods