Disclaimer: Although the following Perl and C scripts have proved helpful in TREC processes, NIST assumes no responsibility for their completeness, compatibility, or performance. Moreover, NIST does not supply technical support for the mentioned programs. Note that these files must be saved with a .pl or a .c extension (for Perl and C respectively) in order to be run.
TREC 2023 check input utilities The check input family of scripts check for errors in a TREC 2023 submission.-
check_neuclir.pl: script for NeuCLIR track runs.
-
check_product.pl: script for Product track runs.
-
check_tot.pl: script for ToT track runs.
-
check_atomic.pl: script for AToMiC track runs.
-
checker for CrisisFACTs track runs.
Submissions that contain errors are returned to the submitter by the automatic submissions procedure.
- ucomp_cdfiles.pl
- Program was designed to copy files from a specified CDROM directory, rename them with a Z extension (i.e., fr940104.z would be replaced with fr940104.Z), and uncompress. NOTE: For file names that include a .1 extension (i.e., fr940104.2z), change line 16 to read $ucomp =~ s/z$/\.Z/g;
-
trec_eval latest and past releases
- IR-STAT-PAK
- Information Retrieval statistical program written by James Blustein for use in analyzing TREC-3 data.
- BEADPLOT
- An interactive tool for visual comparison of TREC Result Sets.
