Text REtrieval Conference (TREC)
System Description

Organization Name: Microsoft/City University Run ID: plt8ah4
Section 1.0 System Summary and Timing
Section 1.1 System Information
Hardware Model Used for TREC Experiment: 16 Node PII cluster
System Use: SHARED
Total Amount of Hard Disk Storage: 144 Gb
Total Amount of RAM: 6,144 MB
Clock Rate of CPU: 300 MHz
Section 1.2 System Comparisons
Amount of developmental "Software Engineering": ALL
List of features that are not present in the system, but would have been beneficial to have:
List of features that are present in the system, and impacted its performance, but are not detailed within this form: Parallelism is used.
Section 2.0 Construction of Indices, Knowledge Bases, and Other Data Structures
Length of the stopword list: 450 words
Type of Stemming: LOVINS
Controlled Vocabulary: NO
Term weighting: YES
  • Additional Comments on term weighting: Okapi BM25
Phrase discovery: NO
  • Kind of phrase:
  • Method used: OTHER
Type of Spelling Correction: NONE
Manually-Indexed Terms: NO
Proper Noun Identification: NO
Syntactic Parsing: NO
Tokenizer: NO
Word Sense Disambiguation: NO
Other technique: NO
Additional comments: A Simple SGML/HTML parser was used.
Section 3.0 Statistics on Data Structures Built from TREC Text
Section 3.1 First Data Structure
Structure Type: INVERTED INDEX
Type of other data structure used:
Brief description of method using other data structure:
Total storage used: 0.342 Gb
Total computer time to build: 0.059 hours
Automatic process: YES
Manual hours required: hours
Type of manual labor: NONE
Term positions used: NO
Only single terms used: NO
Concepts (vs. single terms) represented: NO
  • Number of concepts represented:
Type of representation: simple stemmed keyword
Auxilary files used: NO
  • Type of auxilary files used:
Additional comments:
Section 3.2 Second Data Structure
Structure Type: INVERTED INDEX
Type of other data structure used:
Brief description of method using other data structure:
Total storage used: 0.324 Gb
Total computer time to build: 0.81 hours
Automatic process: YES
Manual hours required: hours
Type of manual labor: NONE
Term positions used: NO
Only single terms used: NO
Concepts (vs. single terms) represented: NO
  • Number of concepts represented:
Type of representation: simple stemmed keyword
Auxilary files used: NO
  • Type of auxilary files used:
Additional comments: This run was done on a single 128mb pentium PII with 9Gb of disk space.
Section 3.3 Third Data Structure
Structure Type: INVERTED INDEX
Type of other data structure used:
Brief description of method using other data structure:
Total storage used: 0.851 Gb
Total computer time to build: 0.064 hours
Automatic process: YES
Manual hours required: hours
Type of manual labor: NONE
Term positions used: YES
Only single terms used: NO
Concepts (vs. single terms) represented: NO
  • Number of concepts represented:
Type of representation: simple stemmed keyword
Auxilary files used: NO
  • Type of auxilary files used:
Additional comments: This is an for extra term weighting run on position data. The sequential index file was also used (see data from other runs).
Section 4.0 Data Built from Sources Other than the Input Text
Internally-built Auxiliary File

File type: NONE
Domain type: DOMAIN INDEPENDENT
Total Storage: Gb
Number of Concepts Represented: concepts
Type of representation: NONE
Automatic or Manual:
  • Total Time to Build: hours
  • Total Time to Modify (if already built): hours
Type of Manual Labor used: NONE
Additional comments:
Externally-built Auxiliary File

File is: NONE
Total Storage: Gb
Number of Concepts Represented: concepts
Type of representation: NONE
Additional comments:
Section 5.0 Computer Searching
Average computer time to search (per query): 0.085 CPU seconds
Times broken down by component(s):
Section 5.1 Searching Methods
Vector space model: NO
Probabilistic model: YES
Cluster searching: NO
N-gram matching: NO
Boolean matching: NO
Fuzzy logic: NO
Free text scanning: NO
Neural networks: NO
Conceptual graphic matching: NO
Other: NO
Additional comments: A single processor run was done which yielded an average QP time of 0.401 seconds. A time of 0.89 was recorded on the
Section 5.2 Factors in Ranking
Term frequency: YES
Inverse document frequency: YES
Other term weights: NO
Semantic closeness: NO
Position in document: YES
Syntactic clues: NO
Proximity of terms: YES
Information theoretic weights: NO
Document length: YES
Percentage of query terms which match: NO
N-gram frequency: NO
Word specificity: NO
Word sense frequency: NO
Cluster distance: NO
Other: NO
Additional comments:
Section 6.0 Query Construction
Section 6.1 Automatically Built Queries for Ad-hoc Tasks
Topic fields used:     TITLE      
Average computer time to build query    CPU seconds
Term weighting (weights based on terms in topics): NO
Phrase extraction from topics: NO
Syntactic parsing of topics:
Word sense disambiguation:
Proper noun identification algorithm:
Tokenizer:
  • Patterns which were tokenized:
Expansion of queries using previously constructed data structures:
  • Comment:
Automatic addition of:
Section 6.2 Manually Constructed Queries for Ad-hoc Tasks
Topic fields used:        
Average time to build query?   minutes
Type of query builder:
Tool used to build query:
Method used in intial query construction?
  • If yes, what was the source of terms?
Total CPU time for all iterations:  seconds
Clock time from initial construction of query to completion of final query:   minutes
Average number of iterations:
Average number of documents examined per iteration:
Minimum number of iterations:
Maximum number of iterations:
The end of an iteration is determined by:
Automatic term reweighting from relevant documents:
Automatic query expansion from relevant documents:
  • Type of automatic query expansion:
Other automatic methods:
  • Other automatic methods included:
Manual methods used:
  • Type of manual method used:
Send questions to trec@nist.gov

Disclaimer: Contents of this online document are not necessarily the official views of, nor endorsed by the U.S. Government, the Department of Commerce, or NIST.