NIST Special Publication 500-249:
The Ninth Text REtrieval Conference (TREC 9)

Return to the TREC home page TREC home    Return to the TREC Publications home page Publications home Return to the TREC Document Help home page Help          National Institute of Standards and Technology Home Page

NOTE: Portions of these proceedings are available in either PS or PDF formats. Applicable files have been compressed (.gz), in order to preserve disk space. Papers need to be saved and unzipped before viewing in the appropriate software. For additional information on these utilities, please reference the [help] file.

The inclusion or omission of a particular company or product implies neither endorsement nor criticism by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own and do not necessarily reflect those of the sponsors.


TABLE OF CONTENTS


postscript file   Adobe Portable Document Format
 (PDF) fileFOREWORD

 postscript file  Adobe Portable Document Format (PDF) fileABSTRACT

PAPERS


  1. postscript file  Adobe Portable Document Format (PDF) fileOverview of the Ninth Text REtrieval Conference (TREC-9), page 1
    E. Voorhees, D. Harman, National Institute of Standards and Technology
  2. postscript file  Adobe Portable Document Format (PDF) fileTREC-9 Cross-Language Information Retrieval (English-Chinese) Overview, page 15
    F. Gey, A. Chen, University of California, Berkeley
  3. postscript file  Adobe Portable Document Format (PDF) fileThe TREC-9 Filtering Track Final Report, page 25
    S. Robertson, Microsoft Research
    D.A. Hull, WhizzBang Labs
    postscript file  Adobe Portable Document Format (PDF) fileThe TREC-9 Interactive Track Report, page 41
    W. Hersh, Oregon Health Sciences University
    Paul Over, National Institute of Standards and Technology
  4. postscript file  Adobe Portable Document Format (PDF) fileQuery Expansion Seen Through Return Order
    of Relevant Documents
    , page 51
    W. Liggett, NIST
    C. Buckley, SabIR Research, Inc.
  5. postscript file  Adobe Portable Document Format (PDF) fileOverview of the TREC-9 Question Answering Track, page 71
    E. Voorhees, NIST
  6. postscript file  Adobe Portable Document Format (PDF) fileThe TREC-9 Query Track, page 81
    Chris Buckley, Sabir Research, Inc.
  7. Spoken Document Retrieval Track Slides
    J. Garofolo, J. Lard, E. Voorhees, NIST
  8. postscript file  Adobe Portable Document Format (PDF) fileOverview of the TREC-9 Web Track, page 87
    D. Hawking, CSIRO Mathematical and Information Sciences
  9. postscript file  Adobe Portable Document Format (PDF) fileStructuring and Expanding Queries in the
    Probabilistic Model
    , page 427
    Y. Ogawa, H. Mano, M. Narita, S. Honma, RICOH Co., Ltd.
  10. postscript file  Adobe Portable Document Format (PDF) fileIIT TREC-9 - Entity Based Feedback with Fusion,
    page 241
    A. Chowdhury, S. Beitzel, E. Jensen, M. Sai-lee, D. Grossman,
    O. Frieder, Illinois Institute of Technology
    M.C. McCabe, U.S. Government
    D. Holmes, NCR Corporation
  11. postscript file  Adobe Portable Document Format (PDF) fileTREC-9 Cross Language, Web and Question-Answering Track Experiments using PIRCS, page 419
    K.L. Kwok, L. Grunfeld, N. Dinstl, M. Chan, Queens College, CUNY
  12. postscript file  Adobe Portable Document Format (PDF) fileTREC-9 CLIR Experiments at MSRCN, page 343
    J. Gao, E. Xun, M. Zhou, C. Huang, Microsoft Research China
    J-Y Nie, Université de Montréal
    J. Zhang, Y. Su, Tsinghua University China
  13. postscript file  Adobe Portable Document Format (PDF) fileFALCON: Boosting Knowledge for Answer Engines,
    page 479
    S. Harabagiu, D. Moldovan, M. Pasca, R. Mihalcea,
    M. Surdeanu, R. Bunescu, R. Gîrju, V. Rus, P. Morarescu, Southern Methodist University
  14. postscript file  Adobe Portable Document Format (PDF) fileIBM's Statistical Question Answering System,
    page 229
    A. Ittycheriah, M. Franz, W-J Zhu,
    A. Ratnaparkhi, IBM T.J. Watson Research Center
    R.J. Mammone, Rutgers University
  15. postscript file  Adobe Portable Document Format (PDF) fileQuestion Answering by Passage Selection
    (MultiText Experiments for TREC-9)
    , page 673
    C.L.A. Clarke, G.V. Cormack, D.I.E. Kisman, T.R. Lynam,
    University of Waterloo
  16. postscript file  Adobe Portable Document Format (PDF) fileQuestion Answering in Webclopedia,
    page 655
    E. Hovy, L. Gerber, U. Hermjakob, M. Junk, C-Y Lin, University of Southern California
  17. postscript f
ile  Adobe Portable Document Format (PDF) fileFilters and Answers: The University of Iowa TREC-9 Results, page 533
    E. Catona, D. Eichmann, P. Srinivasan, University of Iowa
  18. postscript file   Adobe Portable Document Format (PDF) fileThe LIMSI SDR System for TREC-9, page 335
    J.-L. Gauvain, L. Lamel, C. Barras, G. Adda, Y. de Kercardio, LIMSI-CNRS
  19. postscript f
ile  Adobe Portable Document Format (PDF) fileMicrosoft Cambridge at TREC-9: Filtering Track, page 361
    S.E. Robertson, S. Walker, Microsoft Research Ltd., UK
  20. postscript file  Adobe Portable Document Format (PDF) fileAT&T at TREC-9 , page 103
    A. Singhal, M. Kaszkiel, AT&T Labs-Research
  21. postscript f
ile  Adobe Portable Document Format (PDF) fileSpoken Document Retrieval for TREC-9 at
    Cambridge University
    , page 117
    S.E. Johnson, P. Jourlin, K. Spärck Jones, P.C. Woodland,
    Cambridge University
  22. postscript f
ile  Adobe Portable Document Format (PDF) filekNN at TREC-9, page 127
    T. Ault, Y. Yang, Carnegie Mellon University
  23. postscript f
ile  Adobe Portable Document Format (PDF) fileYFilter at TREC-9, page 135
    Y. Zhang, J. Callan, Carnegie Mellon University
  24. postscript f
ile  Adobe Portable Document Format (PDF) filePassive Feedback Collection--An Attempt to Debunk the Myth of Clickthroughs, page 141
    C. Vogt, Chapman University
  25. postscript file  Adobe Portable Document Format (PDF) fileTREC-9 CLIR at CUHK: Disambiguation by Similarity Values Between Adjacent Words, page 151
    H. Jin, K-F Wong, The Chinese University of Hong Kong
  26. postscript f
ile  Adobe Portable Document Format (PDF) fileSyntactic Clues and Lexical Resources in Question-Answering, page 157
    K.C. Litkowski, CL Research
  27. postscript f
ile  Adobe Portable Document Format (PDF) fileDublin City University Experiments in Connectivity Analysis for TREC-9, page 179
    C. Gurrin, A.F. Smeaton, Dublin City University
  28. postscript f
ile  Adobe Portable Document Format (PDF) fileFDU at TREC-9: CLIR, Filtering and QA Tasks, page 189
    L. Wu, X-j Huang, Y. Guo, B. Liu, Y. Zhang, Fudan University
  29. postscript f
ile  Adobe Portable Document Format (PDF) fileFujitsu Laboratories TREC-9 Report, page 203
    I. Namba, Fujitsu Laboratories, Ltd.
  30. postscript f
ile  Adobe Portable Document Format (PDF) fileHummingbird's Fulcrum SearchServer at TREC-9, page 209
    S. Tomlinson, T. Blackwell, Hummingbird
  31. postscript f
ile  Adobe Portable Document Format (PDF) fileEnglish-Chinese Information Retrieval at IBM, page 223
    M. Franz, J.S. McCarley, W-J Zhu, IBM T.J. Watson Research Center
  32. postscript f
ile  Adobe Portable Document Format (PDF) fileOne Search Engine or Two for Question-Answering, page 235
    J. Prager, E. Brown, IBM T.J. Watson Research Center
    D.R. Radev, University of Michigan
    K. Czuba, Carnegie-Mellon University
  33. postscript file  Adobe Portable Document Format (PDF) fileTraining Context-Sensitive Neural Networks with Few Relevant Examples for the TREC-9 Routing, page 257
    M. Stricker, Informatique-CDC and ESPCI
    F. Vichot, F. Wolinski, Informatique-CDC
    G. Dreyfus, ESPCI
  34. postscript f
ile  Adobe Portable Document Format (PDF) fileMercure at trec9: Web and Filtering tasks, page 263
    M. Abchiche, M. Boughanem, T. Dkaki, J. Mothe, C. Soule Dupuy,
    M. Tmar, IRIT-SIG
  35. postscript f
ile  Adobe Portable Document Format (PDF) fileThe HAIRCUT System at TREC-9, page 273
    P. McNamee, J. Mayfield, C. Piatko, The Johns Hopkins University, APL
  36. postscript f
ile  Adobe Portable Document Format (PDF) fileExperiments on the TREC-9 Filtering Track, page 295
    K. Hoashi, K. Matsumoto, N. Inoue, K. Hashimoto,
    KDD R&D Laboratories, Inc.
    T. Hasegawa, K. Shirai, Waseda University
  37. postscript f
ile  Adobe Portable Document Format (PDF) fileTREC-9 Experiments at KAIST: QA, CLIR and Batch Filtering, page 303
    K-S Lee, J-H Oh, JX Huang, J-H Kim, K-S Choi, Korea Advanced Institute of Science and Technology
  38. postscript f
ile  Adobe Portable Document Format (PDF) fileQuestion Answering Considering Semantic Categories and Co-Occurrence Density, page 317
    S-M Kim, D-H Baek, S-B Kim, H-C Rim, Korea University
  39. postscript f
ile  Adobe Portable Document Format (PDF) fileQALC--The Question-Answering System of LIMSI-CNRS, page 235
    O. Ferret, B. Grau, M. Hurault-Plantet, G. Illouz, C. Jacquemin, LIMSI-CNRS
    N. Masson, P. Lecuyer, Bertin Technologies
  40. postscript f
ile  Adobe Portable Document Format (PDF) fileQuestion Answering Using a Large NLP System, page 355
    D. Elworthy, Microsoft Research Ltd.
  41. postscript f
ile  Adobe Portable Document Format (PDF) fileNTT DATA TREC-9 Question Answering Track Report,
    page 399
    T. Takaki, NTT Data Corporation
  42. postscript f
ile  Adobe Portable Document Format (PDF) fileDescription of NTU QA and CLIR Systems in TREC-9, page 389
    C-J Lin, W-C Lin, H-H Chen, National Taiwan University
  43. postscript f
ile  Adobe Portable Document Format (PDF) fileFurther Analysis of Whether Batch and User Evaluations Give the Same Results with a Question-Answering Task, page 407
    W. Hersh, A. Turpin, L. Sacherek, D. Olson, S. Price, B. Chan,
    D. Kraemer, Oregon Health Sciences University
  44. postscript f
ile  Adobe Portable Document Format (PDF) fileMelbourne TREC-9 Experiments, page 437
    D. D'Souza, M. Fuller, J. Thom, P. Vines, J. Zobel, RMIT University
    O. de Kretser, University of Melbourne
    R. Wilkinson, M. Wu, CSIRO, Division of Mathematics and Information Science
  45. postscript f
ile  Adobe Portable Document Format (PDF) fileSupport for Question-Answering in Interactive Information Retrieval: Rutgers' TREC-9 Interactive Track Experience, page 463
    N.J. Belkin, A. Keller, D. Kelly, J. Perez-Carballo, C. Sikora, Y. Sun, Rutgers University
  46. postscript f
ile  Adobe Portable Document Format (PDF) fileHalfway to Question Answering, page 489
    W.A. Woods, S. Green, P. Martin, A. Houston, Sun Microsystems Laboratories
  47. postscript f
ile  Adobe Portable Document Format (PDF) fileQuestion Answering: CNLP at the TREC-9 Question Answering Track, page 501
    A. Diekema, X. Liu, J. Chen, H. Wang, N. McCracken, O. Yilmazel, E.D. Liddy, Syracuse University, School of Information Studies
  48. postscript file  Adobe Portable Document Format (PDF) fileCINDOR TREC-9 English-Chinese Evaluation, page 379
    M.E. Ruiz, S. Rowe, M. Forrester, P. Sheridan, MNIS-TextWise Labs
  49. postscript f
ile  Adobe Portable Document Format (PDF) fileTNO-UT at TREC-9: How Different are Web Documents?, page 665
    W. Kraaij, TNO-TPD
    T. Westerveld, University of Twente, CTIT
  50. postscript f
ile  Adobe Portable Document Format (PDF) fileA Semantic Approach to Question Answering Systems,
    page 511
    J.L. Vicedo, A. Ferrandez, Universidad de Alicante
  51. postscript f
ile  Adobe Portable Document Format (PDF) fileThe PISAB Question Answering System, page 621
    G. Attardi, C. Burrini, Universitá di Pisa - Italy
  52. postscript f
ile  Adobe Portable Document Format (PDF) fileGoal-Driven Answer Extraction, page 563
    M. Laszlo, L. Kosseim, G. Lapalme, Université de Montréal
  53. postscript file  Adobe Portable Document Format (PDF) file The System RELIEFS: A New Approach for Information Filtering, page 573
    C. Brouard and J-Y Nie, Université de Montréal
  54. postscript file  Adobe Portable Document Format (PDF) file Report on the TREC-9 Experiment: Link-based Retrieval and Distributed Collections, page 579
    J. Savoy, Y. Rasolofo, Université de Neuchâtel
  55. postscript file  Adobe Portable Document Format (PDF) fileEnglish-Chinese Cross-Language IR Using Bilingual Dictionaries, page 517
    A. Chen, H. Jiang, School of Information Management and Systems, University of California at Berkeley
    F. Gey, UC Data Archive & Technical Assistance (UC DATA), University of California at Berkeley
  56. postscript f
ile  Adobe Portable Document Format (PDF) fileQuestion Answering, Relevance Feedback and Summarisation: TREC-9 Interactive Track Report, page 523
    N. Alexander, C. Brown, J. Jose, I. Ruthven, A. Tombros, University of Glasgow
  57. postscript f
ile  Adobe Portable Document Format (PDF) fileINQUERY and TREC-9, page 551
    J. Allan, M.E. Connell, W.B. Croft, F-F Feng, D. Fisher, X. Li, Center for Intelligent Information Retrieval, Department of Computer Science, University of Massachusetts
  58. postscript f
ile  Adobe Portable Document Format (PDF) fileInformation Space Based on HTML Structure, page 601
    G. Newby, University of North Carolina, Chapel Hill
  59. postscript f
ile  Adobe Portable Document Format (PDF) fileWeb Document Retrieval Using Passage Retrieval, Connectivity Information, and Automatic Link Weighting--TREC-9 Report, page 611
    F. Crivellari, M. Melucci, University of Padova (Italy)
  60. postscript f
ile  Adobe Portable Document Format (PDF) fileThe Thisl SDR System at TREC-9, page 627
    S. Renals, D. Abberley, University of Sheffield, UK
  61. postscript f
ile  Adobe Portable Document Format (PDF) fileUniversity of Sheffield TREC-9 Q&A System, page 635
    S. Scott, R. Gaizauskas, University of Sheffield
  62. postscript f
ile  Adobe Portable Document Format (PDF) fileThe Mirror DBMS at TREC-9, page 171
    A.P. de Vries, CWI, Amsterdam, The Netherlands
  63. postscript f
ile  Adobe Portable Document Format (PDF) fileTREC-9 Cross-lingual Retrieval at BBN, page 106
    J. Xu, R. Weischedel, BBN Technologies
  64. postscript f
ile  Adobe Portable Document Format (PDF) fileSheffield Interactive Experiment at TREC-9, page 645
    M. Beaulieu, H. Fowkes, H. Joho, University of Sheffield, UK
  65. postscript f
ile  Adobe Portable Document Format (PDF) fileReflections on "Aboutness" TREC-9 Evaluation Experiments at Justsystem, page 281
    S. Fujita, Justsystem Corporation
  66. postscript f
ile  Adobe Portable Document Format (PDF) fileIncrementality, Half-life, and Threshold Optimization for Adaptive Document Filtering, page 589
    A. Arampatzis, J. Beney, C.H.A. Koster, T.P. van der Weide, University of Nijmegen
  67. postscript f
ile  Adobe Portable Document Format (PDF) fileACSys/CSIRO TREC-9 Experiments, page 167
    D. Hawking, CSIRO Mathematics and Information Sciences
  68. postscript file  Adobe Portable Document Format (PDF) fileKasetsart University TREC-9 Experiments, page 289
    P. Narasetsathaporn, A. Rungsawang, Kasetsart University, Bangkok, Thailand
  69. postscript f
ile  Adobe Portable Document Format (PDF) fileSabIR Research at TREC-9, page 475
    C. Buckley, J. Walz, SabIR Research
  70. postscript f
ile  Adobe Portable Document Format (PDF) fileA Simple Question Answering System, page 249
    R. J. Cooper, S.M. Rüger, Imperial College of Science, Technology and Medicine
  71. postscript f
ile  Adobe Portable Document Format (PDF) fileTREC-9 Experiments at Maryland: Interactive CLIR, page 543
    D.W. Oard, G-A Levow, C.I. Cabezas, University of Maryland
  72. postscript f
ile  Adobe Portable Document Format (PDF) fileLogical Analysis of Data in the TREC-9 Filtering Track,
    page 453
    E. Boros, P.B. Kantor, D.J. Neu, Rutgers University
  73. postscript f
ile  Adobe Portable Document Format (PDF) fileAnother Sys Called Qanda, page 369
    E. Breck, J. Burger, L. Ferro, W. Greiff, M. Light, I. Mani, J. Rennie,
    The MITRE Corporation

APPENDICES


postscript file   Adobe Portable Document Format (PDF) fileTREC-9 Results, page A-1 and
Evaluation Techniques and Measures, page A-15

TREC-9 System Descriptions


Last updated: Wednesday, 02-Mar-05 14:37:42
Date created: Tuesday, 01-Aug-00
trec@nist.gov