NIST Special Publication:
SP 500-255

The Twelfth Text Retrieval Conference
(TREC 2003)

Return to the TREC home page TREC home    Return to Publications home Publications home Return to the TREC Document Help home page Help          National Institute of Standards and Technology Home Page

Portions of these proceedings are available in either PS and/or PDF formats. Papers need to be saved before viewing in the appropriate software. For additional information on these utilities, please reference the [help] file.

The inclusion or omission of a particular company or product implies neither endorsement nor criticism by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own and do not necessarily reflect those of the sponsors.


TABLE OF CONTENTS


postscript file   Adobe Portable Document Format
 (PDF) fileFOREWORD

 postscript file   Adobe Portable Document Format (PDF) fileABSTRACT

PAPERS

Proceedings Papers

  1. postscript file postscript file Overview of TREC 2003, page 1
    E. M. Voorhees, National Institute of Standards and Technology (NIST)

  2. postscript file postscript file TREC GENOMICS Track Overview, page 14
    W. Hersh, R.T. Bhupatiraju, Oregon Health and Science University

  3. postscript file postscript file HARD Track Overview in TREC 2003
    High Accuracy Retrieval from Documents
    , page 24
    J. Allan, University of Massachusetts Amherst

  4. postscript file postscript file Overview of the TREC 2003 Novelty Track, page 38
    I. Soboroff, D. Harman, NIST

  5. postscript file postscript file Overview of the TREC 2003 Question Answering Track, page 54
    E.M. Voorhees, National Institute of Standards and Technology (NIST)

  6. postscript file postscript file Overview of the TREC 2003 Robust Retrieval Track, page 69
    E.M. Voorhees, National Institute of Standards and Technology (NIST)

  7. postscript file postscript file Overview of the TREC 2003 Web Track, page 78
    N. Craswell, D. Hawking, CSIRO ICT Centre

  8. postscript file postscript file Recognizing Gene and Protein Function in MEDLINE Abstracts, page 93
    R.D. Hull, L.F. Waldman, Axontologic, Inc.

  9. postscript file postscript file TREC 2003 QA at BBN: Answering Definitional Questions, page 98
    J. Xu, A. Licuanan, R. Weischedel, BBN Technologies

  10. postscript file postscript file REGEN: Retrieval and Extraction of Genomics Data, page 107
    R. Guillen, T. Ferdous, California State University San Marcos

  11. postscript file postscript file TREC12 HARD Track at ISCAS, page 117
    Z. Wu, L. Du, L. Sun, S. Ye, Chinese Academy of Science

  12. postscript file postscript file NLPR at TREC 2003: Novelty and Robust, page 126
    Q. Jin, J. Zhao, B. Xu, Chinese Academy of Science

  13. postscript file postscript file TREC 2003 Novelty and Web Track at ICT, page 138
    J. Sun, Z. Yang, W. Pan, H. Zhang, B. Wang, X. Cheng, Chinese Academy of Sciences

  14. postscript file postscript file TREC 2003 Question Answering Track at CAS-ICT, page 147
    Y. Chang, H. Xu, S. Bai, Chinese Academy of Sciences

  15. postscript file postscript file Clairvoyance Corporation Experiments in the TREC 2003 High Accuracy Retrieval from Douments (HARD) Track, page 152
    J.G. Shanahan, J. Bennett, D.A. Evans, D.A. Hull, J. Montgomery, Clairvoyance Corporation

  16. postscript file postscript file Use of Metadata for Question Answering and Novelty Tasks, page 161
    K.C. Litkowski, CL Research

  17. postscript file postscript file Combining Structural Information and the Use of Priors in Mixed Named-Page and Homepage FInding, page 177
    P. Ogilvie, J. Callan, Carnegie Mellon University

  18. postscript file postscript file The JAVELIN Question-Answering System at TREC 2003: A Multi-Strategh Approach with Dynamic Planning, (this paper not in hard-copy proceedings)
    E. Nyberg, T. Mitamura, J. Callan, J. Carbonnell, R. Frederking, K. Collins-Thompson, L. Hiyakumoto, Y. Huang, C. Huttenhower, S. Judy, J. Ko, A. Kupsc, L.V. Lita, V. Pedro, D. Svoboda, and B. Van Durme, Carnegie Mellon University

  19. postscript file postscript file A Hybrid Approach for QA Track Definitional Questions, page 185
    S. Blair-Goldensohn, K.R. McKeown, A.H. Schlaikjer, Columbia University

  20. postscript file postscript file TREC12 Web and Interactive Tracks at CSIRO, page 193
    N. Craswell, D. Hawking, T. Upstill, A. McLean, R. Wilkinson, M. Wu, CSIRO

  21. postscript file postscript file Task Descriptions: Web Track 2003, page 204
    N. Craswell, D. Hawking, R. Wilkinson, M. Wu, CSIRO

  22. postscript file On the Use of MeSH Headings to Improve Retrieval Effectiveness, page 215
    S. Blott, C. Gurrin, G.J.F. Jones, A.F. Smeaton, T. Sodring, Dublin City University

  23. postscript file postscript file Searching for geneRIFs: Concept-Based Query Expansion and Bayes Classification, page 225
    R. Jelier, M. Schuemie, C. van der Eijk, M. Weeber, E. van Mulligen, B. Schijvenaars, B. Mons, J. Kors, Erasmus University Medical Center Rotterdam

  24. postscript file postscript file Fondazione Ugo Bordoni at TREC 2003: Robust and Web Track, page 234
    G. Amati, C. Carpineto, G. Romano, Fondazione Ugo Bordoni

  25. postscript file postscript file FDUQA on TREC2003 QA task, page 246
    L. Wu, X. Huang, Y. Zhou, Y. Du, L. You, Fudan University

  26. postscript file postscript file Robust, Web and Genomic Retrieval with Hummingbird SearchServer at TREC 2003, page 254
    S. Tomlinson, Hummingbird

  27. postscript file postscript file IBM Research and the University of Colorado TREC 2003 Genomics Track, page 268
    E.W. Brown, IBM TJ Watson Research Center
    A. Dolbey, L. Hunter, University of Colorado

  28. postscript file postscript file Juru at TREC 2003 - Topic Distillation using Query-Sensitive Tuning and Cohesiveness Filtering, page 276
    E. Amitay, D. Carmel, A. Darlow, M. Herscovici, R. Lempel, A. Soffer, IBM Haifa Research Lab
    R. Kraft, J. Zien, IBM Almaden Research Center

  29. postscript file postscript file IBM's PIQUANT in TREC2003, page 283
    J. Prager, J. Chu-Carroll, K. Czuba, C. Welty, A. Ittycheriah, R. Mahindru, IBM T.J. Watson Research Center

  30. postscript file postscript file From TREC to DUC to TREC Again, page 293
    J.M. Conroy, IDA/Center for Computing Sciences, D.M. Dunlavy
    D.P. O'Leary, University of Maryland

  31. postscript file postscript file Generic Text Summarization Using Wordnet for Novelty and Hard, page 303
    G. Ramakrishnan, K. Bellare, C. Shah, D. Paranjpe, Indian Institute of Technology

  32. postscript file postscript file Passage Scoring for Question Answering via Bayesian Inference on Lexical Relations, page 305
    D. Paranjpe, G. Ramakrishnan, S. Srinivasan, Indian Instutue of Technology

  33. postscript file postscript file IIT at TREC 2003, Task Classification and Document Structrure for Known-Item Search, page 311
    S. Beitzel, E. Jensen, R. Cathey, L. Ma, D. Grossman, O. Frieder, Illinois Institute of Technology
    A. Chowdhury, G. Pass, H. Vandermolen, America Online, Inc.

  34. postscript file postscript file Identifying Gene Function Descriptions by Probability-based Sentence Selection, page 321
    K. Seki, N. Sheth, J. Mostafa, Indiana University

  35. postscript file postscript file WIDIT in TREC-2003 Web Track, page 328
    K. Yang, Indiana University

  36. postscript file postscript file TREC NOVELTY TRACK AT IRIT-SIG, page 337
    T. Dkaki, Institut de Recherche en Informatique de Toulouse, Universite Toulouse le Morail
    J. Mothe, Institut de Recherche en Informatique de Toulouse, Institut Unviersitaire de Formation des Maitres Midi-Pyrenees

  37. postscript file postscript file Mercure at TREC 2003 Web track - Topic Distillation Task, page 343
    M. Boughanem, K. Sauvagnat, C. Laffaire, IRIT-SIG

  38. postscript file postscript file ITC-irst at TREC 2003: the DIOGENE QA System, page 349
    M. Kouylekov, B. Magnini, M. Negri, H. Tanev, ITC-Irst

  39. postscript file postscript file Combining Methods for the TREC 2003 Robust Track, page 358
    J. Mayfield, P. McNamee, Johns Hopkins University Applied Physics Laboratory

  40. postscript file postscript file Report on the TREC 2003 Experiments Using Web Topic-Centric Link Analysis, page 363
    P. Ingongngam, A. Rungsawang, Kasetsart Unviersity

  41. postscript file postscript file Biomedical Text Retrieval System at Korea University, page 368
    Y.-I. Song, K.-S. Han, H.-C. Seo, S.-B. Kim, H.-C. Rim, Korea University

  42. postscript file postscript file Answer Mining by Combining Extraction Techniques with Abductive Reasoning, page 375
    S. Harabagiu, D. Moldovan, C. Clark, M. Bowden, J. Williams, J. Bensley, Language Computer Corporation

  43. postscript file postscript file A Non-Functional Prototype at TREC 2003, page 383
    B.D. Davison, W. Zhang, J. Miller, Lehigh University

  44. postscript file postscript file The Role and Meaning of Predicative and Non-Predicative Definitions in the Search for Information, page 386
    I.S. Geller, LexiClone Inc.

  45. postscript file postscript file AnswerFinder in TREC 2003, page 392
    D. Molla, Macquarie University

  46. postscript file postscript file Meiji University Web and Novelty Track Experiments at TREC 2003, page 399
    R. Ohgaya, A. Shimmura, T. Takagi, Meiji University

  47. postscript file postscript file Microsoft Research Asia at the Web Track of TREC 2003, page 408
    J. Wen, R. Song, D. Cai, K. Zhu, S. Yu, S. Ye, W.-Y. Ma, Microsoft Research Asia

  48. postscript file postscript file Microsoft Cambridge at TREC-12: HARD track, page 418
    S.E. Robertson, H. Zaragoza, M. Taylor, Microsoft Research Ltd.

  49. postscript file postscript file Integrating Web-based and Corpus-based Techniques for Question Answering, page 426
    B. Katz, J. Lin, D. Loreto, W. Hildebrandt, M. Bilotti, S. Felshin, A. Fernandes, G. Marton, F. Mora, MIT Computer Science and Artificial Intelligence Laboratory

  50. postscript file postscript file MITRE's Qanda at TREC-12, page 436
    J.D. Burger, The MITRE Corporation

  51. postscript file postscript file Methods for Accurate Retrieval of MEDLINE Citations in Functional Genomics, page 441
    M. Kayaalp, A.R. Aronson, S.M. Humphrey, N.C. Ide, L.K. Tanabe, L.H. Smith, D. Demner, R.R. Loane, J.G. Mork, O. Bodenreider, National Library of Medicine
    D. Demner, University of Maryland, College Park

  52. postscript file postscript file Finiding Gene Function using LitMiner, page 451
    B. de Bruijn, J. Martin, National Research Coucil of Canada

  53. postscript file postscript file Experiments in TREC 2003 Genomics Track at NTT, page 460
    H. Taira, T. Izumitani, T. Hirao, H. Isozaki, H. Kazawa, E. Maeda, NTT Communication Science Laboratories

  54. postscript file postscript file SVM Approach to GeneRIF Annotation, page 468
    W.-J. Hou, C.-Y. Teng, C. Lee, H.-H. Chen, National Taiwan University

  55. postscript file postscript file Approach of Information Retrieval with Reference Corpus to Novelty Detection, page 474
    M.-F. Tsai, M.-H. Hsu, H. and H.-H. Chen, National Taiwan University

  56. postscript file postscript file QUALIFIER In TREC-12 QA Main Task, page 480
    H. Yang, H. Cui, M. Maslennikov, L. Qiu, M.-Y. Kan, T. Chua, National University of Singapore

  57. postscript file postscript file A Language Modeling Approach to Passage Question Answering, page 489
    D. Zhang, W.S. Lee, National University of Singapore-MIT Alliance

  58. postscript file postscript file Oce at TREC 2003, page 496
    P. Iljin, R. Brand, S. Driessen, J. Klok, Oce-Technologies B.V.

  59. postscript file postscript file Phrases, Boosting, and Query Expansion Using External Knowledge Resources for Genomic Information Retrieval, page 503
    W. Hersh, R.T. Bhupatiraju, S. Price, Oregon Health and Science University

  60. postscript file postscript file TREC 2003 Robust, HARD and QA Track Experiments using PIRCS, page 510
    L. Grunfeld, K.L. Kwok, N. Dinstl, P. Deng, Queens College, CUNY

  61. postscript file postscript file Partioning a Graph of Sequences, Structures and Abstracts for Information Retrieval, page 522
    A. Dayanik, Rutgers University
    C. Nevill-Manning, Google, Inc.
    R.Oughtred, Rutgers University

  62. postscript file postscript file Rutgers' HARD and Web Interactive Track Experiments at TREC 2003, page 532
    N.J. Belkin, D. Kelly, H.-J. Lee, Y.-L. Li, G. Muresan, M.-C. Tang, X.-J. Yuan, X.-M. Zhang, Rutgers University

  63. postscript file postscript file Combining First and Second Order Features in the TREC 2003 Robust Track, page 544
    E. Boros, P.B. Kantor, D.J. Neu, Rugters University

  64. postscript file postscript file Knowledge-Based Access to the Bio-Medical Literature, Ontologically-Grounded Experiments for the TREC 2003 Genomics Track, page 547
    R. Tong, Tarragon Cosulting Corporation
    J. Quackenbush, The Institute for Genomic Research
    M. Snuffin, Tarragon Cosulting Corporation, DataNaut, Inc.

  65. postscript file postscript file THUIR at TREC 2003: HARD Experiments, page 552
    L. Ma, W. Tan, Q. Chen, S. Ma, Tsinghua University
    S. Shi, S. Xiao, H. Wang, H. Wang, Beijing Information Technology Institute

  66. postscript file postscript file THUIR at TREC 2003: Novelty, Robust and Web, page 556
    M. Zhang, C. Lin, Y. Liu, L. Zhao, S. Ma, Tsinghua University

  67. postscript file postscript file Document Structure with IR Tools, page 568
    G.B. Newby, University of Alaska Fairbanks

  68. postscript file postscript file Questioning Answering By Pattern Matching, Web-Proofing, Semantic Form Proofing, page 578
    M. Wu, X. Zheng, M. Duan, T. Liu, T. Strzalkowski, SUNY Albany

  69. postscript file postscript file The University of Amsterdam at the TREC 2003 Question Answering Track, page 586
    V. Jijkoun, G. Mishne, C. Monz, M. de Rijke, S. Schlobach, O. Tsur, University of Amsterdam

  70. postscript file postscript file Approaches to Robust and Web Retrieval, page 594
    J. Kamps, C. Monz, M. de Rijke, B. Sigurbjornsson, Language and Inference Technology Group, University of Amsterdam

  71. postscript file postscript file Bangor at TREC 2003: Q&A and Genomics Tracks, page 600
    T. Clifton, A. Colquhoun, W. Teahan, University of Wales, Bangor

  72. postscript file postscript file BioText Team Report for the TREC 2003 Genomics Track, page 612
    G. Bhalotia, P.I. Nakov, A.S. Schwartz, M.A. Hearst, University of California Berkeley

  73. postscript file postscript file Edinburgh-Stanford TREC-2003 Genomics Track, page 622
    M. Osborne, M. Cuminskey, G. Sinclair, M. Smillie, B. Webber, University of Edinburgh
    J. Chang, N. Mehra, V. Rotemberg, R.B. Altman, Stanford University

  74. postscript file QED: The Edinburgh TREC-2003 Question Answering System, page 631
    J.L. Leidner, J. Bos, T. Dalmas, J.R. Curran, S. Clark, C.J. Bannard, B. Webber, M. Steedman, University of Edinburgh

  75. postscript file postscript file University of Glasgow at the Robust Track- A Query-based Model Selection Approach for the Poorly-Performing Queries, page 636
    B. He, I. Ounis, University of Glasgow

  76. postscript file postscript file University of Glasgow at the Web Track: Dynamic Application of Hyperlink Analysis using the Query Scope, page 646
    V. Plachouras, I. Ounis, C.J. van Rijsbergen, University of Glasgow
    F. Cacheda, University of A Coruna

  77. postscript file postscript file UIC at TREC-2003: Robust Track, page 653
    S. Liu, C. Yu, University of Illinois at Chicago

  78. postscript file postscript file Active Feedback - UIUC TREC-2003 HARD Experiments, page 662
    X. Shen, C.X. Zhai, Department of Computer Science, University of Illinois at Urbana-Champaign

  79. postscript file postscript file Improving the Robustness of Language Models - UIUC TREC 2003 Robust and Genomics Experiments, page 667
    C. X. Zhai, T. Tao, H. Fang, Z. Shang, University of Illinois at Urbana-Champaign

  80. postscript file postscript file Relevance Propagation for Topic Distillation UIUC TREC 2003 Web Track Experiments, page 673
    A. Shakery, C. X. Zhai, University of Illinois at Urbana-Champaign

  81. postscript file postscript file Experiments in Novelty, Genes and Questions at the University of Iowa, page 678
    D. Eichmann, P. Srinivasan, M. Light, H. Wang, X. Y. Qiu, R.J. Arens, A. Sehgal, The University of Iowa

  82. postscript file postscript file Question Answering using the DLT System at TREC 2003, page 686
    R.F.E. Sutcliffe, I. Gabbay, M. Mulcahy, K. White, University of Limmerick

  83. postscript file postscript file UMBC at TREC 12, page 699
    S. Kallukar, Y. Shi, R.S. Cost, C. Nicholas, A. Java, C. James, S. Rajavaram, V. Shanbhag, S. Bhatkar, D. Ogle, Univeresity of Maryland Baltimore County

  84. postscript file postscript file HARD Experiment at Maryland: From Need Negotiation to Automated HARD Process, page 707
    D. He, D. Demner-Fushman, Univeresity of Maryland

  85. postscript file postscript file UMass at TREC 2003: HARD and QA, page 715
    N. AbdulJaleel, A. Corrada-Emmanuel, Q. Li, X. Liu, C. Wade, J. Allan, University of Massachusetts Amherst

  86. postscript file postscript file Robust and Web Retrieval with Document-Centric Integral Impacts, page 726
    V.N. Anh, A. Moffat, The University of Melbourne

  87. postscript file postscript file The University of Michigan at TREC 2003, page 732
    J. Otterbacher, H. Qi, A. Hakim, D. Radev, University of Michigan

  88. postscript file postscript file Report on the TREC 2003 Experiment: Genomic and Web Searches, page 739
    J. Savoy, Y. Rasolofo, L. Perret, University of Neuchatel

  89. postscript file postscript file UB at TREC 12: HARD and Genomics Tracks, page 751
    M. Srikanth, M.E. Ruiz, R. Srihari, SUNY at Buffalo

  90. postscript file postscript file Report on the TREC 2003 Experiment: Genomic Track, page 756
    P. Ruch, G. Cohen, F. Ehrler, H. Muller, University Hospital of Geneva
    P. Ruch, G. Coray, H. Ghorbel, V. Pallotta, Swiss Federal Institute of Technology
    C. Chichester, GeneBio SA
    F. Ehrler, AI Laboratory, University of Geneva

  91. postscript file postscript file QA UdG-UPC System at TREC-12, page 762
    M. Massot, Universitat de Girona,
    H. Rodriguez, D. Ferres, Universitat Politecnica de Catalunya

  92. postscript file postscript file Multiple-Engine Question Answering in TextMap, page 772
    A. Echihabi, U.Hermjakob, E. Hovy, D. Marcu, E. Melz, D. Ravichandran, Information Sciences Institute, University of Southern California

  93. postscript file postscript file The University of Sheffield's TREC 2003 Q&A Experiments, page 782
    R. Gaizauskas, M.A. Greenwood, M. Hepple, I. Roberts, H. Saggion, M. Sargaison, University of Sheffield

  94. postscript file postscript file Towards a Sense Based Document Representation for Internet Information Retrieval, page 791
    C. Stokoe, J. Tait, University of Sunderland

  95. postscript file postscript file TREC 2003 Genomics Track Experiments at UTA: Query Expansion with Predefinded High Frequency Terms, page 796
    A. Pirkola, E. Leppanen, University of Tampere (UTA)

  96. postscript file postscript file A Method to Retrieve Papers from MEDLINE: PETER System, page 806
    H. Ao, Y. Yamamoto, T. Takagi, University of Tokyo

  97. postscript file postscript file Task-Specific Query Expansion (MultiText Experiments for TREC 2003), page 810
    D.L. Yeung, C.L.A. Clarke, G.V. Cormack, T.R. Lynam, E.L. Terra, University of Waterloo

  98. postscript file postscript file Interactive Search Refinement Techniques for HARD Tasks, page 820
    O. Vechtomova, E. Lam, University of Waterloo
    M. Karamuftuoglu, Bilkent University

  99. postscript file postscript file Ranking Function Discovery by Genetic Programming for Robust Retrieval, page 828
    L. Wang, W. Fan, R. Yang, W. Xi, M. Luo, Y. Zhou, E.A. Fox, Virginia Polytechnic Insitute and State University
    L. Wang, University of Michigan

  100. postscript file postscript file VT at TREC-2003: The Web Track Report, page 837
    R. Yang, L. Wang, W. Fan,, W. Xi, M. Luo, Y. Zhou, E.A. Fox, Virginia Polytechnic Insitute and State University
    L. Wang, University of Michigan

    APPENDICES

    TREC 2003 System Descriptions





Last updated: Wednesday, 02-Mar-2005 14:36:24 EST
Date created: Friday, 06-Feb-04
trec@nist.gov