Text REtrieval Conference (TREC) 2011 Proceedings

NIST Special Publication: SP 500-296 The Twentieth Text REtrieval Conference (TREC 2011) Proceedings
TREC home Publications home Indexed by Track Help

NOTE: All papers are available in PDF format. The inclusion or omission of a particular company or product implies neither endorsement nor criticism by NIST. Any opinions, findings, and conclusions or recommendations expressed in the individual papers are the authors' own and do not necessarily reflect those of the sponsors.

Overview Papers Overview of the TREC 2011 Chemical IR Track Mihai Lupu, Vienna University of Technology Zhao Jiashu, Jimmy Huang, York University Harsha Gurulingappa, Juliane Fluck, Marc Zimmerman, Fraunhofer SCAI Igor Filippov, National Institutes of Health John Tait, johntait,net Ltd. Overview of the TREC 2011 Entity Track Krisztian Balog, NTNU Pavel Serdyukov, Yandex Arjen P. de Vries, CWI Overview of the TREC 2011 Legal Track Maura R. Grossman, Wachtell, Lipton, Rosen & Katz Gordon V. Cormack, University of Waterloo Bruce Hedin, H5 Douglas W. Oard, University of Maryland, College Park Overview of the TREC 2011 Microblog Track Iadh Ounis, Craig Macdonald, University of Glasgow Jimmy Lin Twitter and University of Maryland, College Park Ian Soboroff, NIST Overview of the TREC 2011 Session Track Evangelos Kanoulas, Mark Hall, Paul Clough, University of Sheffield Ben Carterette, University of Delaware Mark Sanderson, RMIT University Overview of the TREC 2011 Web Track Charles L. A. Clarke, University of Waterloo Nick Craswell, Microsoft Ian Soboroff, Ellen M. Voorhees, NIST
Papers AEHRC & QUT at TREC 2011 Medical Track: A Concept-Based Information Retrieval Approach Beval Koopman, Australian e-Health Research Center and Queensland University of Technology Michael Lawley, Australian e-Health Research Center Peter Bruza, Laurianne Sitbon, Queensland University of Technology Webis at the TREC 2011 Session Track Matthias Hagen, Jan Grassegger, Maximilian Michel, Benno Stein, Bauhaus-Universität Weimar PRIS at TREC 2011 Legal Track Discovery Based on Relevant Feedback Jiayue Zhang, Wenyi Yang, Xi Wang, Lihua Wu, Yongtian Zhang, Weiran Xu, Guang Chen, Juo Guo, Beijing University of Posts and Telecommunications (PRIS team) PRIS at TREC 2011 Medical Record Track Jiayue Zhang, Xueneng Lin, Yang Zou, Shuai Zhu, Jing Xiao, Weiran Xu, Guang Chen, Jun Guo, Beijing University of Posts and Telecommunications (PRIS team) PRIS at TREC 2011 Microblog Track Yan Li, Zhenhua Zhang, Wenlong Lv, Qianlong Xie, Yuhang Lin, Rao Xu, Weiran Xu, Guang Chen, Jun Guo, Beijing University of Posts and Telecommunications (PRIS team) PRIS at TREC 2011 Entity Track: Related Entity Finding and Entity List Completion Zhanyi Wang, Wenlong Lv, Heng Li, Wenyuan Zhou, Li Zhang, Xiao Mo, Liaoming Zhou, Weiran Xu, Guang Chen, Juo Guo, Beijing University of Posts and Telecommunications (PRIS team) BUPT_WILDCAT at TREC Crowdsourcing Track: Crowdsourcing for Relevance Evaluation Tao Xia, Chuang Zhang, Tai Li, Jingjing Xie, Beijing University of Posts and Telecommunications BUPT_WILDCAT at TREC 2011 Session Track Tang Liu, Chunag Zhang, Yasi Gao, Wenjun Xiao, Hao Huang, Beijing University of Posts and Telecommunications BiTeM Group Report for TREC Chemical IR Track 2011 Julien Gobeill, Arnaud Gaudinat, Patrick Ruch, BiTeM Group, University of Applied Studies Emilie Pasche, Douglas Teodoro, Dina Vishnyakova, BiTeM Group, University and Hospitals of Geneva BiTeM Group Report for TREC Medical Records Track 2011 Julien Gobeill, Arnaud Gaudinat, Patrick Ruch, BiTeM Group, University of Applied Studies Emilie Pasche, Douglas Teodoro, Dina Vishnyakova, BiTeM Group, University and Hospitals of Geneva Evaluating Learning-to-Rank Methods in the Web Track Adhoc Task Leonid Boytsov, Anna Belova How to Make Manual Conjunctive Normal Form Queries Work in Patents Search Le Zhao, Jamie Callan, Carnegie Mellon University Cengage Learning at TREC 2011 Medical Track Benjamin King, University of Michigan Lijun Wang, Wayne State University Ivan Provalov, Jerry Zhou, Cengage Learning ICTNET at Entity ELC TREC 2011 Bingyang Liu, Fan Yang, Lei Cao, Xueqi Cheng, Yue Liu, Hongbo Xu, Chinese Academy of Sciences (ICTNET team) ICTNET at Microblog Track TREC 2011 Peng Cao, Jinhua Gao, Yubao Yu, Shenghua Liu, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences (ICTNET team) ICTNET at Session Track TREC 2011 Mingxhuan Wei, Yuanhai Xue, Chen Xu, Xiaoming Yu, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences (ICTNET team) ICTNET at Web Track 2011 Ad-Hoc Track Heyuan Li, Yuanhai Xue, Xu Chen, Xiaoming Yu, Feng Guan, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences (ICTNET team) ICTNET at Web Track 2011 Diversity Track Shengxian Wan, Yuanhai Xue, Xiaoming Yu, Feng Guan, Yue Liu, Xueqi Cheng, Chinese Academy of Sciences (ICTNET team) Author Model and Negative Feedback Methods on TREC 2011 Microblog Track Rui Li, Binjie Wei, Kai Lu, Bin Wang, Chinese Academy of Sciences Exploring Tweets Normalization and Query Time Sensitivity for Twitter Search Zhongyu Wei, Langun Zhou, Binyang Li, Kam-Fai Wong, The Chinese University of Hong Kong W Gao, Qatar Computing Research Institute Kam-Fai Wong, Ministry of Education, China A Hierarchical Bayesian Model of Crowdsourced Relevance Coding Bob Carpenter, Columbia University DUTIR at TREC 2011 Chemistry Track Ping Zhang, Hongfei Lin, Jiajin Wu, Yuan Lin, Dalian University of Technology DUTIR at TREC 2011 Microblog Track Cunhui Shi, Kejiang Ren, Hongfei Lin, Shaowu Zhang, Dalian University of Technology DUTIR at the Session Track in TREC 2011 Wenfei Liu, Hongfei Lin, Yunlong Ma, Tianshu Chang, Dalian University of Technology Managing the Quality of Large-Scale Crowdsourcing Jeroen B. P. Vuurens, Carsten Eickhoff, Delft University of Technology Arjen P. de Vries, Centrum Wiskunde & Informatica CWI at TREC 2011: Session, Web, and Medical Jiyin He, Vera Hollink, Corrado Boscarino, Arjen de Vries, Centrum Wiskunde en Informatica (CWI) Roberto Cornaccia, Spinque WISTUD at TREC 2011: Microblog Track: Exploiting Background Knowledge from DBpedia and News Articles for Search on Twitter Ke Tao, Fabian Abel, Claudia Hauff, Delft University of Technology DEMIR at TREC Medical 2011: Power of Term Phrases in Medical Text Retrieval Okan Ozturkmenoglu, Adil Alpkocak, Dokuz Eylul University DutchHatTrick: Semantic Query Modeling, ConText, Section Detection, and Match Score Maximization Martjin Schuemie, ErasmusMC Dolf Trieschnigg, University of Twente Edgar Meij, University of Amsterdam FUB, IASI-CNR, UNIVAQ at TREC 2011 Microblog Track Gianni Amati, Giuseppe Amodeo, Marco Bianchi, Giuseppe Marcone, Fondazione Ugo Bordoni Giuseppe Amodeo, Carlo Gaibisso, Giorgio Gambosi, IASI-CNR Giuseppe Amodeo, Alessandro Celi, Cesidio De Nicola, Michele Flammini, Univ. dell' Aquila Chemical Structure Reconstruction with chemoCR Marc Zimmermann, Fraunhofer-Institute for Algorithms and Scientific Computing (SCAI) Information Retrieval Framework for Technology Survey in Biomedical and Chemistry Literature Harsha Gurulingappa, Bernd Müller, Martin Hofmann-Apitius, Juliane Fluck, Fraunhofer Institute for Algorithms and Scientific Computing (SCAI) Harsha Gurulingappa, Martin Hofmann-Apitius, Bonn-Aachen International Center for Information Technology (B-IT) A Semantic Platform for Information Retrieval from E-Health Records Harsha Gurulingappa, Bernd Müller, Martin Hofmann-Apitius, Juliane Fluck, Fraunhofer Institute for Algorithms and Scientific Computing (SCAI) Harsha Gurulingappa, Martin Hofmann-Apitius, Bonn-Aachen International Center for Information Technology (B-IT) Microblog Track 2011 of FDU Bingqing Wang, Xuanjing Huang, Fudan University Imago: Open-Source Toolkit for 2D Chemical Structure Image Recognition Viktor Smolov, Fedor Zentsev, Mikhail Rybalkin, GGA Software Services LLC GUCAS at TREC 2011 Microblog Track Xin Zhang, Kai Hui, Ben He, Tiejian Luo, Graduate University of Chinese Academy of Sciences HIT_LTRC at TREC 2011 Microblog Track Yun Li, Xishuang Dong, Yi Guan, Harbin Institute of Technology Heliod at TREC Legal 2011: Learning to Rank from Relevance Feedback for e-Discovery Peter Lubell-Doughtie, Kenneth Hamilton, Helioid, Inc. Cluster-Based Relevance Feedback: Legal Track 2011 Kripabandhu Ghosh, Swapan Kumar Parui, Indian Statistical Institute Prasenjit Majumder, Dhirubhai Ambani Institute of Information and Communication Technology Query Expansion for Microblog Retrieval Ayan Bandyopadhyay, Mandar Mitra, ISI Kolkata Prasenjit Majumder, DAIICT Gandhinagar IRIT at TREC Microblog 2011 Firas Damak, Lamjed Ben Jabeur, Guillaume Cabanac, Karen Pinel-Sauvagnat, Lynda Tamine, Mohand Boughanem, IRIT/SIG-RFI IRIT at TREC 2011: Evaluation of Query Expansion Techniques for Medical Record Retrieval Duy Dinh, Lynda Tamine, IRIT Laboratory, Paul Sabatier University ISTI@TREC Microblog Track 2011: Exploring the Use of Hashtag Segmentation and Text Quality Ranking Giacomo Berardi, Andrea Esuli, Diego Marcheggiani, Fabrizio Sebastiani, ISTI-CNR, NEMIS Lab BEST of KAUST at TREC 2011: Building Effective Search in Twitter Jinling Jiang, Lailatul Hidayah, Hany Ramadan, King Abdullah University of Science and Technology (KAUST) Tamer Elsayed, Microsoft Research Advanced Technology Lab, Cairo, Egypt Realtime Ad Hoc Search in Twitter: Know-Center at TREC Microblog Track 2011 Christopher Horn, Oliver Pimas, Michael Granitzer, Elisabeth Lex, Know-Center Graz TREC 2011 Microblog Track Experiments at Kobe University Taiki Miyanishi, Naoto Okamura, Xiaoxi Liu, Kazuhiro Seki, Kuniaki Uehara, Kobe University LIA at TREC 2011 Web Track: Experiments on the Combination of Online Resources Romain Deveaud, Eric SanJuan, LIA-CERI Patrice Bellot, LSIS Exploiting Social #-Tagging Behavior in Twitter for Information Filtering and Recommendation Ernesto Diaz-Aviles, Patrick Siehndel, Kaweh Djafari Naini, L3S Research Center Empirical Ontologies for Cohort Identification Stephen Wu, Kavishwar Wagholikar, Sunghwan Sohn, Vinod Kaggal, Hongfang Liu, Mayo Clinic Finding Patient Visits in EMR Using LUXID® Luca Toldo, Alexander Scheer, Merck KGaA Microsoft Research at TREC 2011 Web Track Bodo Billerbeck, Nick Craswell, Dennis Fetterly, Marc Najork, Microsoft (msrsv team) MSRC at TREC 2011 Crowdsourcing Track Paul Bennett, Ece Kamar, Microsoft Research, Redmond Gabriella Kazai, Microsoft Research, Cambridge A Knowledge-Based Approach to Medical Records Retrieval Dina Demner-Fushman, Swapna Abhyankar, Antonio Jimeno-Yepes, Russell Loane, Bastien Rance, François Lang, Nicholas Ide, Emilia Apostolova, Alan R. Aronson, National Library of Medicine Search for Medical Records: NICTA at TREC 2011 Medical Track Sarvnaz Karimi, David Martinez, Sumukh Ghodke, Lawrence Cavedon, NICTA and the University of Melbourne Hanna Suominen, NICTA and ANU, CECS, Australia Lumin Zhang, Max Planck Institute for Biological Cybernetic, Germany NUSIS at TREC 2011 Microblog Track: Refining Query Results with Hashtags Hadi Amiri, Yang Bao, Anindya Datta, Xiaoying Xu, National University of Singapore Anqi Cui, Tsinghua National Lab for Information Science & Technology Learning Task Experiments in the TREC 2011 Legal Track Stephen Tomlinson, OpenText Identifying Patients for Clinical Studies from Electronic Health Records: TREC Medical Records Track at OHSU Steven Bedrick, Kyle Ambert, Aaron Cohen, William Hersh, Oregon Health and Science University PKU_ICST at TREC 2011 Microblog Track Feng Liang, Runwei Qiang, Jianwu Yang, Peking University Query Expansion and Message-Passing Algorithms for TREC Microblog Track Dzung Hong, Qifang Wang, Dan Zhang, Luo Si, Purdue University QCRI @ TREC 2011: Microblog Track Ali El-Kahki, Kareem Darwish, Qatar Computing Research Institute Microblog Retrieval Using Topical Features and Query Expansion Cher Han Lau, YueFeng Li, Dian Tjondondronegoro, Queensland University of Technology Recommind at TREC 2011 Legal Track Peter Zeinoun, Aaron Laliberte, Jan Puzicha, Howard Sklar, Craig Carpenter, Recommind RMIT at the Crowdsourcing Track of TREC 2011 MAtthias Petri, Mark Sanderson, Falk Scholer, RMIT University Search for Clinical Records: RMIT at Medical TREC Iman Amini, Mark Sanderson, RMIT University and NICTA David Martinez, NICTA Xiaodong Li, RMIT RGU-ISTI-Essex at TREC 2011 Session Track Ibrahim Adeyanju, Dawei Song, The Robert Gordon University Franco Maria Nardini, Consiglio Nazionale Delle Richerche M-Dyaa Albakour, Udo Kruschwitz, University of Essex RMIT at TREC 2011 Microblog Track Matthias Petri, J. Shane Culpepper, Falk Scholer, RMIT University RMIT at TREC 2011 Session Track Lorena Leal, Sadegh Kharazmi, Jasbir Dhaliwal, Mark Sanderson, Falk Scholer, Sargol Sadeghi, Fahad Alahmari, RMIT University Optical Structure Recognition Application Entry in Image2Structure Task Igor V. Filippov, SAIC-Frederick, Inc. Dmitry Katsubo, European Patent Office, The Hague Marc C. Nicklaus, NCI, NIH, DHHS, NCI-Frederick Rutgers at the TREC 2011 Session Track Chang Liu, Si Sun, Michael Cole, Nicholas J. Belkin, Rutgers University TongKey at Entity Track TREC 2011: Related Entity Finding Zhengcai Pan, Shnu University Haiguang Chen, TongKey Network Technology Co., Ltd. 10 Weeks to TREC: STIRS Siena's Twitter Information Retrieval System Sharon Gower Small, Darren Lim, Karl Appel, Denis Kalic, Matthew Kemmer, David Purcell, Carl Tompkins, Chan Tran, Siena College GeAnn at the TREC 2011 Crowdsourcing Track Carsten Eickhoff, TU Delft Christopher G. Harris, Padmini Srinivasan, The University of Iowa Arjen P. de Vries, CWI Auto-Relevancy and Responsiveness Baseline II Improving Concept Search to Establish a Subset with Maximized Recall for Automated First Pass and Early Assessment Using Latent Semantic Indexing [LSI], Bigrams and WordNet 3.0 Seeding Cody Bennett, TCDI DMIR on Microblog Track 2011 Wen Li, Carsten Eickhoff, TU Delft Arjen P. de Vries, CWI Medical-Miner at TREC 2011 Medical Records Track Juan Manuel Córdoba, Manuel Jesús Maña, Noa Patricia Cruz, Universidad de Huelva Jacinto Mata, Fernando Aparicio, Universidad Europea de Madrid Manuel de Buenaga, Daniel Glez-Peña, Florentino Fdez-Riverola, Universidad de Vigo The University Carlos III of Madrid at TREC 2011 Crowdsourcing Track Julin Urbano, Mónica Marrero, Diego Martín, Jorge Morato, Karina Robles, Juan Loréns, University Carlos III de Madrid UCD SIFT in the TREC 2011 Web Track David Leonard, Doychin Doychev, David Lillis, Fergus Toolan, Rem W. Collier, John Dunnion, University College Dublin UCD IIRG at TREC 2011 Medical Track James Cogley, Nicola Stokes, John Dunnion, Joe Carthy, University College Dublin Team COMMIT at TREC 2011 Marc Bron, Edgar Meij, Maria-Hendrike Peetz, Manos Tsagkias, Maaten de Rijke, University of Amsterdam The University of Amsterdam at the TREC 2011 Session Track Bouke Huurnink, Richard Berendsen, Katja Hofmann, Edgar Meij, Maarten de Rijke, University of Amsterdam Reducing Redundancy with Anchor Text and Spam Priors Marijn Koolen, Jaap Kamps, University of Amsterdam UALR at TREC 2011 Entity Track Venkata Swamy Martha, Halil Bisgin, Stephen Wallace, Nitin Agarwal, Xiaowei Xu, University of Arkansas at Little Rock Hermant Joshi, Acxiom Corporation LIA-iSmart at the TREC 2011 Entity Track: Entity List Completion Using Contextual Unsupervised Scores for Candidate Entities Ranking Ludovic Bonnefoy, University of Avignon, LIA-iSmart Patrice Bellot, Aix-Marseille University, LSIS Performance of MolRec at TREC 2011 Overview and Analysis of Results Noureddin M. Sadawi, Alan P. Sexton, Volker Sorge, University of Birmingham MetaMap is a Superior Baseline to a Standard Document Retrieval Engine for the Task of Finding Patient Cohorts in Clinical Free Text K. Bretonnel Cohen, Tom Christiansen, Lawrence E. Hunter, Univeristy of Colorado School of Medicine A Study of Pattern-Based Suptopic Discovery and Integration in the Web Track Wei Zheng, Hui Fang, University of Delaware Using Multiple External Collections for Query Expansion Dongqing Zhu, Ben Carterette, University of Delaware An Exploration of New Ranking Strategies for Medical Record Tracks Hao Wu, Hui Fang, University of Delaware Implicit Feedback and Document Filtering for Retrieval Over Query Sessions Ben Carterette, Praveen Chandar, University of Delaware Time-Sensitive Weighting for Microblog Retrieval Hao Wu, Hui Fang, University of Delaware Simple Rank-Based Filtering for Microblog Retrieval: Implications for Evaluation and Test Collections Ben Carterette, Naveen Kumar, Ashwani Rao, Dongqing Zhu, University of Delaware University of Essex at the TREC 2011 Session Track M-Dyaa Albakour, Udo Kruschwitz, Brendan Neville, Deirdre Lungely, Maria Fasli, University of Essex Nikolaos Nanas, Center for Research and Technology, Thessaly Online Topic Modeling for Real-Time Twitter Search Christan Grant, Clint P. George, Chris Jenneisch, Joseph N. Wilson, University of Florida University of Glasgow at TREC 2011: Experiments with Terrier in Crowdsourcing, Microblog, and Web Tracks Richard McCreadie, Craig Macdonald, Rodrygo L. T. Santos, Iadh Ounis, University of Glasgow University of Glasgow (qirdcsuog) at TREC Crowdsourcing 2011: TurkRank--Network-based Worker Ranking in Crowdsourcing Stewart Whiting, Jesus Rodriguez Perez, Guido Zuccon, Teerapong Leelanupab, Joemon M. Jose, University of Glasgow University of Glasgow (UGLA-D) at TREC Microblog 2011: Temporal Pseudo-Relevance Feedback in Microblog Retrieval Stewart Whiting, Iraklis A. Klampanos, Joemon M. Jose, University of Glasgow University of Glasgow at Medical Records Track: Experiments with Terrier Nut Limsopatham, Craig Macdonald, Iadh Ounis, Graham McDonald, Matt-Mouley Bouamrane, University of Glasgow The University of Illinois' Graduate School of Library and Information Science at TREC 2011 Miles Efron, University of Illinois University of Indonesia at TREC 2011 Microblog Task Samuel Louvan, Mochamad Ibrahim, Mirna Adriani, Clara Vania, Bayu Distiawan, Metti Z. Wanagiri, University of Indonesia Fasikom UI at TREC 2011 Entity List Completion Task Ananda Budi Prasetya, Hapnes Toba, Mirna Adriani, Hisar Maruli Manurung, University of Indonesia Concept-Centric Indexing and Retrieval on Medical Text David Eichmann, The University of Iowa The University of Iowa at TREC 2011: Microblogs, Medical Records and Crowdsourcing Sanmitra Bhattacharya, Christopher G. Harris, Yelena Mejova, Chao Yang, Padmini Srinivasan, University of Iowa LiveTweet: Microblog Retrieval Based on Interestingness and an Adaptation of the Vector Space Model Arifah Che Alhadi, Thomas Gottron, Jérôme Kunegis, Nasir Naveed, University of Koblenz-Landau University of Lugano at TREC 2011 Microblog Track Giacomo Inches, University of Lugano Melbourne Language Group Microblog Track Report Bo Han, Marco Lui, Timothy Baldwin, The University of Melbourne Melboune at the TREC 2011 Legal Track William Webber, University of Melbourne Phil Farrelly, Potter Farrelly & Associates Image-to-Structure Task by ChemReader Jungkap Park, Ye Li, Gus R. Rosania, Kazuhiro Saitour, Uniersity of Michigan, Ann Arbor Ranking Web Pages Using Collective Knowledge Falah H. Al-akashi, Diana Inkpen, University of Ottawa PITT at TREC 2011 Session Track Jiepu Jiang, Shuguang Han, Jia Wu, Daqing He, University of Pittsburgh Cohort Shepherd: Discoving Cohort Traits from Hospital Visits Travis Goodwin, Bryan Rink, Kirk Roberts, Sanda M. Harabagiu, University of Texas at Dallas Modeling Concept and Context to Improve Performance in eDiscovery H. S. Hyman, University of South Florida Warren Fridy, III, Fridy Enterprises USC/ISI at TREC 2011: Microblog Track Donald Metzler, Congxing Cai, University of Southern California Crowdsourcing with a Crowd of One and Other TREC 2011 Crowdsourcing and Web Track Experiments Mark D. Smucker, University of Waterloo University of Waterloo at TREC 2011: A Social Networking Approach to the Legal Learning Track Robert Warren, University of Waterloo University of Waterloo at TREC 2011 Microblog Track Adam Roegiest, Gordon V. Cormack, University of Waterloo University of Wolverhampton at the TREC 2011 Microblog Track Georgios Paltoglou, Mike Thelwall, University of Wolverhampton Latent Semantic Indexing with selective Query Expansion Andy Garron, April Kontostathis, Ursinus College Yandex at TREC 2011 Microblog Track Zlata Obukhovskaya, Konstantin Pervyshev, Andrey Styskin, Pavel Serdyukov, Yandex York University at TREC 2011: Medical Records Track Mariam Daoud, Dawid Kasperowicz, Jun Miao, Jimmy Huang, York University Appendix Appendix A Cover Common Evaluation Measures Chemical Image-To-Structure Runs Chemical Prior Art Runs Chemical Prior Art Results Chemical Technical Survey Runs Chemical Technical Survey Results Crowd Sourcing Assessment Runs Crowd Sourcing Consensus Runs Entity ELC Runs Entity REF Runs Entity REF Results Legal Runs Legal Results Medical Runs Medical Results Microblog Runs Microblog Results Session Runs Session Results Web Runs Web Results
Last updated: Monday, 15-Apr-2019 11:22:51 MDT Date created: Friday, January 20, 2012 trec@nist.gov