Research and Teaching Page of William Webber

Hi! I'm a Research Associate, and PhD candidate in the Department Computer Science and Software Engineering at the University of Melbourne in Victoria, Australia. As well as research, I also do some teaching in the department, and various miscellaneous other stuff

My research interests include Distributed Information Retrieval and Evaluation Metrics in Information Retrieval. I am currently working on an ARC-funded project in the latter area.

My first supervisor is Alistair Moffat; my second supervisor is Justin Zobel. I am a colleague of Anh Vo. My research area is the Evaluation of Information Retrieval Systems. My personal page may also be of interest to you.

I keep a research blog on evaluation, information retrieval, computer science, and information technology.

Publications

• "Improvements That Don't Add Up: Ad-Hoc Retrieval Results Since 1998", Timothy G. Armstrong, Alistair Moffat, William Webber, and Justin Zobel, Proc. ACM-CIKM, Hong Kong, November 2009, pages 601--610 (paper).
• "Score Adjustment for Correction of Pooling Bias", William Webber and Laurence Park, Proc. ACM-SIGIR, Boston, July 2009, pages 444--451 (paper).
• "Relative Significance is Insufficient: Baselines Matter Too", Timothy G. Armstrong, Justin Zobel, William Webber, and Alistair Moffat, Proc. ACM-SIGIR Workshop on The Future of IR Evaluation, Boston, July 2009, pages 25--26 (poster) (paper).
• "Has Adhoc Retrieval Improved Since 1994?", Timothy G. Armstrong, Alistair Moffat, William Webber, and Justin Zobel. Proc. ACM-SIGIR, Boston, July 2009, pages 692--693 (poster) (poster).
• "EvaluatIR: An Online Tool for Evaluating and Comparing IR Systems", Timothy G. Armstrong, Alistair Moffat, William Webber, and Justin Zobel, Proc. ACM-SIGIR, Boston, July 2009, page 834 (demo) (extended abstract, EvaluatIR.org website).
• "Statistical Power in Retrieval Experimentation", W. Webber, A. Moffat, and J. Zobel, Proc. ACM-CIKM, Napa, USA, October 2008, pages 571--580 (paper).
• "Score Standardization for Inter-Collection Comparison of Retrieval Systems", W. Webber, A. Moffat, and J. Zobel, Proc. ACM-SIGIR, Singapore, July 2008, pages 51--58 (paper).
• "Precision-At-Ten Considered Redundant", W. Webber, A. Moffat, J. Zobel, and T. Sakai, Proc. ACM-SIGIR, Singapore, July 2008, pages 695-696 (poster).
• "Score Standardization for Robust Comparison of Retrieval Systems", W. Webber, A. Moffat, J. Zobel, Proc. 12th Australasian Document Computing Symposium, Melbourne, December 2007, pages 1-8 (paper). Winner, Best Student Paper Prize. (Please see addendum concerning resampling method used in Figure 5.6.)
• "Strategic System Comparisons via Targeted Relevance Judgments", A. Moffat, W. Webber, J. Zobel, Proceedings of the International ACM-SIGIR Conference on Research and Development in Information Retrieval, Amsterdam, July 2007 (paper).
• "Design and Evaluation of a Pipelined Distributed Information Retrieval Architecture", W. Webber, Thesis, Master of Engineering, University of Melbourne, June 2007.
• "A pipelined architecture for distributed text query evaluation", A. Moffat, W. Webber, J. Zobel, R. Baeza-Yates, Information Retrieval, Springer Netherlands, October 2006.
• "Load balancing for term-distributed parallel retrieval", A. Moffat, W. Webber, and J. Zobel, Proceedings of the International ACM-SIGIR Conference on Research and Development in Information Retrieval, Washington, August 2006 (paper).
• "Space-limited ranked query evaluation using adaptive pruning", N. Lester, A. Moffat, W. Webber, and J. Zobel, Proceedings of the WISE Workshop on Information Systems Engineering, M. Kitsuregawa, E. Neuhold, and A.H.H. Ngu (eds), New York, November 2005, pp. 470-477. Full text Bibtex
• "In Search of Reliable Retrieval Experiments", Webber, Moffat. Proc. 10th Australasian Document Computing Symposium, Sydney, December 2005, pages 26-33. Full text Bibtex
• "Melbourne University 2005: Enterprise and Terabyte Tracks", Anh, Webber, Moffat. Proc. 2005 TREC Notebook Proceedings, Gaithersburg, MD, November 2005.
• "RMIT University at TREC 2005: Terabyte and Robust Track", Y. Bernstein, B. Billerbeck, S. Garcia, N. Lester, F. Scholer, J. Zobel, W. Webber.
• "RMIT University at TREC 2004", B. Billerbeck, A. Cannane, A. Chattaraj, N. Lester, W. Webber, H.E. Williams, J. Yiannis, J. Zobel.

Professional activities

Conference chairs and committees

• EVIA Workshop 2010 (co-chair)
• ACM CIKM Conference, 2009 (Program Committee)
• ACM SIGIR Conference, 2009 (Program Committee)
• Australian Document Computing Symposium, 2007 (Program Committee), 2009 (Program Committee)
• String Processing and Information Retrieval Symposium, 2008 (Organizing Committee)
• Asian Information Retrieval Symposium, 2009 (Publicity Chair, Australia)

Reviewing:

• ACM Transactions on Information Systems
• Journal of the American Society for Information Science and Technology
• Information Retrieval (journal)
• Australian Document Computing Symposium, 2005, 2007, 2008 (shared Best Reviewer award), and 2009
• ACM Conference on Information and Knowledge Management, 2006, 2007, 2008, and 2009
• Symposium on Combinatorial Pattern Matching, 2008
• European Conference on Information Retrieval, 2008
• ACM SIGIR Conference, 2008 and 2009
• Conference on Very Large Databases, 2007 and 2008
• ACM International Conference on Web Search and Data Mining, 2008

In 2009, I co-taught 433467, Text and Document Management, in first semester.

• An example of creating name tags in latex.
• I did some thread analysis for the TREC W3C collection.

William Webber
04/Mar/2010