A Machine Learning Approach to Test Data Generation: A Case Study in Evaluation of Gene Finders

Henning Christiansen, Christina Mackeprang Dahmcke

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

Programs for gene prediction in computational biology are examples of systems for which the acquisition of authentic test data is difficult as these require years of extensive research. This has lead to test methods based on semiartificially produced test data, often produced by {\em ad hoc} techniques complemented by statistical models such as Hidden Markov Models (HMM). The quality of such a test method depends on how well the test data reflect the regularities in known data and how well they generalize these regularities. So far only very simplified and generalized, artificial data sets have been tested, and a more thorough statistical foundation is required.

We propose to use logic-statistical modelling methods for machine-learning for analyzing existing and manually marked up data, integrated with the generation of new, artificial data. More specifically, we suggest to use the PRISM system developed by Sato and Kameya. Based on logic programming extended with random variables and parameter learning, PRISM appears as a powerful modelling environment, which subsumes HMMs and a wide range of other methods, all embedded in a declarative language. We illustrate these principles here, showing parts of a model under development for genetic sequences and indicate first initial experiments producing test data for evaluation of existing gene finders, exemplified by GENSCAN, HMMGene and genemark.hmm.


Original languageEnglish
Title of host publicationProc. International Conference on Machine Learning and Data Mining MLDM'2007 : Lecture Notes in Artificial Intelligence
Number of pages15
Volume4571
PublisherSpringer
Publication date2007
Pages741-755
ISBN (Print)978-3-540-73498-7
Publication statusPublished - 2007
EventInternational Conference on Machine Learning and Data Mining MLDM'2007 - Leipzig, Germany
Duration: 18 Jul 200720 Jul 2007

Conference

ConferenceInternational Conference on Machine Learning and Data Mining MLDM'2007
CountryGermany
CityLeipzig
Period18/07/200720/07/2007
SeriesLecture notes in artificial intelligence
Number4571
ISSN0302-9743

Keywords

  • bioinformatics
  • sequence analyses
  • software testing
  • machine learning

Cite this

Christiansen, H., & Dahmcke, C. M. (2007). A Machine Learning Approach to Test Data Generation: A Case Study in Evaluation of Gene Finders. In Proc. International Conference on Machine Learning and Data Mining MLDM'2007: Lecture Notes in Artificial Intelligence (Vol. 4571, pp. 741-755). Springer. Lecture notes in artificial intelligence, No. 4571