Updated 8 July 2012
This guide focuses on using the windows command-line version of Modeltest to find the best parameters to construct a phylogenetic trees.
MODELTEST is a computer programme by David Posada and Keith A Crondall. The program is used to calculate the best model of DNA evolution to use in constructing phylogenetic trees in PAUP* or MrBayes. For more information read their publication (pdf) or visit the Modeltest website. When I started to use this program I found there was little detailed information about to help newbies use it, so I wrote this tutorial to remind me of the steps, and to help some graduate students in my lab. The latest version of Modeltest is 3.7 released on July 29, 2005. However David Posada now recommends you use jModeltest which is a java version of the programme with even more models.
To use the Modeltest program you need the application (available from the authors website), and the phlyogenetics package PAUP* (this is not free unfortunately, hopefully your university or company has a license) [note jModeltest does not require PAUP]. I will be referring to the windows command line version in this document, but these files will work on all versions. Finally you will need a fast computer, I used a 2.4 GHz Pentium 4 laptop, on this it took about an hour to work through 50 taxa of 1300 bp. You also need the file: modelblockPAUPb10.txt (to run modeltest) and optionally ML-search.txt to build a ML tree in PAUP*. modelblockPAUPb10.txt was written by David Posada and is a copy of the file found in the paupblock folder that is included in the download. ML-search was written by me, modify this for you own use.
I also assume that at this point you have a sequence alignment in the NEXUS format (this is critical). The easiest way to do this is use the "save as" command in ClustalX Open up this file in a text editor and replace the "-" (gap) symbol with the missing data symbol "?" where appropriate. It is getting out of the scope of this document to explain this, but typically this is at the ends of the alignment when you don't have full sequence for all taxa. One handy hint don't use the "-" symbol in taxa names, use "_" instead. I use my own file-naming scheme to keep track of things. I suggest replacing the word "test" below with the name of your gene, i.e.: "p53.ML.search.nex" Finally I highly recommend you read the documentation file: modeltest3.6.pdf found in the doc folder of the download.
default lscores longfmt=yes;" this is due to a bug in PAUP* 4.10b. If you use the PAUP-block that came with earlier versions of Modeltest it won't work!C:\" or in the profile root ie. "C:\Documents and Settings\Your Name" do a search if you can't find it).cmd" on win2000 to win7).Modeltest3.7.win.exe < model.scores > test.outfile".BEGIN PAUP; and END; commands).Bootstrapping a ML tree is possible, but very very time consuming. If you do wish to do this add: "bootstrap search=Heuristic nreps=100;" near the end of the file. (search=Heuristic is the default, other possibilities are: BandB, FastStep, NJ, and UPGMA — but don't use those).