OK the very first thing I looked at was something called "execsnoop" which monitors system calls. One single click (in this case, clicking on CRGWeb from an authenticated wiki session , but I get something similar for any click). IMHO this is a very silly number of system calls for a single click. It calls rlog on all 90-odd files in /webvols/wiki/twiki/data/CRG ! For the Unix web it does it on all 203 files! I can see why it is slowing down. ------------------ concrete:/var/tmp/DTraceToolkit-0.96/Bin-> ./execsnoop -a TIME STRTIME ZONE PROJ UID PID PPID ARGS 5927815957057 2007 Apr 23 14:24:40 global 1 443 7537 11582 /usr/bin/perl -wT /webvols/wiki/twiki/bin/view 5927819909817 2007 Apr 23 14:24:44 global 1 443 7538 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebHome.txt,v 5927819961688 2007 Apr 23 14:24:45 global 1 443 7539 7537 /usr/local/bin/rlog -r1.22 /webvols/wiki/twiki/data/CRG/WebHome.txt,v 5927820044551 2007 Apr 23 14:24:45 global 1 443 7540 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/Main/BetsyS.txt,v 5927820160018 2007 Apr 23 14:24:45 global 1 443 7542 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebHome.txt,v 5927820095744 2007 Apr 23 14:24:45 global 1 443 7541 7537 /usr/local/bin/rlog -r1.5 /webvols/wiki/twiki/data/Main/BetsyS.txt,v 5927820211139 2007 Apr 23 14:24:45 global 1 443 7543 7537 /usr/local/bin/rlog -r1.22 /webvols/wiki/twiki/data/CRG/WebHome.txt,v 5927820293063 2007 Apr 23 14:24:45 global 1 443 7544 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebTopicList.txt,v 5927820344175 2007 Apr 23 14:24:45 global 1 443 7545 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/WebTopicList.txt,v 5927820451603 2007 Apr 23 14:24:45 global 1 443 7547 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/WebSearch.txt,v 5927820400519 2007 Apr 23 14:24:45 global 1 443 7546 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebSearch.txt,v 5927820507587 2007 Apr 23 14:24:45 global 1 443 7548 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebChanges.txt,v 5927820558575 2007 Apr 23 14:24:45 global 1 443 7549 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/WebChanges.txt,v 5927820614551 2007 Apr 23 14:24:45 global 1 443 7550 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebNotify.txt,v 5927820666281 2007 Apr 23 14:24:45 global 1 443 7551 7537 /usr/local/bin/rlog -r1.7 /webvols/wiki/twiki/data/CRG/WebNotify.txt,v 5927820724318 2007 Apr 23 14:24:45 global 1 443 7552 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebStatistics.txt,v 5927820775860 2007 Apr 23 14:24:45 global 1 443 7553 7537 /usr/local/bin/rlog -r1.6 /webvols/wiki/twiki/data/CRG/WebStatistics.txt,v 5927820836157 2007 Apr 23 14:24:45 global 1 443 7554 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebPreferences.txt,v 5927820966776 2007 Apr 23 14:24:46 global 1 443 7556 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/Main/WebHome.txt,v 5927820887480 2007 Apr 23 14:24:45 global 1 443 7555 7537 /usr/local/bin/rlog -r1.11 /webvols/wiki/twiki/data/CRG/WebPreferences.txt,v 5927821018305 2007 Apr 23 14:24:46 global 1 443 7557 7537 /usr/local/bin/rlog -r1.23 /webvols/wiki/twiki/data/Main/WebHome.txt,v 5927821154078 2007 Apr 23 14:24:46 global 1 443 7559 7537 /usr/local/bin/rlog -r1.4 /webvols/wiki/twiki/data/Main/CheridyJollie.txt,v 5927821102942 2007 Apr 23 14:24:46 global 1 443 7558 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/Main/CheridyJollie.txt,v 5927821457597 2007 Apr 23 14:24:46 global 1 443 7561 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/WebSearchAdvanced.txt,v 5927821405904 2007 Apr 23 14:24:46 global 1 443 7560 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebSearchAdvanced.txt,v 5927821517678 2007 Apr 23 14:24:46 global 1 443 7562 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/TWiki/WelcomeGuest.txt,v 5927821569503 2007 Apr 23 14:24:46 global 1 443 7563 7537 /usr/local/bin/rlog -r1.25 /webvols/wiki/twiki/data/TWiki/WelcomeGuest.txt,v 5927821649054 2007 Apr 23 14:24:46 global 1 443 7564 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/CrgEmergency.txt,v 5927821700309 2007 Apr 23 14:24:46 global 1 443 7565 7537 /usr/local/bin/rlog -r1.4 /webvols/wiki/twiki/data/CRG/CrgEmergency.txt,v 5927821759999 2007 Apr 23 14:24:46 global 1 443 7566 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/CrgDisasters.txt,v 5927821811172 2007 Apr 23 14:24:46 global 1 443 7567 7537 /usr/local/bin/rlog -r1.4 /webvols/wiki/twiki/data/CRG/CrgDisasters.txt,v 5927821933453 2007 Apr 23 14:24:46 global 1 443 7569 7537 /usr/local/bin/rlog -r1.6 /webvols/wiki/twiki/data/CRG/SummerWorkPlan.txt,v 5927821882261 2007 Apr 23 14:24:46 global 1 443 7568 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/SummerWorkPlan.txt,v 5927822053157 2007 Apr 23 14:24:47 global 1 443 7570 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/BusinessResumptionPlan.txt, 5927822104438 2007 Apr 23 14:24:47 global 1 443 7571 7537 /usr/local/bin/rlog -r1.3 /webvols/wiki/twiki/data/CRG/BusinessResumptionPlan.t 5927822179405 2007 Apr 23 14:24:47 global 1 443 7572 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/PasswordEnvelope.txt,v 5927822230456 2007 Apr 23 14:24:47 global 1 443 7573 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/PasswordEnvelope.txt,v 5927822291716 2007 Apr 23 14:24:47 global 1 443 7574 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/TWiki/WikiWord.txt,v 5927822342813 2007 Apr 23 14:24:47 global 1 443 7575 7537 /usr/local/bin/rlog -r1.5 /webvols/wiki/twiki/data/TWiki/WikiWord.txt,v 5927822469166 2007 Apr 23 14:24:47 global 1 443 7577 7537 /usr/local/bin/rlog -r1.16 /webvols/wiki/twiki/data/CRG/Network/WebHome.txt,v 5927822416774 2007 Apr 23 14:24:47 global 1 443 7576 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Network/WebHome.txt,v 5927822547751 2007 Apr 23 14:24:47 global 1 443 7578 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Email/WebHome.txt,v 5927822599571 2007 Apr 23 14:24:47 global 1 443 7579 7537 /usr/local/bin/rlog -r1.13 /webvols/wiki/twiki/data/CRG/Email/WebHome.txt,v 5927822668031 2007 Apr 23 14:24:47 global 1 443 7580 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Windows/WebHome.txt,v 5927822719502 2007 Apr 23 14:24:47 global 1 443 7581 7537 /usr/local/bin/rlog -r1.14 /webvols/wiki/twiki/data/CRG/Windows/WebHome.txt,v 5927822787945 2007 Apr 23 14:24:47 global 1 443 7582 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Unix/WebHome.txt,v 5927822840674 2007 Apr 23 14:24:47 global 1 443 7583 7537 /usr/local/bin/rlog -r1.40 /webvols/wiki/twiki/data/CRG/Unix/WebHome.txt,v 5927822914923 2007 Apr 23 14:24:47 global 1 443 7584 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Database/WebHome.txt,v 5927822967422 2007 Apr 23 14:24:48 global 1 443 7585 7537 /usr/local/bin/rlog -r1.30 /webvols/wiki/twiki/data/CRG/Database/WebHome.txt,v 5927823053096 2007 Apr 23 14:24:48 global 1 443 7586 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Websites/WebHome.txt,v 5927823105449 2007 Apr 23 14:24:48 global 1 443 7587 7537 /usr/local/bin/rlog -r1.42 /webvols/wiki/twiki/data/CRG/Websites/WebHome.txt,v 5927823241422 2007 Apr 23 14:24:48 global 1 443 7589 7537 /usr/local/bin/rlog -r1.16 /webvols/wiki/twiki/data/CRG/Software/WebHome.txt,v 5927823189547 2007 Apr 23 14:24:48 global 1 443 7588 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Software/WebHome.txt,v 5927823302978 2007 Apr 23 14:24:48 global 1 443 7590 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Printing/WebHome.txt,v 5927823354386 2007 Apr 23 14:24:48 global 1 443 7591 7537 /usr/local/bin/rlog -r1.14 /webvols/wiki/twiki/data/CRG/Printing/WebHome.txt,v 5927823418119 2007 Apr 23 14:24:48 global 1 443 7592 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Printing/LargeFormatPrintin 5927823469825 2007 Apr 23 14:24:48 global 1 443 7593 7537 /usr/local/bin/rlog -r1.20 /webvols/wiki/twiki/data/CRG/Printing/LargeFormatPri 5927823528462 2007 Apr 23 14:24:48 global 1 443 7594 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Printing/LargeFormatPlottin 5927823579603 2007 Apr 23 14:24:48 global 1 443 7595 7537 /usr/local/bin/rlog -r1.3 /webvols/wiki/twiki/data/CRG/Printing/LargeFormatPlot 5927823643388 2007 Apr 23 14:24:48 global 1 443 7596 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Helpdesk/WebHome.txt,v 5927823770051 2007 Apr 23 14:24:48 global 1 443 7598 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/PublicComputers/WebHome.txt 5927823695390 2007 Apr 23 14:24:48 global 1 443 7597 7537 /usr/local/bin/rlog -r1.33 /webvols/wiki/twiki/data/CRG/Helpdesk/WebHome.txt,v 5927823821732 2007 Apr 23 14:24:48 global 1 443 7599 7537 /usr/local/bin/rlog -r1.19 /webvols/wiki/twiki/data/CRG/PublicComputers/WebHome 5927823880623 2007 Apr 23 14:24:48 global 1 443 7600 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Presentation/WebHome.txt,v 5927823932524 2007 Apr 23 14:24:48 global 1 443 7601 7537 /usr/local/bin/rlog -r1.14 /webvols/wiki/twiki/data/CRG/Presentation/WebHome.tx 5927823996608 2007 Apr 23 14:24:49 global 1 443 7602 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/CrgInternal/WebHome.txt,v 5927824048546 2007 Apr 23 14:24:49 global 1 443 7603 7537 /usr/local/bin/rlog -r1.27 /webvols/wiki/twiki/data/CRG/CrgInternal/WebHome.txt 5927824114625 2007 Apr 23 14:24:49 global 1 443 7604 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Websites/WebCalendar/WebHom 5927824166091 2007 Apr 23 14:24:49 global 1 443 7605 7537 /usr/local/bin/rlog -r1.12 /webvols/wiki/twiki/data/CRG/Websites/WebCalendar/We 5927824230468 2007 Apr 23 14:24:49 global 1 443 7606 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/Software/MeetingMaker.txt,v 5927824281628 2007 Apr 23 14:24:49 global 1 443 7607 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/Software/MeetingMaker.tx 5927824344751 2007 Apr 23 14:24:49 global 1 443 7608 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/GIS/WebHome.txt,v 5927824400621 2007 Apr 23 14:24:49 global 1 443 7609 7537 /usr/local/bin/rlog -r1.8 /webvols/wiki/twiki/data/CRG/GIS/WebHome.txt,v 5927824467743 2007 Apr 23 14:24:49 global 1 443 7610 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebTopicList.txt,v 5927824574873 2007 Apr 23 14:24:49 global 1 443 7612 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebChanges.txt,v 5927824518744 2007 Apr 23 14:24:49 global 1 443 7611 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/WebTopicList.txt,v 5927824626290 2007 Apr 23 14:24:49 global 1 443 7613 7537 /usr/local/bin/rlog -r1.2 /webvols/wiki/twiki/data/CRG/WebChanges.txt,v 5927824682485 2007 Apr 23 14:24:49 global 1 443 7614 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebNotify.txt,v 5927824734099 2007 Apr 23 14:24:49 global 1 443 7615 7537 /usr/local/bin/rlog -r1.7 /webvols/wiki/twiki/data/CRG/WebNotify.txt,v 5927824842793 2007 Apr 23 14:24:49 global 1 443 7617 7537 /usr/local/bin/rlog -r1.3 /webvols/wiki/twiki/data/CRG/WebRss.txt,v 5927824791626 2007 Apr 23 14:24:49 global 1 443 7616 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebRss.txt,v 5927824899432 2007 Apr 23 14:24:49 global 1 443 7618 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebAtom.txt,v 5927824950595 2007 Apr 23 14:24:50 global 1 443 7619 7537 /usr/local/bin/rlog -r1.1 /webvols/wiki/twiki/data/CRG/WebAtom.txt,v 5927825060386 2007 Apr 23 14:24:50 global 1 443 7621 7537 /usr/local/bin/rlog -r1.6 /webvols/wiki/twiki/data/CRG/WebStatistics.txt,v 5927825008784 2007 Apr 23 14:24:50 global 1 443 7620 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebStatistics.txt,v 5927825120224 2007 Apr 23 14:24:50 global 1 443 7622 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/CRG/WebPreferences.txt,v 5927825171450 2007 Apr 23 14:24:50 global 1 443 7623 7537 /usr/local/bin/rlog -r1.11 /webvols/wiki/twiki/data/CRG/WebPreferences.txt,v 5927825422622 2007 Apr 23 14:24:50 global 1 443 7624 7537 /usr/local/bin/rlog -h /webvols/wiki/twiki/data/Main/CheridyJollie.txt,v 5927825473718 2007 Apr 23 14:24:50 global 1 443 7625 7537 /usr/local/bin/rlog -r1.4 /webvols/wiki/twiki/data/Main/CheridyJollie.txt,v ^C Betsy Schwartz email: betsys@gsd.harvard.edu Unix Systems Administrator,CRG voice: 617-495-5947 Harvard Graduate School of Design fax: 617-496-5866