Progress on SAK-13584 – MailArchive Performance Improvements

I got the conversion working and all the code checked in. I used the Ian/Jim conversion gadget. Initially it looked like a crazy contraption. It turns out to be pretty cool – just undocumented – and the way Jim/Ian used it in Content was totally Ninja-warrior.
Luckily my new conversion code is a *much* better sample to work from – because it is simple. Some documentation should be written.
So it is now off to Tony for testing. More detail below.
Now I am off to go get my motorcycle gear from www.ridersdiscount.com. So for the rest of the day – call the cell.


The first version is up – primarily for testing – I only have a mysql convertor. It runs with mysql and hsql. Here are checkout, compile, and conversion instructions:
Grab the following branches:
https://source.sakaiproject.org/svn/db/branches/SAK-13584/
https://source.sakaiproject.org/svn/mailarchive/branches/SAK-13584/
https://source.sakaiproject.org/svn/util/branches/SAK-13584/
Compile and deploy
Run the conversion
cd mailarchive
Edit upgradeschema-mysql.config to get the database connection right.
Run the script:
sh mailarchive-runconversion.sh \
-j “/Users/csev/dev/sakai-trunk/apache-tomcat-5.5.23/common/lib/mysql-connector-java-5.1.6-bin.jar” \
-p “/Users/csev/dev/sakai-trunk/apache-tomcat-5.5.23/sakai/sakai.properties” \
upgradeschema-mysql.config
Check to see if the BODY, SUBJECT, and HTMLBODY columns look reasonable. The conversion can be stopped and started. If you want to undo the conversion simply execute these commands:
ALTER TABLE MAILARCHIVE_MESSAGE DROP COLUMN SUBJECT;
ALTER TABLE MAILARCHIVE_MESSAGE DROP COLUMN BODY;
ALTER TABLE MAILARCHIVE_MESSAGE DROP COLUMN HTMLBODY;
–Chuck
Test Scenario for this interim version – RUN this test and send me catalina.out
Here are the needed clicks – keep track of which ones are dog slow and which ones are fast. I expect that the non-search queries will be quite fast. And even the search queries should be tolerable.
Go to the mail tool in a site with lots of messages – do not enter a search value
Press next page 2 times
Press back page
Press last page
Press back page twice
Press first page
Enter a message
Press next message twice
Press back message once
Switch to Sort by Subject
Switch to Ascending and descending
Press back page
Press last page
Press back page twice
Press first page
Now put in a search string that is common and repeat the above steps.
Now put in a rare search string and repeat the above steps.
Send me back the catalina.out – thanks muchly