Well – there is a performance issue in the portal code in Sakai 2.5. There are more queries to the SAKAI_SITE_PROPERTY in Sakai 2.5 than in 2.4.
\nIn looking at things there were several instances of “too many queries” – not just from 2.5 – but for a few features that were added to portal between 2.3 and 2.5.
\nSo I pored over the code for the last three days and figured out what kind of optimization which had already been done – and figure out where bits were leaking through the prior optimization.
\nI talked to Aaron and Ian – and came up with two solutions – one using memcache for the properties and another using thread local.
\nI think that this will be important for Sakai 2.5 sites – My guess is that in the summer many are not noticing the additional query load on the main portal displays. Without these patches things will likely slow down a bit and\/or consumer more resources.
\nI initially made a property to control which tables the properties get cached in memory – my guess is that particularly for 64-bit JVM’s this should be
\nDbFlatPropertiesCache=:all:
\nBut at a minimum this is needed:
\nDbFlatPropertiesCache=:SAKAI_SITE_PROPERTY:
\nAfter some testing and experience we should figure out which of these two should be the default. I think that the methodology (suggested by Ian) is to look at query patterns and see if you are seeing too many hits on tables like:
\nSAKAI_SITE_PAGE_PROPERTY, SAKAI_SITE_TOOL_PROPERTY, SAKAI_SITE_GROUP_PROPERTY, …
\nThen simply add them to the list in preferences – and see if things get better.
\nThis is a nice, clean, short-lived memcache – and it is automated perfectly when properties are changed on the same server (i.e. when an instructor makes a change and presses refresh – the display will be perfect – instantly reflecting the changes).
\nThe Thread Local code is obvious and must be done. It simply makes sure that the portal only gets the list of visitable sites once from the database.
\nBoth of these mods are really simple and clean and should be trivial to review.
\nI currently have some print statements that can be uncommented if folks want to watch the new caches in action.
\nOnce some testing happens – I will remove these before sending it to trunk.
\nNow this is done, I can start working on my talk for tomorrow about functionality mashup.
\nHere is my message to the dev list about it.<\/p>\n
\ntest – you can use the code in these branches:
\nhttps:\/\/source.sakaiproject.org\/svn\/db\/branches\/SAK-13886
\nhttps:\/\/source.sakaiproject.org\/svn\/portal\/branches\/SAK-13886
\nThis is all described here:
\nhttp:\/\/bugs.sakaiproject.org\/jira\/browse\/SAK-13886
\nSince this is a cache thing and thread local thing – I am happy for
\nfolks to look it over before I move it to trunk.
\nOnce this is done I expect to put it into 2-5-x – I would guess that
\nfolks will want this performance fix to get the portal views less
\ncostly in terms of the number of queries needed to produce the main
\npage.<\/p>\n","protected":false},"excerpt":{"rendered":"
Well – there is a performance issue in the portal code in Sakai 2.5. There are more queries to the SAKAI_SITE_PROPERTY in Sakai 2.5 than in 2.4. In looking at things there were several instances of “too many queries” – not just from 2.5 – but for a few features that were added to portal […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-496","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts\/496","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/comments?post=496"}],"version-history":[{"count":1,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts\/496\/revisions"}],"predecessor-version":[{"id":2607,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts\/496\/revisions\/2607"}],"wp:attachment":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/media?parent=496"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/categories?post=496"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/tags?post=496"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}