{"id":5564,"date":"2018-07-31T10:45:39","date_gmt":"2018-07-31T14:45:39","guid":{"rendered":"http:\/\/www.dr-chuck.com\/csev-blog\/?p=5564"},"modified":"2018-07-31T10:45:39","modified_gmt":"2018-07-31T14:45:39","slug":"experiences-with-amazon-aurora-serverless","status":"publish","type":"post","link":"https:\/\/www.dr-chuck.com\/csev-blog\/2018\/07\/experiences-with-amazon-aurora-serverless\/","title":{"rendered":"Experiences with Amazon Aurora Serverless"},"content":{"rendered":"

Recently I moved all my Amazon-hosted servers for my www.tsugi.org<\/a> project from Amazon server-based Aurora to Amazon Serverless Aurora.\u00a0 I was experiencing the classic problem where 98% of the time it vastly over paying for my servers and then when I hit a peak (like after I spoke at the Instructure conference), things would get slow.\u00a0 Then I would upgrade my hardware and pay even more when things were slower.\u00a0 So serverless is *perfect* for me.<\/p>\n

I made a serverless cluster – in Aurora serverless you just make a cluster and do not make instances.\u00a0 I was looking a this Amazon page –\u00a0https:\/\/aws.amazon.com\/rds\/aurora\/serverless\/<\/a>\u00a0and it has said:<\/p>\n

You pay on a per-second basis for the database capacity you use when the database is active, and\u00a0migrate between standard and serverless configurations with a few clicks in the AWS Management Console.<\/em><\/p>\n

\n
\n

I could not find the “migrate with a few clicks” bit in the Amazon user interface.\u00a0 So I asked a question on Stack Overflow .<\/a><\/p>\n

When I did not get an answer in a few days, I did the conversion two ways with different results so I figured I would share my results here. I would still love to hear a better approach.<\/p>\n

    \n
  1. When I did the conversion using mysqldump and restore, with a short outage things were fine.<\/li>\n
  2. When I used AWS Database Migration Service<\/a> it went pretty badly.<\/li>\n<\/ol>\n

    First, you have to get the binary log format as “ROW” and binlog retention to 24 hours. That necessitated server restarts on my old clusters.<\/p>\n

    Then when I got the data migration working, the new database was badly broken.\u00a0 I lost all my auto increments, then NULL settings in my columns, the UNIQUE clauses and foreign keys in the new tables.<\/p>\n

    Literally the only thing that migrated correctly was that the actual data and PRIMARY KEY indications. Also, I would recommend migrating one database at a time (i.e. schema) and don’t try to migrate the mysql internal schemas. I said “migrate everything” and the migration tool tried to migrate the MySQL stuff – sheesh – you would think it would know better.<\/p>\n

    The one thing the AWS Database Migration Service did that was\u00a0really cool<\/em>\u00a0was the migrate and monitor (made possible by the binary logging on the rows). You could watch it moving rows.<\/p>\n

    So the lesson is use mysql dump and restore\u00a0 when moving from Aurors server based to serverless.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Recently I moved all my Amazon-hosted servers for my www.tsugi.org project from Amazon server-based Aurora to Amazon Serverless Aurora.\u00a0 I was experiencing the classic problem where 98% of the time it vastly over paying for my servers and then when I hit a peak (like after I spoke at the Instructure conference), things would get […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-5564","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts\/5564","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/comments?post=5564"}],"version-history":[{"count":3,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts\/5564\/revisions"}],"predecessor-version":[{"id":5567,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/posts\/5564\/revisions\/5567"}],"wp:attachment":[{"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/media?parent=5564"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/categories?post=5564"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dr-chuck.com\/csev-blog\/wp-json\/wp\/v2\/tags?post=5564"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}