Comments on: MySQL Archive Tablespace for FACTs http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/ Musings on reporting, OLAP, ETL, open source Thu, 20 Nov 2008 23:59:17 +0000 http://wordpress.org/?v=2.3.1 By: Mervin Estrada http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-180765 Mervin Estrada Wed, 23 Apr 2008 00:50:26 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-180765 diacritical embound serriferous supersweet printscript educational proepisternum coulisse <a href="http://www.defiance.edu/athletics/volleyball.html" rel="nofollow">Defiance College</a> http://www.davidjelinek.com/ diacritical embound serriferous supersweet printscript educational proepisternum coulisse
Defiance College
http://www.davidjelinek.com/

]]> By: Frankie Leonard http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-169851 Frankie Leonard Mon, 24 Mar 2008 12:04:05 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-169851 diacritical embound serriferous supersweet printscript educational proepisternum coulisse <a href="http://www.cnn.com/2000/ASIANOW/southeast/08/21/timor.congress.ap/" rel="nofollow">East Timor's political leaders open landmark multiparty congress</a> http://www.genesearch.com/ports.html diacritical embound serriferous supersweet printscript educational proepisternum coulisse
East Timor’s political leaders open landmark multiparty congress
http://www.genesearch.com/ports.html

]]> By: Nick Arnett http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-158473 Nick Arnett Thu, 28 Feb 2008 17:58:53 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-158473 Haven't done it yet, but I assume the answer is to create a new table periodically, selecting the rows that are 90 days old or less from the current table. Haven’t done it yet, but I assume the answer is to create a new table periodically, selecting the rows that are 90 days old or less from the current table.

]]> By: ac http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-147234 ac Thu, 07 Feb 2008 22:22:02 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-147234 Let's take this data warehouse example one step further. Suppose your example company wanted to keep the data in the archive table for NO MORE than 90 days. How do you roll off the 91-day old data without access to DELETE? If the answer to this question is obvious, please accept my apology and even a terse link would save me any more time. Thanks! MySQL rocks, and looking to make great use of Archive. (I'm thinking it MUST be obvious... I see so many great example blog posts about Archive Engine and logging... but they all dance around the logrotate functionality). Let’s take this data warehouse example one step further.

Suppose your example company wanted to keep the data in the archive table for NO MORE than 90 days.

How do you roll off the 91-day old data without access to DELETE?

If the answer to this question is obvious, please accept my apology and even a terse link would save me any more time. Thanks! MySQL rocks, and looking to make great use of Archive.

(I’m thinking it MUST be obvious… I see so many great example blog posts about Archive Engine and logging… but they all dance around the logrotate functionality).

]]> By: ngoodman http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-46838 ngoodman Mon, 21 May 2007 19:07:27 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-46838 Margie - You can't (from a DML perspective), but you can from a logical perspective by: <code> DROP TABLE FACT_DAY_01_02_2007; CREATE TABLE FACT_DAY_01_02_2007 ( DIM1_ID INT , DIM2_ID INT , DIM3_ID INT , DIM4_ID INT , DIM5_ID INT , NUMBER1 FLOAT , NUMBER2 FLOAT , NUMBER3 FLOAT , NUMBER4 FLOAT ) engine=ARCHIVE ;</code> and then rerun your ETL. Archive tables bear a certain burden, but they can be worthwhile. Admittedly, I've not heard how this customer did with it operationally so I don't know how it worked for them on a day to day basis. :) Margie -

You can’t (from a DML perspective), but you can from a logical perspective by:

DROP TABLE FACT_DAY_01_02_2007;
CREATE TABLE FACT_DAY_01_02_2007
(
DIM1_ID INT
, DIM2_ID INT
, DIM3_ID INT
, DIM4_ID INT
, DIM5_ID INT
, NUMBER1 FLOAT
, NUMBER2 FLOAT
, NUMBER3 FLOAT
, NUMBER4 FLOAT
) engine=ARCHIVE
;

and then rerun your ETL. Archive tables bear a certain burden, but they can be worthwhile. Admittedly, I’ve not heard how this customer did with it operationally so I don’t know how it worked for them on a day to day basis. :)

]]> By: margiex http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-46799 margiex Mon, 21 May 2007 14:16:30 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-46799 if loaded one day's data which is wrong, how can we reload it? because we can't use delete or update. if loaded one day’s data which is wrong, how can we reload it? because we can’t use delete or update.

]]> By: Matt Casters http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-39844 Matt Casters Wed, 18 Apr 2007 20:49:49 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-39844 Brian, does it work in combination with table partitioning as well? Brian, does it work in combination with table partitioning as well?

]]> By: Brian Aker http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-39824 Brian Aker Wed, 18 Apr 2007 17:26:08 +0000 http://www.nicholasgoodman.com/bt/blog/2007/04/18/mysql-archive-tablespace-for-facts/#comment-39824 Hi! This is with 5.0 right? In 5.1 Archive's reading got a lot faster and its insertion improved as well (especially with tables that have lots of nulls). I spent a little time with an 8way machine making sure archive would work with multiple processors well. Archive does not have update/delete for reasons of market. I was asked not to implement them. I've got it on paper to do it, but its not really high on my list at the moment (the new skip indexes are though, which will make scans faster). Cheers, -Brian Hi!

This is with 5.0 right? In 5.1 Archive’s reading got a lot faster and its insertion improved as well (especially with tables that have lots of nulls). I spent a little time with an 8way machine making sure archive would work with multiple processors well.

Archive does not have update/delete for reasons of market. I was asked not to implement them. I’ve got it on paper to do it, but its not really high on my list at the moment (the new skip indexes are though, which will make scans faster).

Cheers,
-Brian

]]>