I have read about and tested the various backup/recovery methods for mySQL. From my testing, it seems that InnoDB tables are the most transaction safe but are the hardest to backup while the database is up. Has anybody ever used the InnoDB hotbackup scripts in a production environment? How do most people backup their mySQL production environments?