Message-ID: <20010119091836{dot}A12204{at}anusf{dot}anu{dot}edu{dot}au> References: <20010118024057{dot}C11256{at}gorgon{dot}ho{dot}BoM{dot}GOV{dot}AU> Mime-Version: 1.0 X-Mailer: Mutt 1.0.1i In-Reply-To: <20010118024057{dot}C11256{at}gorgon{dot}ho{dot}BoM{dot}GOV{dot}AU>; from r{dot}oxbrow{at}bom{dot}gov{dot}AU on Thu, Jan 18, 2001 at 02:40:57AM +0000 X-archive-position: 34 X-listar-version: Listar v1.0.0 From: Postmaster{at}datalink{dot}com X-original-sender: Ben{dot}Evans{at}anusf{dot}anu{dot}edu{dot}au Precedence: bulk X-list: sam-managers X-MIMETrack: Itemize by SMTP Server on hqdomino/Datalink(Release 5.0.2c |February 2, 2000) at 01/18/2001 04:20:00 PM, Serialize by Router on hqdomino/Datalink(Release 5.0.2c |February 2, 2000) at 01/18/2001 04:20:16 PM, Serialize complete at 01/18/2001 04:20:16 PM Content-Type: multipart/report; report-type=delivery-status; boundary="==IFJRGLKFGIR37243UHRUHIHD" --==IFJRGLKFGIR37243UHRUHIHD Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Your message Subject: [sam-managers] Re: Changing Drive Types was not delivered to: ricks{at}datalink{dot}com because: Error delivering to Rick Shangle/Datalink; Insufficient system resources exist to complete the requested service. --==IFJRGLKFGIR37243UHRUHIHD Content-Type: message/delivery-status Reporting-MTA: dns;chantilly.datalink.com Final-Recipient: rfc822;ricks{at}datalink{dot}com Action: failed Status: 5.0.0 Diagnostic-Code: X-Notes; Error delivering to Rick Shangle/Datalink; Insufficient system resources exist to complete the requested service. --==IFJRGLKFGIR37243UHRUHIHD Content-Type: message/rfc822 Received: from postal.datalink.com ([63.126.255.7]) by hqdomino.datalink.com (Lotus Domino Release 5.0.2c) with ESMTP id 2001011816185810:1864 ; Thu, 18 Jan 2001 16:18:58 -0600 Received: from tardis.ee.ethz.ch (tardis-delek-fast.ee.ethz.ch [129.132.2.199]) by postal.datalink.com (Build 98 8.9.3/NT-8.9.3) with SMTP id PAA11402 for <Rick_Shangle{at}datalink{dot}com>; Thu, 18 Jan 2001 15:57:09 -0800 Received: from tardis (localhost [127.0.0.1]) by tardis.ee.ethz.ch (Postfix) with ESMTP id C1CC03C33E; Thu, 18 Jan 2001 23:19:47 +0100 (MET) Received: with LISTAR (v1.0.0; list sam-managers); Thu, 18 Jan 2001 23:19:47 +0100 Received: from anusf.anu.edu.au (anusf.anu.edu.au [150.203.5.2]) by tardis.ee.ethz.ch (Postfix) with ESMTP id 479463C344 for <sam-managers@list.ee.ethz.ch>; Thu, 18 Jan 2001 23:19:43 +0100 (MET) Received: (from bje900@localhost) by anusf.anu.edu.au (8.8.8+Sun/8.8.6) id JAA23354; Fri, 19 Jan 2001 09:18:36 +1100 (EST) Date: Fri, 19 Jan 2001 09:18:36 +1100 From: Ben Evans <Ben{dot}Evans{at}anusf{dot}anu{dot}edu{dot}au> To: Richard Oxbrow <r{dot}oxbrow{at}bom{dot}gov{dot}AU> Cc: sam-managers@list.ee.ethz.ch Subject: [sam-managers] Re: Changing Drive Types Message-ID: <20010119091836{dot}A12204{at}anusf{dot}anu{dot}edu{dot}au> References: <20010118024057{dot}C11256{at}gorgon{dot}ho{dot}BoM{dot}GOV{dot}AU> Mime-Version: 1.0 X-Mailer: Mutt 1.0.1i In-Reply-To: <20010118024057{dot}C11256{at}gorgon{dot}ho{dot}BoM{dot}GOV{dot}AU>; from r{dot}oxbrow{at}bom{dot}gov{dot}AU on Thu, Jan 18, 2001 at 02:40:57AM +0000 X-archive-position: 34 X-listar-version: Listar v1.0.0 X-original-sender: Ben{dot}Evans{at}anusf{dot}anu{dot}edu{dot}au Precedence: bulk X-list: sam-managers X-MIMETrack: Itemize by SMTP Server on hqdomino/Datalink(Release 5.0.2c |February 2, 2000) at 01/18/2001 04:20:00 PM, Serialize by Router on hqdomino/Datalink(Release 5.0.2c |February 2, 2000) at 01/18/2001 04:20:16 PM Content-type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Hi Richard, There are two main ways: recycling or archset exchanging. Note that you can't just edit the archiver and change the archset to have the new tapes. You have to tell each file that it must be re-archived onto the new media. All that editing the archset line will do is cause any new files to go onto the new media. The old files will be perfectly happy being on media that you aren't putting more files onto :). Typically recycling is used for swapping over media, but you don't have to. The main benefit in using the recycler is that there are a few more controls to complete the process without so much human intervention. But, whatever variant of the procedures you use, just make sure that you always have two copies (either disk&tape or tape&tape). A couple of other relevant notes that are worth mentioning, but you=20 are probably aware of. Large scale re-archiving is one of the biggest workouts you can give your system. You might want to start playing with priority flags to give the normal stage operations a fair go at the machine, but this is only available if you have a later release of SAM-(Q)FS. =20 Also, you might want to have a look at your machine performance in general. If you can keep your tapes streaming then the machine performance is fine. The tuning parameters below (params section) can help do the load balancing you need, and to cut down on unnecessary mounts and dismount= s, and to stop thrashing your disk cache. Also, make sure you keep and eye on your disk cache levels. If you start to fill up, modify some of the parame= ters to keep the system under control. Procedure 1. Recycling 1. stop the archiver by putting a "wait" in the archiver.cmd 2. comment out your old foobar.1 archset. Don't reuse these VSNs until the transfer to new media is complete. 3. add a new foobar.1 with your CKxx tapes.=20 4. Consider editing your archiver.cmd to change the params section and have a separate line for your foobar.1 Options that you might want to consider are - a limit on the number of drives you might want to be used for the archive operation with -drives. Depending on the=20 -offline=5Fcopy should be 1 (say for stageall), or 2 or greater for stageahead. - with slow media like DLT you want to go for a -offline=5Fcopy stageahead or stageall but depends on the size of your cache, the amount of new data, and how busy your drives are. For performance reasons I like=20 to use stageall (but someday would like to see stageahead x). - use the following options to re-archive the most empty media first and to control how many tapes are selected for recycling. -recycle=5Fvsncount x -recycle=5Fmingain y You have to keep revisiting the recycle=5Fmingain as you slowly recycle all the media. 5. Don't forget that it's the archiver that controls pulling back the offline files. Consider the frequency of archiver intervals. 6. take out your "wait" in archiver.cmd. 7. revisit your cron job for how often you run the recycler. 8. Reconsider your idle=5Funload timeout values in defaults.conf, and samd = stop and start if you want to modify. You can always supplement with the chmed +c VSN and running the recycler to mark the files on that VSN. =20 Procedure 2. Exarchive There is a command call 'exarchive' that allows you to keep the inode info for your old foobar.1 in a new archset foobar.3. The procedure=20 for a media swap should look something like this. 1. stop the archiver by putting a "wait" in the archiver.cmd 2. in your vsn section rename foobar.1 to foobar.3 3. add a new foobar.1 with your CKxx tapes. Leave the filesystem archive area at the top of the archiver window to just have archsets 1 and 2. (You don't want to start archiving to your now old archset 3.) 4. run '/opt/LSCsamfs/sbin/exarchive -c 1 -c 3 -r "your directories"' (note this this is pure inode manipulation and bears no real relationship to your archiver.cmd, but all the consequences of not editing your archiver.cmd still hold). 5. Consider editing your archiver.cmd to change the params section and have a separate line for your foobar's (.1 .2 .3) As above, consider -drives for all , and -offline=5Fcopy options=20 for .2 and .3. 6. Don't forget that it's the archiver that controls pulling =20 back the offline files. Consider the frequency of archiver intervals. 7. take out your "wait" in archiver.cmd. 8. Reconsider your idle=5Funload timeout values in defaults.conf, and samd = stop and start if you want to modify. Good Luck! Ben On Thu, Jan 18, 2001 at 02:40:57AM +0000, Richard Oxbrow wrote: >=20 >=20 > Hi, > I'm looking for a bit of advice on how one should go about > changing the media type an archiveset belongs to. My situation > here is that we are adding 9840 drives to our Sam installation > and we would like to use the 9840's to make all our first copies. >=20 > Currently we use DLT 7000s (lt) to make all our copies with and we > have over 3000 tapes. >=20 > I was hoping that we could simply change the media type and vsns > associated with the first copy of each archivesets without causing > anyproblems. >=20 > eg going from >=20 > foobar.1 lt AA000 AA0001 AA0002 > foobar.2 lt BB000 BB0001 BB0002 >=20 > to >=20 > foobar.1 sg CK000 CK0001 ..etc > foobar.2 lt BB000 BB0001 BB0002 >=20 > At a later stage all the old data on the DLT drives would be rearchived > to the 9840s. >=20 > =09 > Is changing media types as simple as above ? or are there problems > doing it this way or is there a better way ? >=20 > richard >=20 > --=20 > S R S U -- B u r e a u o f M e t e o r o l o g y -- A u s t r a l= i a > http://www.bom.gov.au Fax +61 3 9669 8112 Tel +61 3 9669 = 8136 -- Ben{dot}Evans{at}anusf{dot}anu{dot}edu{dot}au ANU Supercomputer Facility =20 Ph +61 2 6125 4967 Australian National University =20 Fax +61 2 6125 8199 Canberra, ACT, 0200, Australia -- Unsubscribe mailto:sam-managers-request@list.ee.ethz.ch?subject=3Dunsubscri= be Help mailto:sam-managers-request@list.ee.ethz.ch?subject=3Dhelp Archive http://www.ee.ethz.ch/~slist/sam-managers --==IFJRGLKFGIR37243UHRUHIHD-- -- Unsubscribe mailto:sam-managers-request@list.ee.ethz.ch?subject=unsubscribe Help mailto:sam-managers-request@list.ee.ethz.ch?subject=help Archive http://www.ee.ethz.ch/~slist/sam-managers |