Set Maintenance Procedure

[bkenobi]

This question is intended to start a discussion on file synchronization techniques for rom sets. I am thinking mainly about MAME due to its massive size, but it could be used for any other rom set as well.

To start with, the problem: I keep my most up to date sets on my main PC and update it via torrents periodically. I manually copy these files to a USB2 hard drive and walk it over to the cabinet to synchronize. There is no easy way to copy only new and updated files in windows (that I know of), so I end up copying the entire set over. MAME currently takes MANY, MANY, MANY GB and copying takes a LONG time.

The goal: I want to copy only files that really need copying. I want it to be easy. I want it to be automated. I really would prefer something that could deal with slow and sometimes unreliable wireless.

The question: Does anyone have any ideas? Does anyone currently have a way they are currently using to copy sets from one machine to another over a network that doesn't involve copying the entire thing?

My current thoughts involve writing an AHK or VB script to compare files based on name and date and copying the ones that don't match. I also found a number of programs that claim to be able to synchronize over a network between machines, but I don't see anything that's really simple enough for what I want. Anyone want to chime in with some of their thoughts?

[LB11]

http://support.microsoft.com/kb/307885

[Brian Hoffman]

This question is intended to start a discussion on file synchronization techniques for rom sets. I am thinking mainly about MAME due to its massive size, but it could be used for any other rom set as well.

To start with, the problem: I keep my most up to date sets on my main PC and update it via torrents periodically. I manually copy these files to a USB2 hard drive and walk it over to the cabinet to synchronize. There is no easy way to copy only new and updated files in windows (that I know of), so I end up copying the entire set over. MAME currently takes MANY, MANY, MANY GB and copying takes a LONG time.

The goal: I want to copy only files that really need copying. I want it to be easy. I want it to be automated. I really would prefer something that could deal with slow and sometimes unreliable wireless.

The question: Does anyone have any ideas? Does anyone currently have a way they are currently using to copy sets from one machine to another over a network that doesn't involve copying the entire thing?

My current thoughts involve writing an AHK or VB script to compare files based on name and date and copying the ones that don't match. I also found a number of programs that claim to be able to synchronize over a network between machines, but I don't see anything that's really simple enough for what I want. Anyone want to chime in with some of their thoughts?

You can learn how to use xcopy. it comes with windows.

OR you can just download the Update torrents... Like 116 to 117 update rom packs Etc...

[emphatic]

So, do you update every full cycle, like 0.118 -> 0.119? There are often rompacks like "0.118 to 0.119 updated roms only" floating around on the interwebs. Use ClrMAMEPro to update your current set using these packs. If you go from 0.106 to 0.119, you can use more than one rompack. It's a "drag'n'drop" operation, so you can just keep droppin' those roms 'til your hearts content.

http://www.clrmame.com/faq.htm

Emph

[bkenobi]

Thanks for the responses...

I don't update every time and when I do update, I simply point the set to the location of my rom set. That way, I start from up to 90% or more done. I realize there are update sets, but they are only available for each release (like 118 to 119) which would be a bit of a problem when skipping releases (like 109 to 119).

The problem with xcopy is that it will just blanket copy everything over and require more time and bandwidth than is really necessary plus put extra stress on hardware. I had been thinking about using SyncBack since it's free and it uses MD5 checksums rather than simply file name, date, and size so a bad download would be detected too.

Any other thoughts?

[LB11]

Did you try the microsoft briefcase? Thats its whole purpose. syncing files between computers.

[bkenobi]

I haven't used the briefcase before, but I thought it was mainly for use with office documents that have multiple copies (like one on the HDD and one on a floppy) so that you can edit one and have both up to date. I hadn't thought of using it for this. The difference from reading the help page is that it appears you have to move the briefcase back to the source computer for updating.

I've been playing with syncback a little bit and it looks like an ideal tool. I'm thinking I might be able share out the roms dir on the cabinet and use it like a backup location. That's sort of what it is anyway, so it's probably appropriate. Using this software, I can set up multiple rules, so perhaps the second cabinet would only have the files for driving games backed up.

This is just tentative, so any other thoughts are definitely welcomed! Thanks for the responses.

[LB11]

Well, it works with any file. If you decide you dont want to use syncback here is all you have to do for briefcase....

Go on the computer you want to have updated periodically. (your cab in this case)

If you keep your roms on c:\

then go there and file>new>briefcase

Name it roms or whatever you want it to be called. Windows sees it as a folder basically and this will probably be where you will keep your roms while gameex uses them.

Now all you have to do is go to the network and drag and drop the roms from your main computer in there. It has to load them all from your main computer on the network the first time. (you cant just load the ones you have on the cab because thats where it will try and update from in the end)

Anytime you cange the files on the main computer just go to the cab, right click on the briefcase folder and select update all. Any file that changed or is new or removed on the main machine will also be changed in the cab. It should pop up a window that says what is being done before it runs in case there is something you dont want changed.

If you need more help, let me know. Its really very simple though.

[LB11]

Oh, try it with a small folder first to see how it works before you copy all your roms over wireless... bleh

[bkenobi]

Hmmm, that sounds interesting. I might give that a try with a small subset and see how it goes. The fact that I have to copy all roms over the network to start might kill it though, since that might require days of stable network connection. Thanks!

[LB11]

I forgot to mention, you should copy the folder (with the files) over from the network. not the files only. Otherwise it wont update when new files are added to the folder.

Maybe do it in small chuncks.

rename roms to roms2

then make another folder called roms (which you transfer to the briefcase)

then move game 1 - 500 from roms2 for example and click update.

Then the next day or when its done, 501 - 1000 click update on the briefcase.

and etc. that way you dont need a continuous wireless connection.

Thats probably how I would do it anyways.

[bkenobi]

Yeah, I know what you meant. I'm just dreading the amount of time I have to wait with the cab running. I don't leave it on all the time and I'm guessing the wife would question it. I suppose there are other ways to do it like running a hard line from the router to the cab to set it up and then going wireless for the update. I'll have to think about it...

[Adultery]

Why not just use clrMAMEpro? That will tell you exactly which ROM sets need to be changed via a TXT list. You can simply just grab whichever ROMs it says you're missing and you can 'thumb drive' those over.

Of course, the PD people make it pretty easy too, like someone mentioned earlier.

[bkenobi]

I ended up choosing SyncBack since the built in MS Briefcase is a folder and I didn't want it to show up that way. I set up a backup for the roms, chds, and artwork. Since over half of the chds (in terms of GB) are rhythm type games and my current hard drive was way too small for all of them, I set up some exclusion rules to not backup those files. I hooked up a long cat5 cable and let her rip! I was originally thinking it would only need to download a few files, but due to the way I originally transfered the files, they had the wrong dates, so it ended up doing everything.

I do have one question that has just popped up with the new artwork though. I may have to create a new thread for it, but I noticed that the Neo Geo games now have a bezel art that shrinks the screen significantly. My 27" TV displays about 19" game play. Any thoughts on how to turn off bezel art for specific games/bios? I guess I could just put an exclusion rule in for it as well, but I was wondering if there were any other concepts?

[Nologic]

A lot of File Managers tend to have these features even in the free ones.

SyncBack in all likely hood has a more full feature set than compared to Directory Opus...but for the common user DO probably has more than most would ever use.

I'm actually surprised few in this community actually use more advanced File Managers.

General File Manager review. [Linky]

Anyways here is a decent list of free tools...some of which are File Managers that are more advanced that Explorer. [Linky]

Another link with some actual reasoning rather than just bulk posting of links. [Linky]

Another link with some other stuff. [Linky]

[bkenobi]

Those tools can backup files based on filters to another computer on a network automatically/with the click of a single button? I've seen those file managers before, but they didn't seem to do things automatically. Basically, I just don't want to think about it, I just want to download the new set from PD and go to my cabinet and click update. I will have to install the new MAME emulator, but that can be done via terminal services, so I really just wanted something to take care of copying the roms/chds/extras automatically.

Still haven't figured out what to do with the Neo Geo bezels yet.

[Nologic]

Hmm well you got me there...Directory Opus requires a bit more than a single click.

Tho the screenshots attached are a little wrong in that I should have used byte comparison rather than date & size.

*Images removed to save forum bandwidth*

[headkaze]

You could always try Spesoft Backup by our very own Tom Speirs

[Nologic]

Oh gee's being addicted to just one of his app's is bad enough...let alone starting on a new one.

[bkenobi]

CRAP! Now I've got to try that one cause it sounds perfect My intent was initially to make this something I could incorporate in to GameEx, so the problem I had been having is how to get these backups to launch with a button click. Tom's has a command line syntax that makes that trivial. I should have checked here first

[LB11]

That does sound like a great program. You can update strait from the gameex GUI!

Well, good luck either way!

[bkenobi]

Hmmm, I just tried it last night and it turned out that I wasn't able to get Spesoft Backup to connect to a network share. I was able to browse to the files, but it couldn't figure out how to connect. It's like it required a login (which I don't have).

I looked into DOpus, but I'm not interested in paying $89+ AUD for a single license. It did look really good, but I just don't think I would use it enough. Anyway, I'm going to stick with SyncBack for the moment. If/when something else comes along or someone recommends another option, I will reevaluate.

Thanks for all the input!

[Tempest]

I'm probably a little late with this....

I use a program called Intelligent copier - www.interdesigner.com

It lets you set up different paths for different extensions, which can be useful.

I don't know if it works with a network or not.