Author Topic: The Deduplication Project  (Read 3907 times)

0 Members and 1 Guest are viewing this topic.

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #15 on: June 18, 2017 - 09:19:15 »
.
« Last Edit: February 01, 2018 - 23:13:12 by attractivo »

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #16 on: June 19, 2017 - 19:09:48 »
.
« Last Edit: February 01, 2018 - 23:13:08 by attractivo »

Offline cannonwillow

  • Full Member
  • ***
  • Posts: 215
Re: The Deduplication Project
« Reply #17 on: June 23, 2017 - 18:29:36 »
Quick question

are _old folders within the new folders tree also not needed for a complete deduped collection?

example:   New/No-Intro/_Old/*

thanks in advance and for the amazing work.

cannonwillow


Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #18 on: June 23, 2017 - 19:03:21 »
.
« Last Edit: February 01, 2018 - 23:12:48 by attractivo »

Offline cannonwillow

  • Full Member
  • ***
  • Posts: 215
Re: The Deduplication Project
« Reply #19 on: June 23, 2017 - 19:27:48 »
thanks for clearing that up.

 8)

Offline cannonwillow

  • Full Member
  • ***
  • Posts: 215
Re: The Deduplication Project
« Reply #20 on: July 24, 2017 - 08:58:38 »
@tractivo, I have found some undeduped roms within the deduped collection (using the 9904 dat collection). such as gdl-0024.chd and gds-0031.chd as can be seen in the picture attached. one is from \Emulator  and the other from \Mame, Mess . I have seen a few others but cant recall from where. Maybe this is only .chd related.

and how could this amazing project end up on page 2, it really should be stickyed...

cannonwillow
« Last Edit: July 24, 2017 - 09:09:34 by cannonwillow »

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #21 on: July 24, 2017 - 09:27:53 »
.
« Last Edit: February 01, 2018 - 23:19:45 by attractivo »

Offline cannonwillow

  • Full Member
  • ***
  • Posts: 215
Re: The Deduplication Project
« Reply #22 on: July 24, 2017 - 10:12:44 »
I thought by using the deduped dats (9904) I could minimize the size of my rom collection, especially random stuff that may be useful later. instead of deleting when I give up on it or not sure what it is. hate to figure out howto and then start the search all over again. A dat can be pulled from the normal udc collection or anywhere, shoved into the datroot with the deduped collection, uncheck all areas in romvault that probably do not apply, sort order useful here. hunt down the rest. TB's are really getting cheap these days but nobody wants copies of the same thing except for backup (and obviously not on the same drive). and actually organized.



thanks for the undeduped .chd explanation

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #23 on: July 24, 2017 - 10:24:41 »
.
« Last Edit: February 01, 2018 - 23:19:42 by attractivo »

Offline cannonwillow

  • Full Member
  • ***
  • Posts: 215
Re: The Deduplication Project
« Reply #24 on: July 24, 2017 - 10:34:45 »
had to go to microcenters store yesterday to buy more memory. when romvault (using deduped) goes into virtual memory during scan/fix might as well turn the monitors off, drink one last beer, and check it when you wake up the next day and then again the next day. extra memory was designed for romvault :D

Offline NLS

  • Hero Member
  • *****
  • Posts: 503
Re: The Deduplication Project
« Reply #25 on: July 24, 2017 - 11:53:31 »
Very interesting project and amazing work by @tractivo.

Would prefer a generic solution (non existent) though, that automatically uses dats in the order a user decides (because now we all have to agree with @tractivo's order), finds duplicates and fixes things.

Still it is interesting as it might "clean up" left overs we all have.
---
NLS

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #26 on: July 24, 2017 - 12:10:40 »
.
« Last Edit: February 01, 2018 - 23:19:39 by attractivo »

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #27 on: July 24, 2017 - 14:20:29 »
.
« Last Edit: February 01, 2018 - 23:19:35 by attractivo »

Offline cannonwillow

  • Full Member
  • ***
  • Posts: 215
Re: The Deduplication Project
« Reply #28 on: September 27, 2017 - 11:25:02 »
not trying to bring up a dead project, but cant scan these roms a second time without becoming unfixable,  Console/[Misc]/Nintendo - Super Nintendo Entertainment System - SuperNESBase (20160518)[@tractivo]/SuperNESBase/Emulators/....(bsnes_v091-32bit, higan_v094-64bit, snes9x-1.53-x32, snes9x-1.53-x64). just curious as to why romvault keeps wanting to rescan and giving error from these.

Offline attractivo

  • Hero Member
  • *****
  • Posts: 658
Re: The Deduplication Project
« Reply #29 on: September 28, 2017 - 08:40:08 »
.
« Last Edit: February 01, 2018 - 23:23:50 by attractivo »