Duplicate MP3 files....

Fibonacci

Duplicate MP3 files....

I've just consolidated two MP3 libraries on to the one hard drive. There are a lot of duplicate files....

Is there any quick way to quickly delete duplicate files?

Thanks.

galwaydude18

yes there is download a program called system mechanic 5.0. search for it on google. you can download a free trial for 30 days...

jessy

Or just use iTunes on click Show duplicates songs, what player are you using?

bladetrinity

Can You Not Just Save All Files To The Other And You Get A Message Replace All Files Say Yes

jessy

Not really an option if some of the mp3s are not named correctly i.e i'm sure I'm not the only one with 100s of mp3s named Track1.mp3 (5+ years tagging them and I'm still finding the odd Track1.mp3) :mad:

bladetrinity

Yeah Your Right My Collection Is Still Realativly Managable I Delete The Crap As I Go Along You Do Need Software

Fibonacci

Thanks for the suggestions, there is about 60 Gb of songs, so any solution has to be highly automated.....

using iTunes, but when i use 'show duplicate songs' i'd still have to choose every second of 10,000+ to delete them...... so not really a runner.

mechanic 5.0 looks promising....if no-one else has any suggestions, think I'll give that a go.

Cheers for the help.

jessy

The thing is its very hard to fully automate something like this, I know i would not like to lose any of my mp3s, it took me long enough to collect them (and im very proud of my collection), In a fully automated program songs that are tagged the same will probably be deleted :mad: so i would prefer to take my time and Know exactly what im deleting but this is just IMO.

Fibonacci

jessy wrote:

The thing is its very hard to fully automate something like this, I know i would not like to lose any of my mp3s, it took me long enough to collect them (and im very proud of my collection), In a fully automated program songs that are tagged the same will probably be deleted :mad: so i would prefer to take my time and Know exactly what im deleting but this is just IMO.

Yeah, I agree with you. Would be devasted to lose some of the MP3s....

.... on the plus side though. A lot of the MP3s will be identical, just duplicate. Ideally, I'm looking for a program that would spot these, list them and allow me to quickly scroll through and 'untick' ones I don't want to delete.

In other words, I need to be able to 'unselect' not too delete, than 'select' to delete (like with iTunes).....

jozi

Just delete everything and rip all your cd's again.

Program called the godfather searches duplicate files as well, dunno how good it it for it thou

Fibonacci

jozi wrote:

Just delete everything and rip all your cd's again.

Are you f**king kidding me? there's about 60 Gb of music.

clint_silver

a quick search of www.download.com for " duplicate mp3" through up the free utility linked below which says it will help identify dupe mp3s. Havent used it but the review looks ok. Worth a try in lieu of something else turning up.. will try myself later on. hth..

http://www.download.com/EasiMP3/3000-2141_4-10307336.html?tag=lst-0-15

Tony H

try NoClone , only problem is the demo version only lets you move the dups 30 at a time , i got rid of 3000 duplicates that way

Fibonacci

NoClone looks like it would be perfect for the job....but 30 at a time would take a while.

think if nothing better comes by, I might give this a go.

Khannie

a script is your friend.

cmp allows you to compare binary files. It should be easy enough to create two file structure snapshots, compare identical file sizes, run a cmp on them, then delete the duplicate.

I reckon 30 - 60 minutes of coding to a script kiddy like myself. I would do this in exchange for a copy of your entire porn collection (which must be enormous if you have 60 gigs of mp3's).

clint_silver

I'll script it in under 30 mins for just the mp3s.
In fact, I'll give this a go later on when I get home so the company doesnt have IP

Khannie

Under 30 minutes eh? I feel some pseudo code coming on.......

since:

Khannie.codingSkills() == ULTIMATE;

then

If (time < Khannie.time())
{
quality = crap;
}



Only buzzin' clint. Fair play to you. I just haven't the 30 minutes to devote to it. If you make it generic enough and comment it so that it can be understood by people other than yourself, I'll put a link to it in the free software sticky.

Fibonacci

awhhh, I hope was hoping for a geek off...

OfflerCrocGod

bladetrinity wrote:

Yeah Your Right My Collection Is Still Realativly Managable I Delete The Crap As I Go Along You Do Need Software

Stop Writing In Capital Letters All The Time It's Annoying.

clint_silver

I started last night. Ran a couple of small tests on my collection. very quickly Ive found some issues with by size or binary.
Ive got 8000 mp3s. I listed all by byte size, just browsing the first 1000 there were examples of files wthich were obviously the same song from the name but had different byte size and 1 example of 5 completely different songs with the EXACT same byte size. Thinking about it, the size depends on what bit rate the song was ripped, whether the tag was edited etc.

Based on the above I dont think its worth generating a duplicate checker based on the size.
The comprehensive checker would have to look at all fields in the tag as well as byte size to offer potential dupes, else youre going to miss some.
If you were going to do that then you may as well output a dir listing to excel, order by name, put a del before the file you dont want, order by col with the del command in it, then copy and save off to a batch file.

Could possibly order by size then as well.
Thoughts?

I tried that easimp3 freeware I posted earlier, it did the job quite well on a small subset but started to get very clunky after it had loaded 6000 mp3s and practically ground to a halt by the time it hit 7000 so I wouldnt recommend it.

Infini

You could always have them put in the my music folder and have windows media player search and add them to its library. All you'd have to do then is reorganise them in alphabetical order and you could then eliminate the duplicates.

jessy

Infini wrote:

You could always have them put in the my music folder and have windows media player search and add them to its library. All you'd have to do then is reorganise them in alphabetical order and you could then eliminate the duplicates.

Thats not automated. he said he's got like 10000+ duplicates.

clint_silver

The mp3s arent always in alphabetical order.
track name :
"the beatles - let it be.mp3"
"let it be - the beatles.mp3"
"beatles_let_it_be.mp3"
etc
etc

hence do you do the best you can or do you try and get something comprehensive. The closest Ive seen to a "free", performance acceptable app Ive found is Musicmatch which will let you order by any of the tag titles, then its an exercise by eye. The pro version of music match allows super tagging which is quite decent at tagging untagged files. I know some of the freeware apps will do this too but Ive yet to come across one thats as comprehensive as Musicmatch.

Fibonacci

clint_silver wrote:

I started last night. Ran a couple of small tests on my collection. very quickly Ive found some issues with by size or binary.
Ive got 8000 mp3s. I listed all by byte size, just browsing the first 1000 there were examples of files wthich were obviously the same song from the name but had different byte size and 1 example of 5 completely different songs with the EXACT same byte size. Thinking about it, the size depends on what bit rate the song was ripped, whether the tag was edited etc.

Based on the above I dont think its worth generating a duplicate checker based on the size.
The comprehensive checker would have to look at all fields in the tag as well as byte size to offer potential dupes, else youre going to miss some.
If you were going to do that then you may as well output a dir listing to excel, order by name, put a del before the file you dont want, order by col with the del command in it, then copy and save off to a batch file.

Could possibly order by size then as well.
Thoughts?

I tried that easimp3 freeware I posted earlier, it did the job quite well on a small subset but started to get very clunky after it had loaded 6000 mp3s and practically ground to a halt by the time it hit 7000 so I wouldnt recommend it.

yeah, I gave it ago to.

It ran fine, but it doesn't select the duplicate files. It just highlights them....so you'd have to go through by hand and select them. Same result as iTunes.

Running NoClone as we speak......

bladetrinity

OfflerCrocGod wrote:

Stop Writing In Capital Letters All The Time It's Annoying.

sorry no offence intended as you can see when i posted first i was only a baby now im in play school :cool:

greglo23

you could try this. doublekiller http://tinyurl.com/8tkj4. it worked for me !!

optiplexgx270

Fibonacci wrote:

NoClone looks like it would be perfect for the job....but 30 at a time would take a while.

think if nothing better comes by, I might give this a go.

You could always do that mad thing and pay for the software.

thesteve

I wouldn't mind finding a program for this either, 135GB of mp3's and hardly no dupes but would still like as much free disk space as possible... One thing to note is albums from artists vs. complimations, there will be dupes there...

You guys sound like you have some cool collections, I wouldn't mind suggesting swapping but am afraid of getting banned

jozi

What happened that post?

AlmightyCushion

It was spam, I deleted it.

jozi

Fair enough, it was what he said it was thou, I think, im not opening the rar file

calex71

jessy wrote: »

The thing is its very hard to fully automate something like this, I know i would not like to lose any of my mp3s, it took me long enough to collect them (and im very proud of my collection), In a fully automated program songs that are tagged the same will probably be deleted :mad: so i would prefer to take my time and Know exactly what im deleting but this is just IMO.

I agree learned a long time ago to tag and add album art as i go , 60 gbs is a drop in th ocean if something was deleted i would have a hard time knowing what went missing for a start