media import stops after 1490 records

rs232 · Post by **rs232** » 2012-08-05 14:40:18

media import stops thinking to have scan all the directories after 1490 records. is this perhaps a little bug?

Regards

soulsnake · Post by **soulsnake** » 2012-08-05 15:57:09

If you want to scan all subfolders, you have to select * on "Browse subfolders with depth of" option.
After that, if some movies are missing during scan, maybe some extensions are missing too ? If it is the case, you can add them in "Extensions" option.

Soulsnake.

rs232 · Post by **rs232** » 2012-08-06 10:34:15

I've played with the parameters but... it does scan for 3400ish media files however when importing it says:

Code: Select all

1221 movies added
0 movies updated

I click OK and it gives me an "invalid pointer operation"
Then I close the warning and my database is totally impty. if i save it though and re-open the program I can find my (only) 1220 media files.

I'm not sure what I'm doing wrong...

One other question, the "Disk tag" option doesn't work very well for me, I've started to modify it and now it's far too long to be managed.

FIY, I *think* this disk tag works quite well:

Code: Select all

(cd|cd |CD| CD |dvd|xvid|divx|xvid(a|b)|(a|b)-xvid|Part|.|oem|disc|disc |\()[0-9]|(a|b|A|B)|([0-9][0-9]){1,5}

But again it's not perfect at all. So I was thinking... would it be possible to have an option to consider multiple video files within the same directory to be part of the same title?

Finally, how about having an option (after the media dir has been scan and before files have been imported) to highlight the files that sit in the same directory? This would help with:
- find duplicates
- fine tune the Disk tag regular expression (for whoever wants to use it of course)

May thanks

soulsnake · Post by **soulsnake** » 2012-08-06 12:42:12

I've played with the parameters but... it does scan for 3400ish media files however when importing it says 1221.

Do you have the good result when you uncheck option "Merge info of media in multi parts/disks". If it is the case, when you check this option you must have a lot of merge ! Maybe the disk tag is not enough informative !

I click OK and it gives me an "invalid pointer operation"
Then I close the warning and my database is totally impty. if i save it though and re-open the program I can find my (only) 1220 media files.

I'm not sure what I'm doing wrong...

This looks like a bug but I've never had this bug before during my tests.
I don't know how this happen !?

One other question, the "Disk tag" option doesn't work very well for me, I've started to modify it and now it's far too long to be managed.

FIY, I *think* this disk tag works quite well:
Code: Select all
(cd|cd |CD| CD |dvd|xvid|divx|xvid(a|b)|(a|b)-xvid|Part|.|oem|disc|disc |\()[0-9]|(a|b|A|B)|([0-9][0-9]){1,5}

The disk tag is not case sensitive.
This should works too (\s? = 0 or 1 space):

Code: Select all

(cd|dvd|xvid|divx|xvid(a|b)|(a|b)-xvid|Part|.|oem|disc|\()\s?[0-9]{1,3}|[0-9]{2,3}|(a|b)

But again it's not perfect at all. So I was thinking... would it be possible to have an option to consider multiple video files within the same directory to be part of the same title?

Regarding this point, it is not so easy.
How to determine if a folder contains only a movie with multiple parts or just simple movies ?

Finally, how about having an option (after the media dir has been scan and before files have been imported) to highlight the files that sit in the same directory? This would help with:
- find duplicates
- fine tune the Disk tag regular expression (for whoever wants to use it of course)

But you already have this information after scan ?
You have the parent folder of each movie in a column (after filename) and you can sort by this folder name if you want !?

Soulsnake.

rs232 · Post by **rs232** » 2012-08-06 13:45:29

uncheck option "Merge info of media in multi parts/disks".

Done, same result, and same null pointer error. perhaps this is driven by the fact that i have a large database? Can you try to replicate this? perhaps copying directories to make your test relevant?

The disk tag is not case sensitive.

Thanks for that I'll give it a go!

Regarding this point, it is not so easy.
How to determine if a folder contains only a movie with multiple parts or just simple movies ?

I think there's people that like to put everything in the same directory and in that case your point is very valid, where other people like me that like to organise by directory, so 2, 3 or even 4 files in the same directory = just one movie. processing this way would avoid going through the DiskTag and precisely identify movies by parent folder name.

Again I'm not saying that everybody organises data on a directory bases, but I'm one of those and perhaps there's somebody else out there that use the same method.

e.g. if i have a series with 6 episodes i just don't store it into my MOVIES directory and I have a SERIES folder for that.

I just though having such a option might help people that's all.

But you already have this information after scan ?
You have the parent folder of each movie in a column (after filename) and you can sort by this folder name if you want !?

yes, you're right and that's what I've been doing do far (sorting by name), once again I haven't explain myself too well lol

What i wanted to ask is: is it possible to highlight e.g. the duplicate path? I totally agree with you if you have 25 video you just read the list, if you have 3500 videos, finding duplicates becomes as tedious as browsing the directory manually.

Once again many thanks for the excellent support!

soulsnake · Post by **soulsnake** » 2012-08-06 14:47:34

Done, same result, and same null pointer error. perhaps this is driven by the fact that i have a large database? Can you try to replicate this? perhaps copying directories to make your test relevant?

I will try to replicate this bug but I am not sure to success.
If you want to help me you can try different cases (scan 1 folder, 100 folders, ..., change key field ?, ...) and say me which of them occurs an error or not. Thanks !

I think there's people that like to put everything in the same directory and in that case your point is very valid, where other people like me that like to organise by directory, so 2, 3 or even 4 files in the same directory = just one movie. processing this way would avoid going through the DiskTag and precisely identify movies by parent folder name.

Again I'm not saying that everybody organises data on a directory bases, but I'm one of those and perhaps there's somebody else out there that use the same method.

e.g. if i have a series with 6 episodes i just don't store it into my MOVIES directory and I have a SERIES folder for that.

I just though having such a option might help people that's all.

Yes I understand but I try to do the things as generic as possible.
Besides, I think you can do whatever you want with this disk tag:

Code: Select all

.*\. #merge folder

This will merge all movies with the same file extension in same folder.

yes, you're right and that's what I've been doing do far (sorting by name), once again I haven't explain myself too well lol
What i wanted to ask is: is it possible to highlight e.g. the duplicate path? I totally agree with you if you have 25 video you just read the list, if you have 3500 videos, finding duplicates becomes as tedious as browsing the directory manually.

Yes I understand but this is a particular case of your own use (all movie parts of a movie are in a unique and separate folder) ...

Soulsnake.

Post by **antp** » 2012-08-06 14:53:45

Organizing movies by folder is quite common and logical (and, I think, the most common).
So if there are options for supporting that, it would not break too much the "generic" idea, as it would still be a normal/common case.

rs232 · Post by **rs232** » 2012-08-06 17:55:01

What I can add related to the bug is that I have 1 root folder, inside this 31 subfolders (all the alphabet A->Z plus a couple of others custom names).
Inside these 31 subfolders my media files spread alphabetically.
If I add the parent folder and scan with a depth of two it scans exactly and completely 20 directory beginning from the last one.
Pretty much Z->G then it crashes.

Finally I do agree with antp, even if having that option would mean replace the Disk tag with .*\. as advised.

rs232 · Post by **rs232** » 2012-08-06 18:08:58

I've tried to scan a single letter folder (C) and it crashed again, so perhaps it's not the number of media files...

soulsnake · Post by **soulsnake** » 2012-08-14 14:21:06

For people who want to know, we have found why the program crashes sometimes during import.
There is a bug when importing pictures whose name contains invalid characters (that don't exist in ANSI table, e.g. some Chinese or Russian characters).
This bug has been fixed for the next release (v4.1.2 ?).
Now if we find file paths with invalid characteres during scan, we ignore them and we warn the user with a warning message that contains all the invalid file paths found.
In addition, we now generate a complete log (scan.log) containing all the information about scan in 'Ant Movie Catalog' data folder if needed

.

Soulsnake.