tehƧP@ƦKly�ANK� -Ⅲ�
01-19-2016, 10:54 PM
Movie Fingerprints:

Bridge of Spies (2015) (Thread 199040)
Dark City (1998) [Director's Cut] (Thread 199040)
Horton Hears A Who! (2008) (Thread 199040)
Kung Fu Panda (2008) (Thread 199040)
Kung Fu Panda 2 (2011) (Thread 199040)
Secret Life of Walter Mitty, The (2013) (Thread 199040)
Suicide Squad (2016) - Trailer 1 (Thread 199040)
Suspiria (1977), Dario Argento's (Thread 199040)
TRON (1982) (Thread 199040)


EDIT:
Spectre used wrong audio (different Bond film) plus there was no normalization to prevent clipping.
Audio clips (exceeds 0dBFS) so it will have to be done again.



So here I'll be doing some movie "fingerprints" where I take every frame in a movie and average the color and make a column of that frame.
The every column will be squished right upside each other like sardines in a can.
The display resolution will be upscaled to Full 4K (4096x2304) so you can get a better look at some of the columns.

This will give you a general idea of the color palette to the film.
Is it naturally dark? Is it bright? How green is the Matrix, anyhow?
(The Matrix coming soon)

The first part is just the movie fingerprint.
It's colorful, very colorful.

The second part is creating intermediate files to create a waveform with transparency and create masks for the whole process.
This requires converting the whole movie audio to a mono wav file to run through a "waveform generator" with alpha transparency.
This has to be done twice (or more) so you create intermediate files with different parts of the image containing Alpha Transparency.
You want one with the background completely transparent and the waveform filled with black so it counts as an image.
You want another one with the waveform completely transparent and the background black (or any color really).
Now you should 3 sets of images: fingerprint, alpha_background, alpha_waveform.

(With some waveform generators, it's possible to add a "gradient transparency" in the waveform. Fancy, probably better for some custom cover artwork or other post work)


Once the intermediate files are created, you use ImageMagick to work through it spit out a pretty waveform with the colorful fingerprint inside the waveform!
This part is the trickiest to composite.
ImageMagick works best over Avisynth since you are assured alpha transparency.




Scroll down for examples.



This takes a lot of time to figure out.
But I finally did it so that it can be done using all free tools (no cracks or anything).

Tools required:
1) Avisynth (non-linear video editing via scripting; not for novices)
2) Imagemagick (to work better with images that contain alpha transparency) (not really for beginners either, better copy/paste existing examples)


This can be done with Adobe PhotoShop or other photo editors that work with alpha transparency, layers and masking.
I can't remember how that works, though. I don't remember the process and settings you need when layering.
But, I don't like how slow it is just to load. Once the program is opened, you want it open forever because it's overbloated software.
Even on an SDD with [email protected], it's a pain just to start the program. :notgood:

So I looked up ImageMagick since it's a CLI program (Command Line Interface; uses Command Prompt/CMD/Console Window).



Some examples:
All images are linked images.
Click on image to view on Imgur.
Once at Imgur, click button to "download" image, or right-click on image and "View Image" to view in full resolution.


Spectre (2015)
Coming Soon(tm)

Phew.

More coming soon.
Now that I got it all worked out, I can add the commands later so others can try.



But a warning!:
This can only be done on Windows operating systems due to Avisynth usage.
There's a Linux port of Avisynth, but it's vastly deprecated and no longer in development.
There is no real port of Avisnyth to MAC that I know of.

Depending on your system specs, this could take 1-2 hours to do one (2-hour) movie.
The fingerprint scaninng takes some time.
What can speed this up? Using Solid State Drives (SSD) or USB 3.0 external HDD's running through USB 3.0 ports so it basically caps at your CPU.
Windows x64 makes no difference. For this processing, you won't be doing extensive processing where using AVS x64 (AVS+ 64 instead of regular AVS x64) memory would help.

Converting audio to mono with ffmpeg will also take some time.
Maybe 15-30 minutes on HDD. Same as above, try to use all USB 3.0 instead of USB 2.0.

The png creation and editing is the fastest process.
Should only take up to 5 minutes maximum.



Coming Soon:
Interstellar
Inception
The Martian

Requests?
Make sure to include an IMDb link so there's no confusion.

Kung Fu Panda (2008)
http://www.imdb.com/title/tt0441773/

The Secret Life of Walter Mitty (2013)
http://www.imdb.com/title/tt0359950/

Momonoki
01-19-2016, 11:02 PM
http://www.imdb.com/title/tt0441773/ <3
This is so mesmerizing.

tehƧP@ƦKly�ANK� -Ⅲ�
01-19-2016, 11:06 PM
http://www.imdb.com/title/tt0441773/ <3
This is so mesmerizing.

Aw, that's going to look pretty.
I love the orange atmosphere to that film.

I'll have to work on it though. I lost my copies to the first two.
This will be excellent to restock on that one.

I'll add it to the list.

Azetlor
01-19-2016, 11:15 PM
http://www.imdb.com/title/tt0359950/
Some awesome visuals. Awesome film with exceptional music.

Momonoki
01-19-2016, 11:18 PM
Thank you :33 I agree.

tehƧP@ƦKly�ANK� -Ⅲ�
01-19-2016, 11:19 PM
http://www.imdb.com/title/tt0359950/
Some awesome visuals. Awesome film with exceptional music.

I think I still have that.
I'll add it and look for it.
The contrast of the outdoor shots and indoor should show up nicely.

tehƧP@ƦKly�ANK� -Ⅲ�
01-23-2016, 10:09 AM
Kung Fu Panda (2008) (http://www.imdb.com/title/tt0441773/)



(http://imgur.com/TWhNg17)


Using ReplayGain 2.0 standard on the mono waveform.
EDIT: No clipping. Max peak is actually at 0dB

(http://imgur.com/UHjjH4F)

CLONEMASTER 6.53
01-23-2016, 05:54 PM
Slightly darker tones than I imagined, but still one of the better looking ones. :)

tehƧP@ƦKly�ANK� -Ⅲ�
01-23-2016, 08:25 PM
It's because of the Panda. :p
his black fur changes the average color for each frame he's in.

Momonoki
01-23-2016, 08:31 PM
It's crazy. I can see the scenes in the lines, like I know exactly where each and every moment is in that fingerprint just by looking at the colours.. Maybe I've seen the film 100 too many times x3

tehƧP@ƦKly�ANK� -Ⅲ�
01-23-2016, 09:39 PM
I haven't been able to finish watching the first one. Got so side tracked trying to compile my own version of SoX among other things.

But, I can see what you mean.

There's still another "normalization" i want to try out.

That was done using just "peak normalization" (or "sample peak").

I want to try EBU R128 and ReplayGain 2.0 (instead of 1.0).
EBU R128 is a European standard that aims for -23.0 LUFS (Loudness Units Full Scale)
North American standard is ATSC A/85 @-24.0 LUFS.
So the European standard should sound louder over the North American Standard.
ReplayGain 2.0 aims for -18.0 LUFS!

Taking Kung Fu Panda 1 and mixing to mono and applying a generic peak normalization of -0.1 (waveform does not touch borders and no clipping),
then running a scan on it using bs1770gain analysis tool, we can see through European standards and ReplayGain 2.0 standards just how much loudness we can actually gain...

thus:
Pay attention to "LU" values on the end of the lines.
"LU" = Loudness Unit (how much we can apply to achieve loudness of given standard

Default for bs1770gain is to read at EBU R128 standard (-23.0)

E:\Temp>"C:\Apps\Audio\bs1770gain-0.4.8-win64\bs1770gain.exe" -ismrpt KFP1-mono-norm.wav
analyzing ...
[1/1] "KFP1-mono-norm.wav":
integrated: -30.63 LUFS / 7.63 LU
momentary maximum: -14.06 LUFS / -8.94 LU
shortterm maximum: -19.40 LUFS / -3.60 LU
range: 20.93 LUFS
sample peak: -0.10 SPFS / 0.988553
true peak: -0.10 TPFS / 0.988722
[ALBUM]:
integrated: -30.63 LUFS / 7.63 LU
momentary maximum: -14.06 LUFS / -8.94 LU
shortterm maximum: -19.40 LUFS / -3.60 LU
range: 20.93 LUFS
sample peak: -0.10 SPFS / 0.988553
true peak: -0.10 TPFS / 0.988722
done.

Now the same file but scanned to ReplayGain 2.0 standard (-18.0)

E:\Temp>"C:\Apps\Audio\bs1770gain-0.4.8-win64\bs1770gain.exe" -ismrpt --replaygain KFP1-mono-norm.wav
analyzing ...
[1/1] "KFP1-mono-norm.wav":
integrated: -30.63 LUFS / 12.63 LU
momentary maximum: -14.06 LUFS / -3.94 LU
shortterm maximum: -19.40 LUFS / 1.40 LU
range: 20.93 LUFS
sample peak: -0.10 SPFS / 0.988553
true peak: -0.10 TPFS / 0.988722
[ALBUM]:
integrated: -30.63 LUFS / 12.63 LU
momentary maximum: -14.06 LUFS / -3.94 LU
shortterm maximum: -19.40 LUFS / 1.40 LU
range: 20.93 LUFS
sample peak: -0.10 SPFS / 0.988553
true peak: -0.10 TPFS / 0.988722
done.

Things like "integrated/momentary/shortterm" are still new to me.

you can read lots more here:
http://bs1770gain.sourceforge.net/
And download and give it a try on some music.

I think Foobar2000 ReplayGain uses v1.0 standard? I haven't looked for awhile.

It updates quite often. Last update was Dec 2015, so that's good.



Anywho, this is what Kung Fu Panda (2008) looks like using ReplayGain 2.0 standard on the mono waveform.
EDIT: No clipping. Max peak is actually at 0dB

(http://imgur.com/UHjjH4F)

---------- Post added at 12:39 PM ---------- Previous post was at 12:31 PM ----------

Just did a scan with SoX for "stat" and "stats" on the RG2 conversion.
There should be no clipping (over 0dBFS).


DC offset -0.001156
Min level -1.000000
Max level 0.999999
Pk lev dB 0.00
RMS lev dB -19.09
RMS Pk dB -0.81
RMS Tr dB -1.#J
Crest factor 9.00
Flat factor 41.33
Pk count 304k
Bit-depth 24/24
Num samples 265M
Length s 5529.483
Scale max 1.000000
Window s 0.050

tehƧP@ƦKly�ANK� -Ⅲ�
01-24-2016, 12:33 AM
Kung Fu Panda 2 (2011)
(http://imgur.com/cFE9RaV)


Fingerprint@4K:
(http://imgur.com/5r6A6rU)

Fingerprint@4K in Waveform:
(http://imgur.com/W5DXiSw)

Fingerprint@4K in Waveform +ReplayGain2.0:
(http://imgur.com/63A3Mer)





Suicide Squad (2016) - Trailer 1
(http://imgur.com/tAUrpTo)


Fingerprint@4K:
(http://imgur.com/g3c0ymn)

Fingerprint@4K in Waveform:
(http://imgur.com/M1IalQc)

Fingerprint@4K in Waveform +ReplayGain2.0:
(http://imgur.com/3m1ADnZ)

CLONEMASTER 6.53
01-24-2016, 01:00 AM
^These are looking good.

Would be interesting to see Finding Nemo.

Azetlor
01-24-2016, 01:10 AM
Don't forget about Walter Mitty :P

tehƧP@ƦKly�ANK� -Ⅲ�
01-24-2016, 01:11 AM
Bridge of Spies (2015)
(http://imgur.com/uRtayB5)


Fingerprint@4K:
(http://imgur.com/Bzx6kxq)

Fingerprint@4K in Waveform:
(http://imgur.com/D4pY5ib)

Fingerprint@4K in Waveform +ReplayGain2.0:
(http://imgur.com/h82VDm5)

tehƧP@ƦKly�ANK� -Ⅲ�
01-26-2016, 05:30 AM
Dark City (1998) [Director's Cut]
http://i.imgur.com/kugHm3N.gif

These ones, right-click and "View Image" to see in full resolution (4096*2304)

Fingerprint@4K:


Fingerprint@4K in Waveform:


The fingerprints are vastly dark due to the movie being extremely dark so here are versions with boosted saturation, brightness and contrast:

Boosted Fingerprint@4K:


Boosted Fingerprint@4K in Waveform:

tehƧP@ƦKly�ANK� -Ⅲ�
01-27-2016, 06:33 AM
The Secret Life of Walter Mitty (2013)
(http://imgur.com/fEHKkH9)

Fingerprint@4K:

(http://imgur.com/EmUKgOX)

Fingerprint@4K in Waveform:

(http://imgur.com/02xVDeo)

(http://imgur.com/H4OClUG)

Consequently, this movie was done in Dolby Atmos, but no bluray existed in Atmos. :p
(http://imgur.com/gGS0J9n)

tehƧP@ƦKly�ANK� -Ⅲ�
01-27-2016, 08:51 PM
Horton Hears A Who! (2008)
(http://imgur.com/dF4yUfN)

Fingerprint@4K:
(http://imgur.com/kGmJkwy)

Fingerprint@4K in Waveform:
(http://imgur.com/09MvACv)

Azetlor
01-29-2016, 03:11 AM
I'm thinking Interstellar and / or The Martian

Momonoki
01-29-2016, 11:07 PM
INTERSTELLAR!!! It would be mostly black and white I think :P

James P.Sullivan
02-05-2016, 03:13 AM
I've only just found this thread - so this is where these have been posted! They're so awesome. :D

I remember you did one for Inception when you first had this idea. The other film I suggested was Cars 2. Also Ratatouille. Both very colourful.

Actually, the first Cars would be lovely too. I'm in love with the colour palette of that film. Also, Spirit: Stallion of the Cimarron would be gorgeous.

But I don't know how much time and energy go into making these.

Dave999
02-10-2016, 04:27 PM
This is amazing and it does look like a nifty way for a color grader to get a first (but not at all cursory) glance of what a film looks like :)

---------- Post added at 04:27 PM ---------- Previous post was at 04:20 PM ----------

I'd like to see what Superman The Movie looks like, if you have it (and have the time to do it) :)

tehƧP@ƦKly�ANK� -Ⅲ�
02-10-2016, 11:22 PM
I'll see what I can do.

The time it takes to one of these is about... half an hour?
That's if I have the movie in the first place.

I think I found a way to rip the audio only once but I have to test that.

The normal process means I have to rip the audio to WAV (usually over 4GB so I use w64 just in case), then mix that down to mono in float 32 with peak normalization.
Indexing the video in avisynth for the color palette can take anywhere from 5-10 minutes, depending on the length of the movie.

Compiling the waveforms and the fingerprint in the waveform is relatively easy since it can be done with a batch script and the processing of the final stages only takes less than a minute.

Currently, I'm trying to expirment with the scripting to get them output in higher definition.
The resolution is high, but I want it bigger, richer!

gururu
02-11-2016, 12:05 AM
I'd like to see the results for political speeches.

tehƧP@ƦKly�ANK� -Ⅲ�
02-11-2016, 02:59 AM
I don't follow politics.

The only sources available would be anything from youtube.
There might be torrents out for any HDTV captures of whatever those things are. But that might even be a long stretch.
I don't normally see anything political on any site. Not even public sites.

hack3rman
02-11-2016, 04:03 AM
How about Toy Story? Or either of the TRON films? :D

CLONEMASTER 6.53
02-11-2016, 04:25 AM
We gotta get Finding Nemo in here first! :p

tehƧP@ƦKly�ANK� -Ⅲ�
02-11-2016, 06:29 AM
Nemo and Tron Legacy I can do.

The other movies I'd have to look for a download.
By "look", I mean through my usual avenues. I already know where to get them. I just have to get them.



I have:
Inception (remastered)
Interstellar (remastered)
The Martian
Finding Nemo
Tron: Legacy

I don't have:
Superman The Movie
Cars
Spirit: Stallion of the Cimarron
Toy Story

tehƧP@ƦKly�ANK� -Ⅲ�
02-15-2016, 07:05 AM
TRON (1982)
(http://imgur.com/ggeo7Ax)

Fingerprint@4K:
(http://imgur.com/oRWv9bE)

Fingerprint@4K in Waveform:
(http://imgur.com/ONINcYE)

hack3rman
02-15-2016, 07:08 AM
TRON (1982)
(http://imgur.com/ggeo7Ax)

Fingerprint@4K:
(http://imgur.com/oRWv9bE)

Fingerprint@4K in Waveform:
(http://imgur.com/ONINcYE)

Sweet! Thank you! A lot of blue like I was expecting! :P looking forward to Legacy

tehƧP@ƦKly�ANK� -Ⅲ�
03-05-2016, 09:36 AM
Dario Argento's Suspiria (1977)
German bluray release (distributor: 84 Entertainment).

(http://imgur.com/pKU7UTq)

(http://imgur.com/D9WLyIA)

The German bluray provided original ComOpt (combined optical) mono audio. So there was less work needed to be done.
(http://imgur.com/7MKWgIu)

Used ReplayGain 2.0 to normalize.
(http://imgur.com/PWB4ct7)

Momonoki
03-06-2016, 09:32 AM
Ahh, I like that one. Thanks for your contributions :)

tehƧP@ƦKly�ANK� -Ⅲ�
08-02-2016, 05:52 PM
Angry Birds, the movie




"Symphony Mode" (aka, the isolated score)


Lubrick
01-12-2017, 10:17 AM
Wow I really found your fingerprints amazing to see ! It's kind of a color chart for those movies, very beautiful :)

Blip
05-21-2017, 04:43 PM
These. Are. Incredible!!

Have you thought of doing any of the Marvel films? Several have noticeably rich & differentiated palettes throughout; much like the Star Wars films for that matter (and quite varied soundtracks) - could make for some very cool waveforms, IMO...

LoseYourself99
12-14-2017, 12:36 PM
I love these. Seconded for Tron Legacy.
Would love to see Nemo and Inception too.

GOTG2 and Ragnarok would look pretty dope as well

Tarditus
10-14-2018, 09:46 PM
These fingerprints look amazing and very nice idea!
Tron: Legacy would be amazing and I would add another request to Mad Max: Fury Road.

Thanks for your work!