Giallo

Using a vision language model to analyze Italian Giallo films

Oct 31 2025

Intro

Italian Giallo Films seem to be having a little resurgence recently. I first was exposed to them when the Criterion Channel app had a collection of them for Halloween a few years ago and now watch a few of them around this time of year mixed in with other spooky season movies. They are terrible movies, but are usually visually striking. It’s like the cinematographer or director is competing to make the most saturated, dramatic and elaborate scene possible. Coupled with the 1960/70s aesthetic they are really kind of fun to visually experience. Watching them you notice recurring tropes, things like extreme zoom shots of the actors eyes, a shadow creeping up a staircase or a POV knife wielding gloved hand. I was wondering if you had a large corpus could you automatically group these tropes and maybe discover new ones or even see influences?

Image Similarity algorithms are a pretty common approach to work with a corpus to find visually similarity but I wanted to group the content of the scenes not just how they looked. I want to group two scenes together of a shadow walking down a hallway even if they are visually very different. So I thought I could maybe use a vision language model to describe a scene and then use that textual description to group and explore. I decided to try and use the Qwen2.5-VL-72B-Instruct model and send it a frame from the movie every 5 seconds to build a textual representation of the film. I did this for about 70 Giallo films and used those texts to do some experiments. This post looks at that process and results.

Code + Data

All the code and data that I can make public is in this repo. This project is working with copyright material though and also it's pretty graphic so I’m limited in what I can realistically put up in the form of public tools and visualizations. But everything I created from the material such as scene descriptions and embeddings I put in the repository.

This_Is_Cinema.mkv

In any project collecting the data is often the hardest part. If you want to algorithmically examine Giallo films you need a lot of Giallo films. Wikipedia has a helpful list of films I decided to just focus on the 1970s films which really represent the peak I think of the genre. I spent some time gathering the ~140 films from the list as best I could. I ended up only able to get 70-ish of them in good quality. I was pretty discerning, a lot of these are on free streaming sites but they are in potato quality. However even only 70 films if you extract a frame every 5 seconds ended up being over 80,000 images. I thought this was enough to get a sense if it would work at all. Here is a list of the the 140 films I tried to get and which ones I was able to find:

The Bird with the Crystal Plumage (1970)
Hatchet for the Honeymoon (1970)
Paranoia (1970)
Five Dolls for an August Moon (1970)
Death Occurred Last Night (1970)
A Suitcase for a Corpse (1970)
Your Hands on My Body (1970)
Forbidden Photos of a Lady Above Suspicion (1970)
Kill the Fatted Calf and Roast It (1970)
In the Folds of the Flesh (1970)
The Weekend Murders (1970)
The Man with Icy Eyes (1971)
A Lizard in a Woman's Skin (1971)
The Fifth Cord (1971)
Oasis of Fear (1971)
The Strange Vice of Mrs. Wardh (1971)
The Case of the Scorpion's Tail (1971)
Black Belly of the Tarantula (1971)
The Cat o' Nine Tails (1971)
The Bloodstained Butterfly (1971)
Four Flies on Grey Velvet (1971)
Marta (1971)
The Double (1971)
Cross Current (1971)
The Iguana with the Tongue of Fire (1971)
A Bay of Blood (1971)
They Have Changed Their Face (1971)
The Designated Victim (1971)
Slaughter Hotel (1971)
The Fourth Victim (1971)
The Devil Has Seven Faces (1971)
Seven Murders for Scotland Yard (1971)
Death Walks on High Heels (1971)
The Short Night of the Glass Dolls (1971)
Cold Eyes of Fear (1971)
Human Cobras (1971)
In the Eye of the Hurricane (1971)
The Glass Ceiling (1971)
Two Males for Alexa (1971)
The Night Evelyn Came Out of the Grave (1971)
The Great Swindle (1971)
Amuck! (1971)
The Red Headed Corpse (1972)
The Case of the Bloody Iris (1972)
Don't Torture a Duckling (1972)
Who Killed the Prosecutor and Why? (1972)
Death Walks at Midnight (1972)
Alta Tension / High Tension (1972)
An Open Tomb...An Empty Coffin (1972)
Who Saw Her Die? (1972)
My Dear Killer (1972)
Spirits of Death (1972)
Your Vice Is a Locked Room and Only I Have the Key (1972)
The French Sex Murders (1972)
Death Falls Lightly (1972)
Smile Before Death (1972)
What Have You Done to Solange? (1972)
Knife of Ice (1972)
Eye in the Labyrinth (1972)
Murder Mansion (1972)
All the Colors of the Dark (1972)
The Killer is on the Phone (1972)
Tropic of Cancer (1972)
Love and Death in the Garden of the Gods (1972)
The Dead Are Alive (1972)
So Sweet, So Dead (1972)
Delirium (1972)
Seven Blood-Stained Orchids (1972)
The Crimes of the Black Cat (1972)
Naked Girl Killed in the Park (1972)
The Two Faces of Fear (1972)
The Weapon, the Hour, the Motive (1972) [L'arma l'ora il movente]
The Red Queen Kills Seven Times (1972)
The Cat in Heat (1972)
A.A.A. Masseuse, Good-Looking, Offers Her Services (1972)
Death Carries a Cane (1973)
Torso (1973)
The Deadly Triangle (1973)
The Flower with the Petals of Steel (1973)
Seven Deaths in the Cat's Eye (1973)
The Bloodstained Lawn (1973)
The Sex of the Witch (1973)
Love and Death on the Edge of a Razor (1973)
The Crimes of Petiot (1973)
Death Smiles on a Murderer (1973)
No One Heard the Scream (1973)
Don't Look Now (1973)
The Perfume of the Lady in Black (1974)
Delitto d'autore (1974)
Blue Eyes of the Broken Doll (1974)
Five Women for the Killer (1974)
Spasmo (1974)
Puzzle (1974)
The Girl in Room 2A (1974)
The Killer Reserved Nine Seats (1974)
What Have They Done to Your Daughters? (1974)
Ciak...si muore (1974)
The Killer Is One of the Thirteen (1974)
The Killer Wore Gloves (1974)
The Killer With a Thousand Eyes (1974)
The Fish With the Gold Eyes (1974)
Death Will Have Your Eyes (1974)
Eyeball (1975)
Autopsy (1975)
The Killer Must Kill Again (1975)
Giochi erotici di una famiglia per bene (1975)
All the Screams of Silence (1975)
A Dragonfly for Each Corpse (1975)
La pelle sotto gli artigli (1975)
Footprints on the Moon (1975)
Deep Red (1975)
Strip Nude for Your Killer (1975)
The Killer is Not Alone (1975)
Reflections in Black (1975)
The Suspicious Death of a Minor (1975)
The Bloodsucker Leads the Dance (1975)
...a tutte le auto della polizia (1975)
Snapshot of a Crime (1975)
The Police Are Blundering in the Dark (1975)
Death has blue eyes (1976)
The House with Laughing Windows (1976)
Plot of Fear (1976)
Death Haunts Monica (1976)
Death Steps in the Dark (1977)
Crazy Desires of a Murderer (1977)
The Psychic (1977)
The Pyjama Girl Case (1977)
Watch Me When I Kill (1977)
Nine Guests for a Crime (1977)
Hotel Fear (1978)
The Sister of Ursula (1978)
Red Rings of Fear (1978)
The Bloodstained Shadow (1978)
Cock Crows at Eleven (1978)
The Perfect Crime (1978)
Trauma (1978)
Atrocious Tales of Love and Death (1979)
Killer Nun (1979)
The Sky is Falling (1979)
Giallo a Venezia (1979)
Play Motel (1979)

Process

I ran all 80k images through the model with a prompt asking it to identify things in the frame, striking features of the scene and a few sentence description. Here is an example of what a single frame data looks like:

"The.Bird.With.The.Crystal.Plumage.1970.mkv__0465.jpg": {
    "tags": [
      "man",
      "glasses",
      "telephone",
      "hand",
      "face"
    ],
    "striking": [
      "closeup of eyes",
      "dark lighting",
      "intense gaze"
    ],
    "description": "Man holding telephone to ear. Eyes focused and serious. Dark shadows cast on face.",
    "file_name": "The.Bird.With.The.Crystal.Plumage.1970.mkv__0465.jpg"
  }

In this case the count in the filename 0465 is the timestamp of the film 0465*5 seconds == 38 Minute and 45 Seconds

At this point I built some tools that lets you explore the 70 film corpus textually by features. You can see across all film scenes that have "closeup of eyes" for example. Here is a video showing that interface if you are interested since I cannot put it up publicly (source code in repo though).

Expand to watch video

This tool lets you build clips from selected scenes, so you can make a supercut from the 70 films like this:

Or an exploration of reel-to-reel technology depicted in Giallo films:

I would make more but it is pretty annoying posting copyrighted material on YouTube, even short clips like this get flagged with copyright issues and there is no telling if the copyright holder’s policy is to completely block your video or simply monetize it.

Embeddings

Next step was to send the 80K frames to build embeddings. I used the Google gemini-embedding-001 in “cluster” mode and only used the “tags” and “description” section of the text to build the embedding.

Now with embeddings available I first built nearest neighbors for all the frames and created a little interface to let me manually browse those, again I can't put it online so here is video if interested.

Expand to watch video

But I wanted to automatically find tropes, I’ve built clusters before after reducing the 3072 dimensions using something like UMAP but I wanted to try building clusters without reducing dimensionality. I tried HDBSCAN which is interesting because it doesn’t force every vector into a cluster which makes sense for this application I wouldn’t expect every frame to be related to another.

The result was around 330 clusters which I sent off the descriptions of each cluster to a LLM to organize them into a single description of what all the descriptions had in common. The result is a pretty interesting list of possible scenes you would expect to find in a Giallo:

# Frames Cluster Name
333Fearful or suspenseful women's faces and eyes dramatically obscured or revealed by darkness and shadow.
309Intimate bedroom scenes of couples in close physical embrace or repose, typically under soft or dim lighting.
290Tense, dimly lit indoor dialogues between two individuals.
186Movie credit sequences featuring high-contrast text against simple, often dark or solid-colored backgrounds.
154Suspenseful nocturnal scenes featuring solitary vehicles navigating or parked on dark, desolate, or forested roads, often with headlights piercing the pervasive shadows.
118Scenes of men engaged in tense and urgent phone calls within dimly lit, suspenseful indoor settings.
117Tense, dimly lit nocturnal conversations between a man and a woman inside a car.
116Vulnerable women sleeping in dimly lit, suspenseful settings.
106Tense and intimate dialogues or confrontations among women in private indoor settings.
101Contemplative and investigative office scenes.
100Eerie nocturnal scenes set in dense, dark forests, featuring shadowy figures and an atmosphere of hidden dangers.
100Ominous encounters with shadowy figures at dimly lit doorways.
98Professional or investigative office meetings among men engaged in serious or tense discussions.
97Suspenseful scenes of women cautiously engaging with dark or shadowy doorways.
96Close-up shots of a hand gripping a knife in darkness, establishing intense suspense and the imminent threat of violence.
95Dark, suspenseful scenes of an unidentifiable figure emerging from profound obscurity.
86Tense domestic interactions or conversations in a kitchen setting.
83Tense outdoor discussions between two men, frequently set in lush natural environments or against rustic stone backdrops.
76Suspenseful scenes depicting women fearfully traversing dimly lit staircases and hallways, marked by pervasive shadows creating an eerie and foreboding atmosphere.
72Scenes of intimate embraces and kisses between a man and a woman, often portrayed in atmospheric low light or dramatic color.
68Contemplative formally-dressed men isolated within serene yet mysterious natural outdoor environments.
66Dimly lit scenes of vulnerable men in bed.
65Shadowy figures navigating dimly lit, suspenseful staircases.
64Giallo scenes of a woman being stalked by a masked, knife-wielding figure in a shadowy corridor.
61Scientific investigation and discussion in laboratory settings.
60Pivotal, tense discussions or confrontations between formally dressed men in private settings.
59Courtroom trial proceedings with judges, lawyers, and juries.
57Intimate scenes depicting vulnerable women at rest or asleep in dimly lit beds.
55Dramatic close-ups of women's faces conveying intense emotional states.
54Detailed close-ups of analog tape recorders emphasizing their mechanical operation.
54Close-up depictions of men with bloodied faces exhibiting intense pain and distress.
52Dramatic chiaroscuro close-ups of men's faces conveying intense emotion and suspense.
50Darkly atmospheric giallo tableaux depicting the motionless, often bloodied body of a woman, typically with a knife nearby.
49Tense reveals of a knife-wielding, shadowy assailant in a dark setting.
48Serious Outdoor Conversations between a Man and a Woman.
48Terrorized women in darkened bedrooms facing unseen or impending threats.
47Scenes depicting formally dressed men engaged in tense, often dimly lit, indoor conversations or deep contemplation.
46Solemn or mysterious scenes featuring clergy, often engaged in rituals, within dimly lit religious or ornate settings.
45Pensive scenes of women smoking in dark, mysterious interiors.
44Dimly lit dining scenes featuring intimate or tense conversations.
43Scenes featuring women in contemplative or cautious states amidst dense natural surroundings.
43Scenes of quiet intimacy between a man and woman in bed.
41Tense exchanges with clergy in dimly lit ecclesiastical settings.
41Masked killer attacks on terrified women, highlighted by blood on white clothing.
40Dark, reflective nocturnal waterscapes conveying suspense and hidden threats.
40Dramatically lit portraits of men in suits engaged in intense, contemplative, or suspicious thought.
39Dimly lit nocturnal car interiors focusing on a woman's tense or contemplative state.
38Intimate or tense bedroom scenes featuring smoking couples.
36Winding road sequences featuring solitary cars traversing isolated natural landscapes.
36Motionless, bloodied male victims in dark, tense settings.
34Mirror reflections conveying suspense and impending danger to women.
33Opening and closing credit sequences overlaid on evocative natural landscapes, frequently depicting trees or water at dusk or twilight.
33Funeral services and processions.
33Suspenseful nocturnal scenes featuring a lone figure navigating dimly lit, shadow-laden urban environments.
32Film credit sequences featuring dramatic nighttime vehicular destruction.
32Serious or urgent discussions between a nurse and a man, predominantly in medical or clinical settings.
32Somber or eerie cemetery scenes featuring male figures.
32Dimly lit close-ups of a man's intense, contemplative, or suspicious expression, often against a dark background.
32Scenes of a masked assailant menacing a terrified woman with a knife.
31Atmospheric shower scenes depicting vulnerable women, often emphasizing intimacy and tension.
31Eerie nocturnal urban scenes featuring a solitary male figure.
31Shadowy close-ups of hands manipulating door mechanisms in tense, dark environments.
30Scenes depicting a woman's tense introspection or contemplation within a mysterious, dimly lit interior.
29Scenes depicting studio photography sessions, often featuring models and photographers.
29Eerie nocturnal cemetery and graveyard scenes.
29Scenes of women engaged in tense or distressing phone calls within dimly lit, suspenseful interior settings.
29Tense, low-light outdoor conversations between a man and a woman.
28Scenes featuring various aircraft in flight or at airport locations.
28Tense outdoor dialogues between two women in natural, serene environments.
28Intense conversations between a man and a woman at lively parties or nightclubs.
28Tense nocturnal movements of solitary women through dimly lit, shadow-filled environments.
27Bustling urban street and market scenes.
27Scenes featuring solitary women in contemplative or pensive moments, primarily on benches in serene park or garden environments.
27Solemn cemetery visitations and grave-side interactions.
27Scenes of women in bathrooms engaged in personal grooming, self-examination, or contemplative reflection.
27Solitary, contemplative smoking scenes in dimly lit, shadowy settings.
27Serious office discussions at a desk.
27Tense group discussions in affluent or intellectual interior settings.
26Opening credit sequences featuring airplanes and production details.
26Rugged and isolated coastal seascapes.
26Vibrant stage performances, primarily by women, in nightclub or cabaret environments.
26Serious conversations between women in indoor settings.
26Eerie nocturnal exteriors of secluded houses.
25Tense, dimly lit conversations between characters, frequently featuring smoking.
25Contemplative indoor scenes of men, frequently by windows or curtains, conveying a mood of serious introspection and quiet tension.
25A lone figure's tense or contemplative presence within an eerie, shadowed forest.
25Scenes characterized by overwhelming darkness and obscured forms, hinting at an unseen lurking menace.
25Scenes of a masked killer menacing a terrified victim with a knife.
24Dusk-lit seaside conversations and intimate interactions.
24Close-up shots of women displaying intense or contemplative expressions.
23Newspaper headlines and articles detailing murder investigations and accusations.
23Forensic examination of a deceased body in a clinical setting.
23Tense and mysterious scenes of men in dimly lit cars at night.
23Panicked female flight through an ominous forest.
23Private conversations between a man and a woman on a couch.
23Atmospheric scenes depicting a masked assailant's impending attack on a woman with a knife.
22Equestrian and carriage scenes set in diverse natural and estate landscapes, often blending serenity with underlying mystery.
22Historic Venetian canal scenes.
22Tense armed confrontations in dimly lit interior settings.
22Intimate and vulnerable scenes of nude or partially undressed women interacting with mirrors in private, dimly lit settings.
22Tense, elegant dialogues and confrontations in opulent, often theatrical, settings.
21Scenes depicting conversations between two women in a maritime or coastal environment.
21Scenes depicting watercraft in transit with prominent distant geographical features.
21Hospital scenes featuring men with bandaged head injuries and specialized medical equipment.
21Suspenseful portrayals of men, often shirtless, in dramatically lit, confined interior spaces.
21Eerie nighttime graveyard scenes featuring women experiencing fear or grief.
21Detailed portrayals of women engaged in desk-based intellectual or administrative work.
21Tense, dimly lit armed confrontations and standoffs between men.
21Dimly lit bar and nightclub dialogues between a man and a woman.
21Strategic contemplation scenes featuring a man at a desk with chess pieces and a map.
21Tense or intimate conversations set within vibrantly patterned and intricately decorated interior spaces.
21Intimate and tense face-to-face encounters in dim, shadowy lighting.
21Dramatic, low-lit close-ups of men with intense, contemplative, or urgent expressions.
21Suspenseful scenes of shadowy figures partially obscured by curtains in dim lighting.
21Scenes of contemplative men in suits within indoor environments featuring curtains.
21Pensive indoor scenes of suited men, often near a door.
21Perilous navigation of shadowed staircases.
21Masked assailant knife attack scenes.
20Bustling market scenes depicting people shopping, interacting, and browsing various goods.
20Hospital scenes featuring medical examinations and concerned observation of patients.
20Tense conversations between two women in a car's backseat.
20Contemplative or emotionally conflicted nuns.
20Vehicle-bound scenes of serious dialogue or contemplative tension.
20Introspective or apprehensive moments featuring a woman in a dimly lit bedroom.
20Knife attack on a woman.
20Contemplative close-ups of men in formal wear deep in thought, often featuring subtle indoor greenery.
20Contemplative close-ups of men in formal attire.
19Bustling Train Station Scenes of Travel and Anticipation.
19Opening credit sequences set over scenic landscapes and driving footage.
19Tense, shadowy close-ups of a hand gripping a gun, portending an imminent threat.
19Close-ups of women in states of intense fear and distress, marked by tears and dramatic lighting.
19Tense, shadow-laden hallway scenes featuring a woman navigating an ominous atmosphere.
19Giallo scenes featuring a woman in a dark forest with a glinting knife.
18Architectural establishing shots of imposing urban and historical building exteriors.
18Photography and film studio sessions featuring models and motorcycles.
18Theatrical stage performances featuring dancers or performers in elaborate, often feathered, costumes under vibrant lighting.
18Leisurely or contemplative boat scenes with a man and a woman.
18Serene and mysterious scenes of women interacting with boats in natural, vegetated waterscapes.
18Subdued indoor scenes of male characters in pensive thought or focused conversation.
18Tense official questioning or police-involved confrontations.
18Scenes of tense, asymmetrical discussions between three men, typically in an intellectual or professional indoor environment.
18Scenes of two men having tense, often smoke-filled, discussions in a cluttered office or study.
18Intense contemplative and investigative dialogues among men.
17Scenes of women swimming, floating, or struggling in various bodies of water.
17Outdoor dialogue scenes in the rain featuring characters walking with umbrellas.
17Suspenseful indoor scenes featuring characters in wheelchairs.
17Somber graveyard encounters between a formally dressed man and woman.
17Ominous foot and leg shots with prominent shadows.
17Scenes of women in their distinctively decorated private domestic spaces.
17Clandestine outdoor meetings between two men.
17Intimate portrayals of a woman's anxious contemplation or fearful anticipation in a tense indoor environment.
17Introspective scenes of women gazing at their reflections in mirrors.
17Scenes of ominous lurking figures or concealed threats, dramatically illuminated by faint window light.
17Tense indoor discussions between two men.
17Eerie, suspenseful scenes featuring women's silhouettes by windows in darkness.
17Scenes depicting an obscured threat poised at a doorway.
16Motorcycle journeys on winding, verdant rural or mountain roads.
16Scenes of nurses attending to patients in hospital rooms.
16Intimate bathing scenes between a man and a woman.
16Tense scenes depicting hands interacting with old-fashioned telephones in darkness.
16Eerie, candlelit church and altar scenes featuring solemn or mysterious figures.
16Scenes depicting tense and secretive discussions within elegant library settings.
16Tense conversations between a man and a woman inside a car.
16Indoor scenes of formally dressed men in serious contemplation, often featuring prominent paintings or textured walls as backdrops.
16Chiaroscuro portraits of enigmatic male figures.
16Ominous Silhouettes in Doorways
15Scenes of children playing in diverse outdoor environments.
15The scenes depict competitive motocross racing events.
15Nocturnal police investigations and patrols conducted on urban canals.
15Interactions among diverse passengers on a bus during travel.
15Vibrant outdoor poolside scenes depicting leisure, conversation, and observation.
15Serious classroom discussions between a man and a woman.
15Portraits of nurses displaying focused concern or contemplation.
15Ominous scenes of women struggling or submerged in dark waters.
15Pensive female gazes from a car window.
15Intimate mealtime conversations between a man and a woman.
15Women engaged in private telephone interactions from bed.
15Scenes depicting women in contemplative or apprehensive repose on couches.
15Intimate and often tense bedroom scenes featuring a woman and a man amidst ornate decor.
15Tense and critical conversations between a man and a woman inside a car.
15Lurking shadowy figures silhouetted against dimly lit walls.
15Private bedroom encounters between a man and a woman, frequently involving tension or serious discussion.
15The scenes depict elegant, private conversations between a man and a woman in opulent indoor settings.
15Intimate, serious discussions between two men.
15A woman covertly observing through curtains or shadows, conveying fear and suspense.
15Stylized masked killer murder scenes.
14Pharmacy and clinical environment scenes depicting characters, interactions, and pharmaceutical items.
14Tense forest scenes of pursuit and confrontation.
14Establishing shots of mysterious, often isolated, castles or grand estates at night.
14Discussions between men in urban or coastal waterside settings.
14Solemn or tense discussions between two men in a graveyard.
14Isolated figures, typically women, in vast and rugged coastal settings, often at dusk or night.
14Contemplative male figures in atmospherically lit interior settings.
14Tense police interrogation scenes.
14Intimate interior scenes of women observing ornate decorative art and objects.
14Ominous or suspenseful close-ups of solitary footwear in darkness.
14Eerie candlelit scenes emphasizing looming shadows and suspense in pervasive darkness.
14Intimate and vulnerable moments of men in repose.
14Intimate and tender physical contact between individuals.
14Scenes of men engaged in serious discussions while traveling by car.
14Giallo murder tableaux of female victims.
14Intimate and tense emotional exchanges between a man and a woman.
14Scenes of women poised in doorways, exhibiting tense contemplation or watchful suspense.
14Eerie giallo interior scenes featuring a cautious woman at a threshold.
14A man's solitary, shadowed contemplation or troubled thought in a tense atmosphere.
14Pivotal library conversations between two men.
14Scenes depicting tense, formal dialogues between two men, invariably framed with one's back to the camera.
14Scenes depicting solitary figures cautiously navigating suspenseful, shadow-filled hallways.
14Impending knife attacks on a vulnerable woman in a darkened bedroom setting.
13Outdoor credit sequences featuring a man in a natural setting.
13Stylized credit sequences set against bustling urban streets with a prominent web-like or spiderweb overlay.
13Elevated panoramic views of urban cityscapes and rooftops.
13Scenes of intricate photographic operations conducted in darkness or low light.
13Giallo film title sequences featuring a partially obscured woman against a vivid red background.
13Scenes of urgent and frantic chases or escapes.
13Serene yet foreboding waterside landscapes at dusk, framed by silhouetted trees.
13Scenes depicting a woman, often with a man, on or by a bridge over calm water, framed by urban or ancient landscapes.
13Bustling vintage urban street and square scenes with traffic and pedestrians.
13Tense two-person conversations on atmospheric sea cliffs.
13Men in suits navigating urban street environments.
13Intimate or tense bathtub encounters between a man and a woman.
13Injured men, often in suits, slumped or pinned against walls.
13Scenes depicting a man driving a car on a road with a focused demeanor, traversing diverse natural and urban environments.
13Scenes of characters navigating dimly lit spaces filled with mannequins or veiled figures, creating an eerie and suspenseful atmosphere.
13Tense police-involved investigative discussions or confrontations.
13Scenes of men drinking contemplatively in sumptuously decorated, atmospheric interiors.
13Tense, dimly lit street conversations between men, often observed by or involving a woman.
13Men conducting desk-based investigation or journalistic work in dimly lit office settings.
13Flashlight-guided investigations within dark, mysterious, or ominous environments.
13Contemplative female portraits.
13Suspenseful nocturnal approaches to isolated, dimly lit houses.
13Tense and serious hallway discussions between a man and a woman.
13Dimly lit bedroom scenes depicting resting couples, characterized by deep shadows and an atmosphere of quiet tension and vulnerability.
12Tension-building bathroom scenes featuring dripping or flowing water and ominous shadows.
12Scenes depicting the atmospheric operation of film projectors and reels in dark or dimly lit environments.
12Suspenseful nocturnal and dimly lit train sequences.
12Scenes depicting hands interacting with handwritten documents or correspondence.
12Secluded vintage car scenes in natural, often wooded, environments.
12Enigmatic felines with prominent, glowing eyes in dark, suspenseful settings.
12Intense fires illuminating dark settings and casting dramatic shadows.
12Hospital room scenes centered on investigative documentation or critical information disclosure around a patient's bedside.
12Outdoor breakfast scenes between a man and a woman, marked by serious discussion or contemplation.
12Crowded urban street scenes depicting everyday life.
12Scenes of a man's shaving routine, often highlighting his reflection in a decorative bathroom.
12Unsettling nighttime scenes of women dramatically illuminated by fires.
12Tense, foggy forest confrontations between two men, often involving a firearm.
12Scenes depicting a bloodied, injured man in a forest.
12Characters in intimate and vulnerable bath scenes.
12Establishing shots of mysterious, often ornate, buildings at night.
12Tense, secretive conversations between men in dimly lit bar settings.
12Intimate or emotionally charged embraces between a man and a woman, frequently against a door.
12Tableaux of motionless women in outdoor settings dominated by a distant castle.
12Scenes of a contemplative mustachioed man in a library setting.
12Scenes of women engaged in tense or concerned phone calls in intimate indoor environments.
12Suspenseful scenes of female fear and apprehension in dimly lit indoor settings.
12Pensive female character close-ups.
12Enigmatic portraits of veiled women.
12Tense power dynamic dialogues between two men in opulent, antique settings.
12Dramatic close-ups of a man's face displaying intense, deep emotion under shadowy lighting.
12Intense female gazes with serious or contemplative expressions against a dark, dramatic background.
12Tense, private two-man discussions often occurring by doorways or in secretive indoor settings.
12Shadow-obscured men in suspenseful doorways.
12Scenes depicting women's terrified reactions and desperate gestures within pervasive darkness.
12Tense scenes of a woman's hand reaching for a door handle amidst encompassing darkness.
12Suspenseful approaches to dark doorways, hinting at an unseen or imminent threat.
12Scenes of masked assailants stalking fleeing victims with an imminent knife attack.
11Waterfront credit sequences often featuring figures and industrial or cityscape backdrops.
11Silent, contemplative children illuminated against dark, eerie backdrops.
11Giallo scenes featuring shirtless men in tense phone calls within distinctive home interiors.
11Scenes of women gagged and restrained in distress.
11A man's desperate confinement behind bars.
11Scenes of a gathering around a critical or deceased individual in a tense, private setting.
11Courtroom drama scenes.
11Tranquil and secluded scenes featuring a man in a small boat on calm water surrounded by dense reeds and vegetation.
11Leisurely outdoor meal and conversation scenes at private estates.
11Conversations between a man and a woman in an airport setting.
11Tense interpersonal confrontations between a man and a woman in elevators or confined spaces.
11Cluttered kitchen confrontations between two men.
11Dimly lit intimate encounters in cars.
11Elegant indoor scenes depicting a man and woman interacting by or at a piano.
11Dimly lit, shadowy car interior scenes establishing a mood of suspense and impending danger.
11Tense or mysterious indoor phone call scenes featuring a man and an accompanying, reacting woman.
11Serious outdoor conversations between two formally dressed men, often by a parked car.
11Walking conversations between a man and a woman on streets.
11Contemplative indoor close-ups of a blonde woman.
11A distressed woman's suspenseful phone call in a dimly lit, tense environment.
11Scenes of women in tense contemplation or ominous anticipation within dimly lit interiors.
11Tense parlor or drawing-room scenes centered around tea service and strained conversations between a woman and men.
11Contemplative indoor smoking scenes featuring men in suits.
11Plot-critical outdoor exchanges between a man and a woman.
11Hand-centric suspense sequences in deep shadow.
11A man's tense and contemplative introspection in a formal, dimly lit indoor setting.
11Tense discussions among individuals within opulent interiors featuring grand staircases.
11Tense candlelit scenes of a woman in darkness.
11Tense, shadow-filled alley scenes depicting an isolated figure encountering an emerging threat.
11Dimly lit scenes emphasizing a figure's prominent shadow or silhouette against a wall.
11Scenes of fallen women in dimly lit or shadowy environments.
11Pensive male contemplation in shadowy, suspenseful interiors.
11Intense close-up shots of blonde women's emotive gazes.
10Scenes of intense outdoor surveillance using binoculars.
10Suspenseful nocturnal scenes depicting wheelchair-bound figures navigating dark, outdoor environments.
10Autopsy scenes or unsettling post-mortem examinations in giallo films.
10Establishing shots of foreboding and isolated gothic castles.
10Tense nocturnal searches and navigations through fog, illuminated by flashlights.
10Tense conversations between a man and a woman aboard a boat.
10Mirrored discussions between two women.
10Urgent driving sequences.
10Atmospheric scenes of men in dimly lit, cluttered kitchens conveying suspense and mystery.
10Scenes depicting women in atmospheric interiors defined by colorful lamps and wall posters.
10Dimly lit restaurant scenes featuring women smoking during conversations.
10Eerie nocturnal urban or architectural credit sequences.
10Scenes depicting a professional in a white coat engaged in a serious and concerned phone call.
10Bathtub murder scenes.
10Contemplative or tense scenes of a man in a car during rain.
10Tense social gatherings in stylishly decorated living rooms.
10Elegant outdoor social gatherings featuring two men in serious conversation, often framed by classical architecture.
10Canal-side discussions between a man and a woman.
10Intense close-up shots of women in hats conveying mystery through their gaze.
10Tense, candlelit dinner discussions between two men.
10Quiet, contemplative domestic scenes of a woman reading beside a reclining man.
10Nighttime, dimly lit conversations between a man and a woman, typically by a car, characterized by seriousness or tension.
10Clandestine and tense nocturnal encounters between a man and a woman in isolated forest settings.
10Intimate bedside conversations.
10Tense phone call scenes featuring men at dimly lit office desks.
10Tense interpersonal confrontations in dimly lit spaces.
10Contemplative and tense indoor scenes featuring a man by a door.
10Shadowy and tense staircase scenes featuring a solitary male figure.
10Moments of shadowy male apprehension or intense contemplation.
10Tense, formal discussions between two men in indoor environments.
10Close-up portrayals of a woman's tearful emotional distress.
10Suspenseful scenes of women in shadowy thresholds.

They are pretty niche but I was happy to see “Fearful or suspenseful women's faces and eyes dramatically obscured…” as the number one cluster since that is the recurring visual trope that triggered this idea in the first place.

I built a cluster browser and “cleaned” up as much explicit material as I could to make it a public interactive tool. Of course I’m sure I missed something so if you don’t want to potentially see scary/gross/naked things don't use the tool below:

Hallucinations

Of course if we are dealing with vision language models there are going to be problems. I noticed that sometimes I would rarely get a frame with a completely wrong description. I found that the VLM would generate a predictable description for some frames especially if it was an abstract or completely black image. It would just invent a realistic sounding description like “a masked figure lurks in the shadows. the woman's eyes widen in terror. blood stains the pristine white dress.” It would reuse the same duplicate wrong descriptions for many images so I could aggregate on them and find them. If you want examples you can see in this tool (loads 45MB of data) [https://thisismattmiller.github.io/giallo/apps/dupe-descriptions/]. The takeaway is that if you are using these models for “serious” work you better have a seriously good QA workflow process because it will generate bad data eventually.

Plotting the Tropes

I wanted to see if you could plot these clusters within the playtime of the movies. I was thinking maybe you could see that specific types of scenes happen a predictable times in these types of movies. For example something like, you often see the silhouetted killer creeping up the staircase at the half-way mark of the movie. I built a tool to plot the occurrences of the cluster members on a 0-100% x-axis. Technically it works, for example here is the plot for the cluster: “Cluster 3 - Opening credit sequences featuring airplanes and production details.”

You can use this tool to explore, plot and compare the other clusters:

If you explore there are interesting patterns you can extrapolate, for example: “Cluster 120 - Close-up depictions of men with bloodied faces exhibiting intense pain and distress.”

Which makes sense in the context of these movies often the male antagonist gets their comeuppance or justice for their crimes in the last act of the film.

That wraps up this fun exploration. I think if I could get my hands on more Giallo films from the 140 list I could do more, I would even likely increase the frame extraction to one every second. These VLM models come out quickly and are rapidly improving but as I’ve shown, care must be taken because it will generate bad data. Otherwise this seems like a potential approach to “distance read” a large corpus of thematically related films.