1 - AI Support in RawCull
RawCull AI is planned for release when macOS 27 becomes publicly available. It adds local AI-assisted search and review while retaining the same culling workflow and non-AI functions as the current RawCull version.
The AI features run locally on Apple Silicon. RawCull does not upload photos to an external inference service.
AI-Assisted Culling
RawCull uses two types of vision model:
- CLIP converts images and text into comparable vectors. RawCull uses those vectors for semantic search, visual similarity, and burst grouping.
- SAM 3 locates the subject in an image. Deep Review uses the resulting subject mask together with sharpness and camera autofocus evidence to help compare frames.
AI results are review aids, not automatic decisions. Semantic-search scores describe relative similarity rather than confidence, and the photographer always makes the final selection.
Similarity and CLIP
CLIP does not create captions, keywords, or fixed labels while indexing. It converts each image into a normalized numeric embedding that summarizes its overall visual content. RawCull stores that embedding locally and can reuse it for both similarity analysis and semantic search.
Build the Similarity Index
Choose a CLIP model in Settings > AI, enable it for similarity, and select Index Similarity or Re-index in the burst workspace. Indexing runs the image encoder once for each photograph that does not already have a compatible cached embedding.
CLIP embeddings are specific to the selected model and its preprocessing configuration. Changing the CLIP model or installing an incompatible model version requires a new index. If CLIP is unavailable, RawCull can use the macOS Vision feature-print fallback for visual grouping, but text-based semantic search requires compatible CLIP embeddings.
Group Similar Frames
Select Analyze Bursts after indexing. RawCull compares the cached image embeddings and groups visually related frames for review. The Similarity control adjusts how tightly frames are grouped: a lower value creates tighter groups, while a higher value admits more visually related frames.
The burst list shows each group and highlights its suggested pick. From here you can open the burst, run Deep Review, mark it reviewed, or defer it until later.
Review a Burst
Open a burst to inspect its frames in the filmstrip and compare them at a larger size. The review workspace combines the candidate rank with sharpness, focus-point, saliency, metadata, and subject evidence. You can navigate between frames, assign ratings, pick or reject a photograph, and return to the burst list when the review is complete.
The suggested pick and component scores are starting points, not final judgments. Check expression, pose, timing, framing, and critical focus before deciding which frame to keep.
Semantic Search
After a catalog has been indexed with a compatible CLIP model, enter a short description such as puffin, raven, or squirrel. RawCull ranks the catalog using the cached image embeddings, so later searches do not have to reprocess every image.
Search terms work best in English because the supported CLIP models were primarily trained and evaluated with English text.
Supported Models
RawCull supports one selected CLIP model for similarity and semantic search, plus SAM 3 for subject-aware Deep Review.
The upstream files on Hugging Face are the source models. RawCull requires model bundles converted and validated for Apple Core AI on macOS 27.
Model Downloads
The AI models are not included in the RawCull application or its release download. Compatible model bundles will be available separately. Each RawCull AI release note will identify the supported model versions, download locations, installation steps, and expected checksums.
Follow the RawCull release notes rather than installing an arbitrary conversion. RawCull validates an installed bundle before enabling it and falls back safely when a required model is missing or invalid.
Keeping the models separate makes the application download smaller. It does
not remove the upstream model’s licence conditions. Every model archive
distributed by RawCull must contain the complete applicable licence, model
provenance, conversion information, and checksums.
Before using Download or Accept and Download in RawCull, read
AI Model Licences and Downloads.
Model Licences
The RawCull application licence does not replace or extend the licences for the separately downloaded models.
- OpenAI’s CLIP source repository is published under the MIT License.
- The DataComp model page identifies its licence as MIT. Its model card also documents the training data, intended uses, and limitations.
- SAM 3 is distributed under Meta’s separate SAM License, not the MIT License. Access to the official Hugging Face files may require signing in, sharing the requested contact information, and accepting Meta’s terms.
Review the complete licence and model card shown by RawCull before downloading
or using a model. RawCull records the exact model revision and licence version
applicable to each converted bundle. If a model update changes its licence,
RawCull must present the new terms before downloading that update.
macOS Support
RawCull AI requires macOS 27 and Apple Silicon and will be released when the public version of macOS 27 is available.
At that point, active RawCull development and support move to macOS 27. The existing macOS 26 version will no longer receive support or new features, but installed copies will continue to work with their current functionality.
The macOS 27 AI version retains the current RawCull feature set and workflows. AI support is additive: catalogs, ratings, culling, comparison, sharpness tools, previews, and copying continue to work as they do in the current version.
2 - CLIP Models and Beta Testing
How RawCull uses and evaluates its two CLIP models, why beta testers should try both, and how to compare their results.
RawCull supports two optional CLIP models for semantic search, visual
similarity, and burst grouping. This page explains what CLIP does, how the
models were evaluated, and how to compare them during the RawCull beta.
Both models run locally on Apple Silicon. RawCull does not upload photographs,
search text, or model results to an external inference service.
What CLIP Does
CLIP connects text and images by converting both into numeric embeddings. An
embedding represents visual and semantic characteristics in a form that can be
compared efficiently.
RawCull uses CLIP in two ways:
- Semantic search: a description such as
a dog on a beach, city street at night, or sharp portrait is compared with the indexed photographs. - Visual similarity and burst grouping: image embeddings are compared with
each other to find related frames.
CLIP does not generate captions, modify photographs, rate artistic quality, or
make final culling decisions. Its search scores are relative similarity values,
not confidence percentages. The photographer remains responsible for every
selection and rejection.
The Two Models
| Model | Image input | Background | Practical role |
|---|
| OpenAI CLIP ViT-B/32 | 224 × 224 | The established OpenAI CLIP model | A conservative and well-understood reference model |
| OpenCLIP DataComp ViT-B/32-256 | 256 × 256 | OpenCLIP model trained with DataComp weights | An alternative with different retrieval behavior that may suit some catalogs and searches better |
The models use different weights, image sizes, tokenization details, and
converted Core AI graphs. They therefore do not rank every photograph in the
same way. A higher raw score from one model cannot be compared directly with a
score from the other.
How the Models Were Evaluated
RawCull uses two independent forms of evaluation.
Conversion parity
The first test compares embeddings produced by each converted Apple Core AI
bundle with embeddings from its original source framework. This detects errors
in model conversion, tokenization, preprocessing, output selection, and
normalization.
Text and image parity are tested separately. A cosine value of 1.0 means that
the normalized source and Core AI embeddings are identical. Very small
differences are expected from Float16 conversion and differences in image
decoding or resizing.
Product behavior
The second test builds complete, model-specific indexes for the same photo
catalog and runs the same 77 text queries. It checks result diversity, repeated
“hub” images, query time, paraphrase behavior, and image-similarity
neighborhoods.
Conversion parity answers whether Core AI reproduces the source model. Product
testing answers whether the model is useful for photographers. One test cannot
replace the other.
Current Results
The current Core AI bundles produced these results on the fixed conversion
fixtures and the 77-query RawCull test:
| Result | OpenAI CLIP | DataComp CLIP |
|---|
| Minimum text parity | approximately 1.0000 | approximately 1.0000 |
| Minimum end-to-end image parity | 0.9988 | 0.9908 |
| Distinct first-ranked images across 77 queries | 53 | 58 |
| Largest repeated first-result hub | 4 of 77 | 4 of 77 |
| Warm mean query time | 67.25 ms | 65.67 ms |
The two models selected the same first-ranked photograph for only 19 of the 77
queries, or approximately 25 percent. This is the most important beta-testing
finding: the models offer meaningfully different search behavior.
OpenAI currently passes RawCull’s chosen 0.998 end-to-end conversion-parity
gate. DataComp’s text path is extremely close to its source implementation,
but its image path has a larger difference that remains under investigation.
That difference does not by itself mean that DataComp produces worse semantic
search. DataComp can still retrieve better results for a particular query or
catalog, and the initial product test produced slightly more diverse first
results.
The test set is not yet a large human-labeled accuracy benchmark. Beta feedback
is therefore valuable, especially when it describes which model returned a
more useful photograph and why.
Why Beta Testers Should Download Both
Downloading both models lets you compare two genuinely different views of the
same catalog. OpenAI may work better for one subject or photographic style,
while DataComp may work better for another. Testing both also helps RawCull
identify weak query categories and choose sensible model-specific defaults.
Each model is optional. Downloading both uses more storage and creating an
index for each takes additional time. A user who does not want to participate
in comparison testing can install only one model. For this beta, however,
installing both is the most useful configuration.
The models are downloaded through macOS Managed Background Assets. macOS stores
and manages the asset packs, and RawCull validates a model before enabling it.
Download Both Models
- Open RawCull > Settings > AI.
- Select Download AI Models.
- Review the licence and model information for each CLIP model.
- Download OpenAI CLIP and DataComp CLIP.
- Wait until both downloads report Installed.
- Close the download window and select Check Again if either model has not
yet appeared as available.
Downloaded models run locally. Removing a managed model from the same window
removes its RawCull asset pack but does not delete manually installed models.
Compare the Models
Use the same photographs and search phrases for both tests.
Test OpenAI CLIP
- In Settings > AI, choose OpenAI under Selected CLIP model.
- Enable Use selected CLIP model for similarity.
- Open the catalog you want to test.
- Select Index Similarity or Re-index and wait for indexing to finish.
- Try a set of short English descriptions and record which results are useful.
- If you use burst analysis, inspect the groups without changing the source
catalog before testing the second model.
Test DataComp CLIP
- Return to Settings > AI and choose DataComp.
- Keep Use selected CLIP model for similarity enabled.
- Re-index the same catalog. Embeddings from OpenAI and DataComp are not
interchangeable, so the DataComp test requires its own index.
- Repeat exactly the same searches and burst-analysis workflow.
- Compare the photographs, rankings, and groups rather than comparing the raw
numeric scores between models.
Useful test phrases include:
- objects and scenes:
a dog, mountains surrounding a lake; - colors and attributes:
yellow flower, red car; - actions and relationships:
person riding a bicycle, bird in flight; - photographic properties:
sharp portrait, motion blur, backlit subject; - paraphrases: try several different descriptions of the same idea.
Search primarily in English during this beta because the supported models were
trained and evaluated mainly with English text.
What to Report
Useful feedback includes:
- RawCull beta version, macOS build, and Mac model;
- selected CLIP model;
- approximate number and type of photographs in the catalog;
- the exact search phrase;
- which model returned the more useful first five results;
- examples of clearly relevant or irrelevant results;
- unexpected repeated results across unrelated searches;
- indexing failures, model validation errors, or unusually slow operation; and
- whether burst groups became more or less useful after switching models.
Screenshots are helpful, but do not share private photographs unless you are
comfortable doing so. A text description of the expected and actual result is
enough.
Choosing a Model After Testing
There is no universal winner yet. Choose the model that gives the most useful
results for your photographs and vocabulary. OpenAI is the established
reference, while DataComp is a promising alternative with noticeably different
retrieval behavior.
You can switch later, but changing models requires a compatible index for the
new selection. RawCull keeps model identities separate so that embeddings from
one model are never silently reused with the other.
For the broader feature overview, see AI Support in RawCull.