This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

AI in RawCull

Local AI-assisted search, similarity analysis, subject review, and optional model downloads in RawCull.

RawCull adds optional, locally running AI features to its existing photo-culling workflow. Photographs, prompts, embeddings, masks, and inference results remain on the Mac.

Read:

  • AI Support in RawCull for supported features, models, and system requirements. downloading any converted model through RawCull.

1 - AI Support in RawCull

RawCull AI is planned for release when macOS 27 becomes publicly available. It adds local AI-assisted search and review while retaining the same culling workflow and non-AI functions as the current RawCull version.

The AI features run locally on Apple Silicon. RawCull does not upload photos to an external inference service.

AI-Assisted Culling

RawCull uses two types of vision model:

  • CLIP converts images and text into comparable vectors. RawCull uses those vectors for semantic search, visual similarity, and burst grouping.
  • SAM 3 locates the subject in an image. Deep Review uses the resulting subject mask together with sharpness and camera autofocus evidence to help compare frames.

AI results are review aids, not automatic decisions. Semantic-search scores describe relative similarity rather than confidence, and the photographer always makes the final selection.

Similarity and CLIP

CLIP does not create captions, keywords, or fixed labels while indexing. It converts each image into a normalized numeric embedding that summarizes its overall visual content. RawCull stores that embedding locally and can reuse it for both similarity analysis and semantic search.

Build the Similarity Index

Choose a CLIP model in Settings > AI, enable it for similarity, and select Index Similarity or Re-index in the burst workspace. Indexing runs the image encoder once for each photograph that does not already have a compatible cached embedding.

CLIP embeddings are specific to the selected model and its preprocessing configuration. Changing the CLIP model or installing an incompatible model version requires a new index. If CLIP is unavailable, RawCull can use the macOS Vision feature-print fallback for visual grouping, but text-based semantic search requires compatible CLIP embeddings.

Group Similar Frames

Select Analyze Bursts after indexing. RawCull compares the cached image embeddings and groups visually related frames for review. The Similarity control adjusts how tightly frames are grouped: a lower value creates tighter groups, while a higher value admits more visually related frames.

The burst list shows each group and highlights its suggested pick. From here you can open the burst, run Deep Review, mark it reviewed, or defer it until later.

Review a Burst

Open a burst to inspect its frames in the filmstrip and compare them at a larger size. The review workspace combines the candidate rank with sharpness, focus-point, saliency, metadata, and subject evidence. You can navigate between frames, assign ratings, pick or reject a photograph, and return to the burst list when the review is complete.

The suggested pick and component scores are starting points, not final judgments. Check expression, pose, timing, framing, and critical focus before deciding which frame to keep.

After a catalog has been indexed with a compatible CLIP model, enter a short description such as puffin, raven, or squirrel. RawCull ranks the catalog using the cached image embeddings, so later searches do not have to reprocess every image.

Search terms work best in English because the supported CLIP models were primarily trained and evaluated with English text.

Supported Models

RawCull supports one selected CLIP model for similarity and semantic search, plus SAM 3 for subject-aware Deep Review.

RawCull modelPurposeUpstream model
OpenAI CLIP ViT-B/32Semantic search, similarity, and burst groupingOpenAI CLIP ViT-B/32 on Hugging Face
OpenCLIP ViT-B/32 DataCompSemantic search, similarity, and burst groupingDataComp s34B-b86K on Hugging Face
Meta SAM 3Subject masks and Deep ReviewMeta SAM 3 on Hugging Face

The upstream files on Hugging Face are the source models. RawCull requires model bundles converted and validated for Apple Core AI on macOS 27.

Model Downloads

The AI models are not included in the RawCull application or its release download. Compatible model bundles will be available separately. Each RawCull AI release note will identify the supported model versions, download locations, installation steps, and expected checksums.

Follow the RawCull release notes rather than installing an arbitrary conversion. RawCull validates an installed bundle before enabling it and falls back safely when a required model is missing or invalid.

Keeping the models separate makes the application download smaller. It does not remove the upstream model’s licence conditions. Every model archive distributed by RawCull must contain the complete applicable licence, model provenance, conversion information, and checksums.

Before using Download or Accept and Download in RawCull, read AI Model Licences and Downloads.

Model Licences

The RawCull application licence does not replace or extend the licences for the separately downloaded models.

  • OpenAI’s CLIP source repository is published under the MIT License.
  • The DataComp model page identifies its licence as MIT. Its model card also documents the training data, intended uses, and limitations.
  • SAM 3 is distributed under Meta’s separate SAM License, not the MIT License. Access to the official Hugging Face files may require signing in, sharing the requested contact information, and accepting Meta’s terms.

Review the complete licence and model card shown by RawCull before downloading or using a model. RawCull records the exact model revision and licence version applicable to each converted bundle. If a model update changes its licence, RawCull must present the new terms before downloading that update.

macOS Support

RawCull AI requires macOS 27 and Apple Silicon and will be released when the public version of macOS 27 is available.

At that point, active RawCull development and support move to macOS 27. The existing macOS 26 version will no longer receive support or new features, but installed copies will continue to work with their current functionality.

The macOS 27 AI version retains the current RawCull feature set and workflows. AI support is additive: catalogs, ratings, culling, comparison, sharpness tools, previews, and copying continue to work as they do in the current version.

2 - CLIP Models and Beta Testing

How RawCull uses and evaluates its two CLIP models, why beta testers should try both, and how to compare their results.

RawCull supports two optional CLIP models for semantic search, visual similarity, and burst grouping. This page explains what CLIP does, how the models were evaluated, and how to compare them during the RawCull beta.

Both models run locally on Apple Silicon. RawCull does not upload photographs, search text, or model results to an external inference service.

What CLIP Does

CLIP connects text and images by converting both into numeric embeddings. An embedding represents visual and semantic characteristics in a form that can be compared efficiently.

RawCull uses CLIP in two ways:

  • Semantic search: a description such as a dog on a beach, city street at night, or sharp portrait is compared with the indexed photographs.
  • Visual similarity and burst grouping: image embeddings are compared with each other to find related frames.

CLIP does not generate captions, modify photographs, rate artistic quality, or make final culling decisions. Its search scores are relative similarity values, not confidence percentages. The photographer remains responsible for every selection and rejection.

The Two Models

ModelImage inputBackgroundPractical role
OpenAI CLIP ViT-B/32224 × 224The established OpenAI CLIP modelA conservative and well-understood reference model
OpenCLIP DataComp ViT-B/32-256256 × 256OpenCLIP model trained with DataComp weightsAn alternative with different retrieval behavior that may suit some catalogs and searches better

The models use different weights, image sizes, tokenization details, and converted Core AI graphs. They therefore do not rank every photograph in the same way. A higher raw score from one model cannot be compared directly with a score from the other.

How the Models Were Evaluated

RawCull uses two independent forms of evaluation.

Conversion parity

The first test compares embeddings produced by each converted Apple Core AI bundle with embeddings from its original source framework. This detects errors in model conversion, tokenization, preprocessing, output selection, and normalization.

Text and image parity are tested separately. A cosine value of 1.0 means that the normalized source and Core AI embeddings are identical. Very small differences are expected from Float16 conversion and differences in image decoding or resizing.

Product behavior

The second test builds complete, model-specific indexes for the same photo catalog and runs the same 77 text queries. It checks result diversity, repeated “hub” images, query time, paraphrase behavior, and image-similarity neighborhoods.

Conversion parity answers whether Core AI reproduces the source model. Product testing answers whether the model is useful for photographers. One test cannot replace the other.

Current Results

The current Core AI bundles produced these results on the fixed conversion fixtures and the 77-query RawCull test:

ResultOpenAI CLIPDataComp CLIP
Minimum text parityapproximately 1.0000approximately 1.0000
Minimum end-to-end image parity0.99880.9908
Distinct first-ranked images across 77 queries5358
Largest repeated first-result hub4 of 774 of 77
Warm mean query time67.25 ms65.67 ms

The two models selected the same first-ranked photograph for only 19 of the 77 queries, or approximately 25 percent. This is the most important beta-testing finding: the models offer meaningfully different search behavior.

OpenAI currently passes RawCull’s chosen 0.998 end-to-end conversion-parity gate. DataComp’s text path is extremely close to its source implementation, but its image path has a larger difference that remains under investigation. That difference does not by itself mean that DataComp produces worse semantic search. DataComp can still retrieve better results for a particular query or catalog, and the initial product test produced slightly more diverse first results.

The test set is not yet a large human-labeled accuracy benchmark. Beta feedback is therefore valuable, especially when it describes which model returned a more useful photograph and why.

Why Beta Testers Should Download Both

Downloading both models lets you compare two genuinely different views of the same catalog. OpenAI may work better for one subject or photographic style, while DataComp may work better for another. Testing both also helps RawCull identify weak query categories and choose sensible model-specific defaults.

Each model is optional. Downloading both uses more storage and creating an index for each takes additional time. A user who does not want to participate in comparison testing can install only one model. For this beta, however, installing both is the most useful configuration.

The models are downloaded through macOS Managed Background Assets. macOS stores and manages the asset packs, and RawCull validates a model before enabling it.

Download Both Models

  1. Open RawCull > Settings > AI.
  2. Select Download AI Models.
  3. Review the licence and model information for each CLIP model.
  4. Download OpenAI CLIP and DataComp CLIP.
  5. Wait until both downloads report Installed.
  6. Close the download window and select Check Again if either model has not yet appeared as available.

Downloaded models run locally. Removing a managed model from the same window removes its RawCull asset pack but does not delete manually installed models.

Compare the Models

Use the same photographs and search phrases for both tests.

Test OpenAI CLIP

  1. In Settings > AI, choose OpenAI under Selected CLIP model.
  2. Enable Use selected CLIP model for similarity.
  3. Open the catalog you want to test.
  4. Select Index Similarity or Re-index and wait for indexing to finish.
  5. Try a set of short English descriptions and record which results are useful.
  6. If you use burst analysis, inspect the groups without changing the source catalog before testing the second model.

Test DataComp CLIP

  1. Return to Settings > AI and choose DataComp.
  2. Keep Use selected CLIP model for similarity enabled.
  3. Re-index the same catalog. Embeddings from OpenAI and DataComp are not interchangeable, so the DataComp test requires its own index.
  4. Repeat exactly the same searches and burst-analysis workflow.
  5. Compare the photographs, rankings, and groups rather than comparing the raw numeric scores between models.

Useful test phrases include:

  • objects and scenes: a dog, mountains surrounding a lake;
  • colors and attributes: yellow flower, red car;
  • actions and relationships: person riding a bicycle, bird in flight;
  • photographic properties: sharp portrait, motion blur, backlit subject;
  • paraphrases: try several different descriptions of the same idea.

Search primarily in English during this beta because the supported models were trained and evaluated mainly with English text.

What to Report

Useful feedback includes:

  • RawCull beta version, macOS build, and Mac model;
  • selected CLIP model;
  • approximate number and type of photographs in the catalog;
  • the exact search phrase;
  • which model returned the more useful first five results;
  • examples of clearly relevant or irrelevant results;
  • unexpected repeated results across unrelated searches;
  • indexing failures, model validation errors, or unusually slow operation; and
  • whether burst groups became more or less useful after switching models.

Screenshots are helpful, but do not share private photographs unless you are comfortable doing so. A text description of the expected and actual result is enough.

Choosing a Model After Testing

There is no universal winner yet. Choose the model that gives the most useful results for your photographs and vocabulary. OpenAI is the established reference, while DataComp is a promising alternative with noticeably different retrieval behavior.

You can switch later, but changing models requires a compatible index for the new selection. RawCull keeps model identities separate so that embeddings from one model are never silently reused with the other.

For the broader feature overview, see AI Support in RawCull.