Skip to content

Adding signed ingestion#58

Open
bgmello wants to merge 4 commits intomainfrom
feat/signed-ingestion
Open

Adding signed ingestion#58
bgmello wants to merge 4 commits intomainfrom
feat/signed-ingestion

Conversation

@bgmello
Copy link

@bgmello bgmello commented Feb 11, 2026

This PR adds support for a new signed URL file upload workflow as an alternative to the existing direct ingest endpoint.

This is an optional flag that speeds up uploads and makes them more reliable, specifically for Aleph Pro. But OpenAleph may choose to implement this as well.

Instead of a single multipart POST to /collections/{id}/ingest, the new flow works in three steps:

  • request a signed upload URL;
  • PUT the file content to that URL;
  • than create the document record via /collections/{id}/document.

This is opt-in via a --signed-url flag on the CLI crawldir command, and a signed_url=True parameter on the AlephAPI.ingest_upload() Python method.

The old ingest path remains the default so nothing breaks for existing users.

New unit and integration tests were added and all pass.

@bgmello bgmello closed this Feb 11, 2026
@bgmello bgmello reopened this Feb 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments