weepinbell/src/weepinbell/processor, branch master

all: use JF2 as a single source of truth, compile microformats/JSON-LD/ to JF2 (#80)

2026-10-29T11:42:50+00:00

closes #75

This is a large squash commit. For details, see https://codeberg.org/eltrac/weepinbell/pulls/80

test: test concurrent proceesor; assert config option types

2026-10-15T09:21:09+00:00

test: remove http request retries from tests

2026-10-15T08:09:41+00:00

processor: concurrently starts multiple pipeline loops

2026-10-15T08:09:40+00:00

processor, storage: clear queues before shutting down proceesor and storage worker

2026-10-14T10:31:01+00:00

processor: log before write; logging afterwards doesn't mean write is completed

2026-10-14T09:18:04+00:00

wrapper: fix not downloading photo with relative urls

2026-10-13T09:19:44+00:00

proceesor, storage: better error handling; no interrupting pipeline

2026-10-11T10:00:32+00:00

- print clear stack trace using timbre when capturing exceptions
- don't pass nil to url/normalize; if url/normalize gets a nil, instead
of NPE, it now returns an empty string
- capture exceptions in processor pipeline to keep it from dying
- http.downloader now checks response status instead of blindly
downloading anything

verifier, http.client: retry timeout HTTP requests

2026-10-09T03:17:48+00:00

- add weepinbell.http.client/with-retry macro
  - retry only requests that returns :error with type TimeoutException
  - retry is done asynchronously
  - with-retry should return a Future
- retry verifier requesting source and target, 3 times with 5 seconds
backoff

test, verifier, utils: fix failed tests

2026-10-07T09:18:06+00:00

- some namespaces tests require did not get renamed
- url/extract might throw AssertionError if input contains non-HTTP(S)
urls. it should not check schemes.
- verifier doesn't need to filter non-HTTP(S) urls since they will
return false anyway, and plus it makes localhost urls in tests fail