Skip to content

V4 main#496

Open
jmikedupont2 wants to merge 582 commits intoWikiTeam:masterfrom
meta-introspector:v4-main
Open

V4 main#496
jmikedupont2 wants to merge 582 commits intoWikiTeam:masterfrom
meta-introspector:v4-main

Conversation

@jmikedupont2
Copy link

Hi teem,
I am working on nix packaging of wikiteam and its data in shards.
see https://github.com/meta-introspector/shards for more
see you in irc cicadia71,
user: mdupont

yzqzss and others added 30 commits August 3, 2023 22:47
pre-bump 4.0.0
WIP: deprecate launcher
WIP: refactor uploader
WIP: rename function names from camelCase to snake_case
WIP: default args
WIP: feat: `--noverify-image-size`
WIP: enable `--xmlrevisions --curonly` support
TODO: feat: save `Special:Log` wiki page
break change: image: change the magic NULL string from `False` to `null`
chore: remove deprecated alias for xml.etree.ElementTree
TODO: feat: cli: add an option to disable random UserAgent
TODO: feat: Incremental image dump powered by archive.org (experimental)
WIP: feat: add option to dump recent images only (with a custom cut-off date)
Reasons:
* if the limit is float and between 0 to 1, the MW backend will force-int it to 0
* To loop over all the revisions, we need to retrieve at least 2 at a time
* If the historical revisions cannot be retrieved even with limit=2, it should fail at this time so that the user can try to use --curonly .
<element name="parentid" type="positiveInteger" minOccurs="0" maxOccurs="1"/>
The last titlelist may not be yielded
deprecate: `.desc` xmlfile support
feat: cli: `--disable-image-verify`
pre-bump: version 4.0.0
feat: cli: add  `--user-agent` to custom UA
feat: `--ia-wbm-booster`
feat: write .mark file after dumped
refactor: SessionMonkeyPatch
feat: image: dynamic load config.delay
yzqzss and others added 30 commits May 11, 2025 05:32
* fix: Incomplete redirect dump

* del arcontinue

---------

Co-authored-by: yzqzss <[email protected]>
* Add --http-method

* refactor

---------

Co-authored-by: yzqzss <[email protected]>
- Enable reproducible builds via Nix
- Declare all Python dependencies
- Support binary cache distribution
- Content-addressed archive storage

Enables Archive Team workflows in Nix with verifiable,
reproducible archives.
All checks pass locally with 'nix flake check'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants