Commit Graph

  • 0bb5e1eaed
    Merge pull request #69 from saveweb/redundant-retry Rob Kam 2023-01-13 14:27:49 +0000
  • 95dd2e8a8f
    Merge pull request #66 from saveweb/requests-session Rob Kam 2023-01-13 14:18:38 +0000
  • fa246d2df1 fix: index url computation fails on some wikis yzqzss 2023-01-11 04:16:04 +0800
  • 375e6ae2d0 remove redundant retry logic yzqzss 2023-01-11 07:04:55 +0800
  • 22c8955fc8 print error msg yzqzss 2023-01-10 20:07:15 +0800
  • 6327064778 Add to_stdout parameter to logerror() for printing errors to stdout yzqzss 2023-01-09 03:05:16 +0800
  • 0bc8161a73 Remove duplicate code block for downloading images yzqzss 2023-01-09 03:07:25 +0800
  • 331c497502 make requests.session to use `--retries` value yzqzss 2023-01-11 06:59:24 +0800
  • aed4cdd78e update UA yzqzss 2023-01-10 20:12:47 +0800
  • d8f595e0b7 Pass requests session to mwclient yzqzss 2023-01-09 00:04:25 +0800
  • cdfa5ef4e8
    Merge pull request #63 from elsiehupp/robkam-patch-1 Janet Cobb 2023-01-12 17:44:50 -0500
  • b8ee71cd96
    Update generator.py Rob Kam 2023-01-12 22:27:05 +0000
  • 0225583085
    Merge pull request #62 from randomnetcat/generator-path Rob Kam 2023-01-12 20:40:08 +0000
  • 1332a2edf4 Export path to PYTHONPATH when starting python subprocesses Janet Cobb 2023-01-12 15:16:05 -0500
  • f8e5ae99d4
    Merge pull request #36 from elsiehupp/robkam-tweak-readme Elsie Hupp 2023-01-12 13:22:18 -0500
  • 7275fd707d
    Merge branch 'python3' into robkam-tweak-readme Elsie Hupp 2023-01-12 13:21:36 -0500
  • 939f695f08
    Merge pull request #52 from elsiehupp/robkam-patch-3 Elsie Hupp 2023-01-12 13:15:29 -0500
  • 4f3e2bff2f
    Merge branch 'python3' into robkam-patch-3 Elsie Hupp 2023-01-12 13:15:08 -0500
  • 98518297cc
    Merge pull request #57 from saveweb/rename-log-argument Rob Kam 2023-01-08 20:40:40 +0000
  • d1c2fe1aa1 rename log argument with `stdout` prefix to avoid confusion (#56) yzqzss 2023-01-08 23:07:27 +0800
  • 948bdd4f26 Remove empty comment element if no comment provided yzqzss 2023-01-08 03:10:08 +0800
  • 01a9e55b7b Replace invalid space attribute with xml:space attribute in text element yzqzss 2023-01-08 02:04:56 +0800
  • 0a9a81d609
    Merge branch 'python3' into robkam-tweak-readme Rob Kam 2023-01-06 13:10:53 +0000
  • c5e3f097fc
    Merge branch 'python3' into robkam-patch-3 Rob Kam 2023-01-06 13:10:18 +0000
  • 16add9790e
    Merge pull request #56 from randomnetcat/log-file Rob Kam 2023-01-05 22:57:03 +0000
  • dfa2f6b253 Add very basic option to copy stdout to file Janet Cobb 2023-01-05 17:39:28 -0500
  • d47a51b9b9
    Merge pull request #47 from elsiehupp/robkam-patch-1 Rob Kam 2023-01-05 19:52:13 +0000
  • ea4070fe15
    Merge pull request #54 from saveweb/test Rob Kam 2023-01-05 16:27:17 +0000
  • 331f8e122b
    update regex to match `'` and `"` in <option> tag yzqzss 2023-01-06 00:24:52 +0800
  • b03b61fedb build yzqzss 2023-01-05 23:28:15 +0800
  • 980810b5db update dependencies yzqzss 2023-01-05 23:27:49 +0800
  • a32d61c4d4 update regex to match `'` and `"` in `<option>` tag yzqzss 2023-01-05 23:11:18 +0800
  • e4b9f1bc32
    Merge branch 'python3' into robkam-patch-1 Rob Kam 2023-01-05 15:24:31 +0000
  • 3498189aba
    Merge branch 'python3' into robkam-tweak-readme Rob Kam 2023-01-05 15:21:13 +0000
  • 387eff122b
    Merge branch 'python3' into robkam-patch-3 Rob Kam 2023-01-05 15:18:51 +0000
  • cc91fb29cc
    Merge pull request #49 from saveweb/test Rob Kam 2023-01-05 14:22:58 +0000
  • 038def2123
    Merge branch 'python3' into test yzqzss 2023-01-05 21:10:32 +0800
  • 3e84d9c764
    Update .gitignore Rob Kam 2023-01-05 11:23:21 +0000
  • 4079a5195f
    Merge pull request #50 from randomnetcat/uploader Rob Kam 2023-01-05 10:51:44 +0000
  • d17c680215 refactor: xml_dump.py yzqzss 2023-01-05 18:05:52 +0800
  • d254d90768 move `#Execute meta info params` code block yzqzss 2023-01-05 17:05:40 +0800
  • 0424941c9d reuse requests.session for getWikiEngine() and mwGetAPIAndIndex() yzqzss 2023-01-05 16:51:55 +0800
  • db075d963f Add -wd to README Janet Cobb 2023-01-05 00:50:47 -0500
  • 40215080b0 Add information to README Janet Cobb 2023-01-05 00:47:58 -0500
  • 7021e120e8 Update argument short forms Janet Cobb 2023-01-05 00:27:16 -0500
  • f12bb27899
    Update .gitignore Rob Kam 2023-01-04 22:58:29 +0000
  • 6678156ff7 print "X title, y edits" instead of "X more revisions exported" yzqzss 2023-01-05 05:32:06 +0800
  • 0a154c05c5 rm more useless str() and add some type hints yzqzss 2023-01-05 03:53:09 +0800
  • 542f2216dd Add command line argument for log file Janet Cobb 2023-01-04 13:51:44 -0500
  • a39fc4edb1 Migrate uploader to using pathlib Janet Cobb 2023-01-04 13:25:28 -0500
  • 019a9876d6 Compute file hashes in python Janet Cobb 2022-12-31 01:04:59 -0500
  • 3ab2c33bcc Add command line argument for keyfile location Janet Cobb 2022-12-29 23:45:25 -0500
  • 4bbb414153 Remove useless configtemp Janet Cobb 2022-12-29 23:34:32 -0500
  • 4197ffa2ed Fix use of has_key Janet Cobb 2022-12-24 00:14:28 -0500
  • 8733defc97 Add imports for dumpgenerator functions Janet Cobb 2022-12-23 23:49:45 -0500
  • 887b309640 Fix dumpgenerator import Janet Cobb 2022-12-23 23:40:14 -0500
  • 126d28e3da Add uploader in pyproject Janet Cobb 2022-12-23 23:37:20 -0500
  • 97639e1a86 Use `session.get` instead of `requests.get` in `getXMLHeader` yzqzss 2023-01-05 02:54:07 +0800
  • 1bbba096eb
    revert miraheze.org.info yzqzss 2023-01-04 07:59:51 +0800
  • b736ec5ad7
    typo yzqzss 2023-01-04 07:52:27 +0800
  • fa5e3cc577 truncate the XML to a <page> with a <title> yzqzss 2023-01-04 07:40:05 +0800
  • 6a99870f5d rm useless str() yzqzss 2023-01-04 03:27:48 +0800
  • ce7f404ecf typo. yzqzss 2023-01-04 00:38:51 +0800
  • bb9388d350 rm useless str() yzqzss 2023-01-04 00:35:30 +0800
  • a4526f840c add __main__.py yzqzss 2023-01-03 17:58:25 +0800
  • 5643b653c5 style: launcher.py yzqzss 2023-01-03 05:28:49 +0800
  • 40ce314aeb rm xml.py yzqzss 2023-01-03 05:23:36 +0800
  • f32a5f0808 Update mediawiki wikifarm lists yzqzss 2023-01-03 01:12:53 +0800
  • c0c8f5d0fa Display appended-date IA URL if appended yzqzss 2023-01-03 00:44:53 +0800
  • 0bb5c52400 import "domain2prefix" and "getUserAgent" yzqzss 2023-01-03 00:37:49 +0800
  • 9b4f21d23d Add dump date to item identifier yzqzss 2023-01-03 00:24:11 +0800
  • da0df2265f
    Merge pull request #48 from saveweb/fix-imageNames-grab Rob Kam 2022-12-30 23:18:49 +0000
  • f65e10e032 fix incomplete imageNames grab (API:Allpage) yzqzss 2022-12-31 05:12:37 +0800
  • 5876842b6e .gitignore: ignore tests/tmp yzqzss 2022-12-31 04:44:03 +0800
  • b29e31045c
    Update greeter.py Rob Kam 2022-12-30 17:48:10 +0000
  • 0382aa20e6
    Update README.md Rob Kam 2022-12-30 17:01:48 +0000
  • 1a0047e436
    Merge pull request #46 from saveweb/fix-xml-bug Rob Kam 2022-12-29 23:55:20 +0000
  • e57d18d8db Merge branch 'test' into fix-xml-bug yzqzss 2022-12-29 12:30:17 +0800
  • f3d22cc767 build yzqzss 2022-12-29 11:46:09 +0800
  • 6e71e31872
    avoid return byte-str yzqzss 2022-12-29 11:33:49 +0800
  • 4d0078384c
    Fix xml de/encode and other improve (#2) yzqzss 2022-12-29 10:37:50 +0800
  • 0be37c16b7 build yzqzss 2022-12-29 10:31:12 +0800
  • 71fc2b6bc7 [Docs] Update checking dump integrity command yzqzss 2022-12-29 09:21:38 +0800
  • 06da261f04 completely fix xml en/decode bug yzqzss 2022-12-29 07:43:11 +0800
  • f085af5c5e reduce dumped XML filesize for --curonly yzqzss 2022-12-29 07:42:09 +0800
  • 4307fb82e6 fix bin-style XML yzqzss 2022-12-29 03:45:11 +0800
  • 21e23a7820 Update Dependencies yzqzss 2022-12-29 02:14:23 +0800
  • 0fc2e21f96 retry after getting HTTP 429 yzqzss 2022-12-28 22:05:09 +0800
  • 5fe9b8dae5 delete dist/ yzqzss 2022-12-28 04:08:24 +0800
  • 9717c56183 .gitignore add dist/ yzqzss 2022-12-28 04:00:59 +0800
  • 61a56b5e29
    Merge pull request #1 from yzqzss/fix-bytes-regex-2 yzqzss 2022-12-28 03:49:57 +0800
  • f92872a06d print imageName when getImagesAPI() is running yzqzss 2022-12-25 23:19:03 +0800
  • 570ea8f9ee Force str(xml) yzqzss 2022-12-25 21:53:25 +0800
  • acd2b82a92
    Merge pull request #44 from randomnetcat/fix-launcher-path Rob Kam 2022-12-24 10:01:48 +0000
  • 313169b9a4 Remove xml part of launcher wikidump name Jason Cobb 2022-12-23 23:55:36 -0500
  • 798f6e1fc2
    Merge pull request #43 from randomnetcat/launcher Rob Kam 2022-12-22 10:34:45 +0000
  • 29e669b334 Add self to README as contributor Jason Cobb 2022-12-21 18:53:03 -0500
  • fef85ac8a1 Add launcher docs to README Jason Cobb 2022-12-21 18:31:26 -0500
  • 4ee63a48a3 Simplify setting 7z path Jason Cobb 2022-12-21 01:28:31 -0500
  • fc1ea9759e Add ability to pass arguments through to dumpgenerator Jason Cobb 2022-12-21 01:13:34 -0500