Commit graph

  • a7e236f0d7
    Merge pull request #528 from aaryansinhaa/feature/overwrite main benoit74 2025-12-22 11:56:16 +01:00
  • 81018f06fa Added --overwrite flag to zimit Aaryan Kumar Sinha 2025-12-13 01:30:33 +05:30
  • 34ce7eb98d
    Fix offliner definition benoit74 2025-12-16 16:33:53 +00:00
  • 5bb068ffea
    Merge pull request #529 from openzim/blob-types benoit74 2025-12-16 17:32:44 +01:00
  • aec19d95d2 migrate custom_css and favicon flags to blob types Uchechukwu Orji 2025-12-15 14:25:24 +01:00
  • ee4c28f33e
    Merge 70f4b5f07f into 277473884e dependabot[bot] 2025-12-10 22:50:44 +05:30
  • 277473884e
    Merge pull request #524 from Routhinator/issue-490-resume-crawl-from-interrupt benoit74 2025-11-08 10:55:07 +01:00
  • e30a82a91c PR #524 Fix line length. Chris Routh 2025-11-07 12:59:25 -08:00
  • ef004f3863 Issue #499 Record changes in CHANGELOG Chris Routh 2025-11-07 11:33:01 -08:00
  • 6db73a0a83 Issue #499 - Ensure build directory exists when passed. Chris Routh 2025-11-06 12:19:28 -08:00
  • 57a88434e2 Issue #499 - Use all warc_directories found when no specific collection has been passed. Chris Routh 2025-11-06 11:49:58 -08:00
  • 4595d2a302 Issue #499 - Only register cleanup if neither build or keep arguments have been passed. Chris Routh 2025-11-06 09:36:47 -08:00
  • 611d2033f7 Issue #499 - Use build dir rather than random tmp dir when passed. Chris Routh 2025-11-06 09:29:15 -08:00
  • 00845293d6
    Merge pull request #522 from vitaly-zdanevich/patch-3 benoit74 2025-10-20 07:53:34 +02:00
  • 44cf4218cb
    README.md: add link to https://en.wikipedia.org/wiki/ZIM_(file_format) Vitaly Zdanevich 2025-10-20 01:22:31 +04:00
  • 6b520318a2
    Merge pull request #521 from openzim/prepare-json-output benoit74 2025-10-10 11:52:08 +02:00
  • a9805c84c2 set proper outputs name Uchechukwu Orji 2025-10-10 10:34:26 +01:00
  • 8630b87a1f
    Merge pull request #520 from openzim/offliner-definition-workflow-dispatch benoit74 2025-10-10 11:25:51 +02:00
  • ad09665c4a add workflow dispatch to update-offliner ci Uchechukwu Orji 2025-10-10 10:22:29 +01:00
  • 1d2069a66b
    Merge pull request #519 from openzim/offliner-definitions benoit74 2025-10-09 10:21:30 +02:00
  • 4ec47cd6dd use base64 string as argument to workflow call Uchechukwu Orji 2025-10-08 04:25:12 +01:00
  • b60dd388e7
    Merge pull request #518 from openzim/offliner-definitions benoit74 2025-10-07 21:50:57 +02:00
  • 5624cbf081 set up offliner definitions Uchechukwu Orji 2025-10-07 04:08:14 +01:00
  • 70f4b5f07f
    Bump requests from 2.32.3 to 2.32.4 dependabot/pip/requests-2.32.4 dependabot[bot] 2025-06-10 08:57:23 +00:00
  • 8c471d9ee2
    Prepare for 3.0.6 benoit74 2025-04-11 07:46:42 +00:00
  • 009b8b4bd6
    Release 3.0.5 v3.0.5 benoit74 2025-04-11 07:18:18 +00:00
  • 0c795b0051
    Merge pull request #493 from orangetin/update-browsertrix benoit74 2025-04-11 09:14:34 +02:00
  • b5d87198d8 update changelog orangetin 2025-04-10 17:54:34 -07:00
  • 511c3a5021 Upgrade browsertrix-crawler to version 1.6.0 in Dockerfile orangetin 2025-04-10 17:52:19 -07:00
  • 3421ca0212
    Prepare for 3.0.5 benoit74 2025-04-04 11:09:50 +00:00
  • 12fde3af98
    Release 3.0.4 v3.0.4 benoit74 2025-04-04 11:00:29 +00:00
  • 6c006d9a4d
    Merge pull request #491 from openzim/upgrade_crawler benoit74 2025-04-04 12:56:46 +02:00
  • 146af5de0a
    Upgrade to browsertrix crawler 1.5.10 benoit74 2025-04-02 08:04:32 +00:00
  • 4e0174836d
    Prepare for 3.0.4 benoit74 2025-02-28 06:38:52 +00:00
  • 1e6748ab69
    Release 3.0.3 v3.0.3 benoit74 2025-02-28 06:21:27 +00:00
  • 5d319cdc09
    Merge pull request #483 from openzim/update benoit74 2025-02-28 07:19:00 +01:00
  • 88b85311e0
    Upgrade to browsertrix crawler 1.5.7 benoit74 2025-02-28 06:13:45 +00:00
  • 9fc66a95b7
    Prepare for 3.0.3 benoit74 2025-02-27 20:03:37 +00:00
  • 6ee053af5f
    Release 3.0.2 v3.0.2 benoit74 2025-02-27 19:58:51 +00:00
  • ac4ba0b01e
    Merge pull request #482 from openzim/upgrade benoit74 2025-02-27 20:50:50 +01:00
  • 1287351c1d
    Upgrade to browsertrix crawler 1.5.6 benoit74 2025-02-27 19:36:11 +00:00
  • b85a6b7e4e
    Merge pull request #480 from openzim/upgrade benoit74 2025-02-27 08:50:05 +01:00
  • eebc75f868
    Pin warc2zim version in preparation for 3.0.2 release benoit74 2025-02-27 07:32:25 +00:00
  • 00f0e475ae
    Upgrade to browsertrix crawler 1.5.5 benoit74 2025-02-27 07:31:28 +00:00
  • 363ff40767
    Prepare for 3.0.2 benoit74 2025-02-24 09:40:04 +00:00
  • dd65902556
    Release 3.0.1 v3.0.1 benoit74 2025-02-24 09:37:40 +00:00
  • 3e2ad5fede
    Merge pull request #476 from openzim/upgrade benoit74 2025-02-24 10:34:08 +01:00
  • 5e53be6fa4
    Pin warc2zim version in preparation for 3.0.1 release benoit74 2025-02-24 09:22:40 +00:00
  • 1b5b9bb80b
    Upgrade to browsertrix crawler 1.5.4 benoit74 2025-02-24 09:21:19 +00:00
  • bce22ceac1
    Prepare for 3.0.1 benoit74 2025-02-17 10:08:49 +00:00
  • e3cd12b0d1
    Release 3.0.0 v3.0.0 benoit74 2025-02-17 10:02:43 +00:00
  • ee0f4c6cec
    Use released warc2zim 2.2.2 benoit74 2025-02-17 09:52:55 +00:00
  • 91d5edda4a
    Merge pull request #472 from clach04/patch-1 benoit74 2025-02-15 09:42:49 +01:00
  • 3eb6c09046
    Correct link in README.md clach04 2025-02-14 22:02:17 -08:00
  • a9efec4797
    Merge pull request #471 from openzim/fix_browsertrix_args benoit74 2025-02-14 15:35:32 +01:00
  • 2f7a83e187
    Fixes following review benoit74 2025-02-14 14:22:30 +00:00
  • 96c4c3bdfd
    Clarify args variables/functions names benoit74 2025-02-13 17:11:32 +00:00
  • 7bfb4b25f0
    Remove confusion between zimit, warc2zim and crawler stats filenames benoit74 2025-02-13 17:08:22 +00:00
  • ed1a8a0aa9
    Use preferred Browsertrix Crawler arguments and fix multiple/file seeds support benoit74 2025-02-13 15:30:30 +00:00
  • dc6b5aafb7
    Enhance support of Browsertrix Crawler arguments benoit74 2025-02-13 15:14:53 +00:00
  • 4f9085b10e
    Merge pull request #470 from openzim/keep_tmp_folder benoit74 2025-02-14 09:46:12 +01:00
  • b4ec60f316
    fixup! Keep temporary folder when crawler or warc2zim fails, even if not asked for benoit74 2025-02-13 15:31:51 +00:00
  • ee82837aaa
    Keep temporary folder when crawler or warc2zim fails, even if not asked for benoit74 2025-02-13 13:18:06 +00:00
  • bc73193ce0
    Merge pull request #469 from openzim/crawler_1_5_3 benoit74 2025-02-13 13:03:27 +01:00
  • 101fb71a0b
    Better processing of crawler exit codes with soft/hard limits benoit74 2025-02-11 16:57:19 +00:00
  • 3a7f583a96
    Upgrade to Browsertrix Crawler 1.5.3 benoit74 2025-02-07 08:59:54 +00:00
  • 8b4b18bfb7
    Prepare for 2.1.9 benoit74 2025-02-07 08:59:54 +00:00
  • d228e9f346
    Release 2.1.8 v2.1.8 benoit74 2025-02-07 08:57:09 +00:00
  • 2e48ea1af6
    Merge pull request #466 from openzim/prepare_release benoit74 2025-02-07 09:50:49 +01:00
  • a7e1026b2e
    Pin warc2zim for release benoit74 2025-02-07 08:38:20 +00:00
  • cc84848c32
    Merge pull request #464 from openzim/upgrade benoit74 2025-02-07 09:36:24 +01:00
  • 6ec53f774f
    Upgrade to Browsertrix Crawler 1.5.1 benoit74 2025-02-07 08:24:02 +00:00
  • 5af981c01c
    Remove ARM64 job temporarily, still not working benoit74 2025-02-07 08:07:23 +00:00
  • b4c0495f48
    Fix arm runner selector benoit74 2025-02-06 21:19:08 +00:00
  • cea10bd3b5
    Add second build job on native arch for ARM64 benoit74 2025-02-06 21:17:46 +00:00
  • 4ef9a0d380
    Remove support for ARM64, this is not working anymore and was painfully slow benoit74 2025-02-06 21:11:40 +00:00
  • bf0dcd2ffc
    Merge pull request #462 from openzim/upgrade_py benoit74 2025-02-06 14:45:03 +01:00
  • 9396cf1ca0
    Alter crawl statistics following 1.5.0 release benoit74 2025-02-06 13:38:10 +00:00
  • 0f136d2f2f
    Upgrade Python 3.13, Crawler 1.5.0 and others benoit74 2025-02-04 15:12:49 +00:00
  • 53ca789885
    README.md: add about compression Vitaly Zdanevich 2025-01-29 19:45:26 +04:00
  • 0cb84f2126
    Prepare for 2.1.8 benoit74 2025-01-10 12:41:01 +00:00
  • 4835adbdd7
    Prepare for 2.1.8 benoit74 2025-01-10 12:41:01 +00:00
  • 14670d4c69
    Release 2.1.7 v2.1.7 benoit74 2025-01-10 10:24:47 +00:00
  • 8cddcf0666
    Merge pull request #450 from openzim/upgrade_crawler benoit74 2025-01-09 13:45:22 +01:00
  • 97ea6dfd7b
    Fix Docker label to follow new convention benoit74 2025-01-09 10:41:22 +00:00
  • 8d42a8dd93
    Move integration tests to test website benoit74 2025-01-09 10:41:05 +00:00
  • 00d2433383
    Upgrade to browsertrix crawler 1.4.2 benoit74 2025-01-09 09:06:08 +00:00
  • b5dac3c309
    Merge pull request #434 from openzim/upgrade_crawler benoit74 2024-11-15 16:49:26 +01:00
  • 16a4f8d4d8
    Upgrade to browsertrix crawler 1.4.0-beta.0 benoit74 2024-11-15 15:46:40 +00:00
  • e9adc38856
    Merge pull request #430 from openzim/set_return_code benoit74 2024-11-08 15:40:50 +01:00
  • bfa226bf81
    Properly exit with code benoit74 2024-11-08 14:22:35 +00:00
  • 15b72022ce
    Prepare for 2.1.7 benoit74 2024-11-07 10:03:03 +00:00
  • ac3975550d
    Release 2.1.6 v2.1.6 benoit74 2024-11-07 09:48:22 +00:00
  • 800142d66f
    Merge pull request #427 from openzim/upgrade_crawler benoit74 2024-11-07 10:47:42 +01:00
  • 5869a6a1c9
    Prepare for release benoit74 2024-11-07 09:43:47 +00:00
  • 1307285641
    Upgrade to browsertrix crawler 1.3.5 benoit74 2024-11-07 09:39:38 +00:00
  • c81c148207
    Fix Docker badge benoit74 2024-11-01 21:40:35 +01:00
  • 4c1007cb94
    Prepare for 2.1.6 benoit74 2024-11-01 14:21:03 +00:00
  • 06693c9d86
    Release 2.1.5 v2.1.5 benoit74 2024-11-01 13:33:03 +00:00
  • 1de457a478
    Merge pull request #424 from openzim/upgrade_crawler benoit74 2024-11-01 14:30:20 +01:00