Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add flag to only log a warning when HTML rewriting issue arises #72

Closed
benoit74 opened this issue Nov 19, 2024 · 0 comments · Fixed by #73
Closed

Add flag to only log a warning when HTML rewriting issue arises #72

benoit74 opened this issue Nov 19, 2024 · 0 comments · Fixed by #73
Assignees
@benoit74
Labels
enhancement New feature or request
Milestone
0.1

Comments

@benoit74
Copy link
Contributor

We have some checks in HTML rewriting to fail the scraper if unexepected HTML is encountered.

It would be however very useful to be able to failsafe on these checks on-demand, so that one can scrape a whole property and get a whole list of warnings on issues discovered, rather than discovering them one-by-one. It will for instance help to run a full scrape of geo.libretexts.org despite #71 not yet being implemented.
@benoit74 benoit74 added the enhancement New feature or request label Nov 19, 2024
@benoit74 benoit74 added this to the 0.1 milestone Nov 19, 2024
@benoit74 benoit74 self-assigned this Nov 19, 2024
@benoit74 benoit74 mentioned this issue Nov 19, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@benoit74 benoit74

Labels
enhancement New feature or request
Projects
None yet
Milestone
0.1
Development

Successfully merging a pull request may close this issue.

Add flag to continue on HTML rewriting issue openzim/mindtouch
1 participant
@benoit74