[naaz234]

Description

HTMLExtractor.inline_close_follows (added for #1643) runs on every comment while a raw inline tag is open. Each call copies the rest of the paragraph and runs one regex per entry of inline_stack over it, so n open tags followed by n comments is cubic:

'x ' + '<span>' * 500  + '<!---->' * 500     6.5 KB    1.6 s
'x ' + '<span>' * 1000 + '<!---->' * 1000     13 KB   12.3 s
'x ' + '<span>' * 2000 + '<!---->' * 2000     26 KB   75.4 s

The end tags of the paragraph are now found once, with the position of the last end tag of each name. The parser also counts how many times each name is in inline_stack and how many open names still have an end tag ahead. A later comment in the same paragraph only drops the names whose last end tag it has passed. The 26 KB input now takes 0.035 s and 416 KB takes 3.5 s, which is what master already spends on a paragraph of plain <!----> comments of the same size. Mixing tag names, putting a non-matching end tag at the end, or alternating <span><!----> all stay linear too.

Output matches master on 60,000 random documents built from inline/block tags, end tags (including </ span>, </B >, </span/>), comments, blank lines and Markdown syntax, with no extensions, md_in_html and extra. The new test takes over 60 s on master and 0.14 s with this change.

AI Assistance Disclosure

• No AI tools were used in preparing this PR.

• AI tools were used and I have disclosed which ones, and have fully reviewed and verified their output.

  AI tools were use to assist with the following:

  • Code
  • Code Comments
  • Documentation
  • Changelog Entry
  • Commit Message
  • The Description Above
  • Other: the regression test, the benchmark and the random-document comparison against master

Checklist

• This PR follows the contribution guidelines.
• The code follows the Code Style Guide.
• The commit message follows the Commit Message Style Guide.
• I have added or updated relevant docs, including release notes if applicable which follow the Documentation Style Guide.
• I have added or updated relevant tests.
• I have not requested, and will not request, an automated AI review for this PR.

[waylan]

We have done a release since this PR was submitted. This edit to the changelog needs to be moved to the new unreleased section.

[naaz234]

Moved it to the end of the new Unreleased section. I rebased onto current master to do it, since the entry had ended up under 3.11.3 after the release, so the diff should only touch the Unreleased list now.