codsen-tokenizer/CHANGELOG.md

HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages

# Change Log

All notable changes to this project will be documented in this file.
See [Conventional Commits](https://conventionalcommits.org) for commit guidelines.

## 7.0.24 (2024-03-30)

### Bug Fixes

- remove an unused import ([f97b2d8](https://github.com/codsen/codsen/commit/f97b2d8a75cda25afb7e3485aa26595dbc6988c0))

## 7.0.0 (2022-12-01)

### BREAKING CHANGES

- Minimum supported Node version is v14.18; we're dropping v12 support

## 6.1.0 (2022-08-12)

### Features

- export types ([11b5fb9](https://github.com/codsen/codsen/commit/11b5fb936ce20e0a77c3a09806773e1cd7695c50))

## 6.0.17 (2022-04-18)

### Fixed

- tweak types ([5ef2fbf](https://github.com/codsen/codsen/commit/5ef2fbff647e07b8b96133b01d81b7f9e7d412ad))

## 6.0.0 (2021-09-09)

### Features

- migrate to ES Modules ([8c9d95d](https://github.com/codsen/codsen/commit/8c9d95d5dea0b769c2f070397141918a4893d575))

### BREAKING CHANGES

- programs now are in ES Modules and won't work with Common JS `require()`

## 5.6.0 (2021-05-24)

### Fixed

- algorithm fixes ([b20147c](https://github.com/codsen/codsen/commit/b20147c8d86c905ce595920f7fffb00ab02c8557))
- algorithm improvements ([f313aed](https://github.com/codsen/codsen/commit/f313aed2e19cdcdfe4ee7652cea64d156e21d1cf))
- algorithm improvements around inline CSS styles and ESP tokens ([774e925](https://github.com/codsen/codsen/commit/774e92584622e12f4bde8a60c4238b96e044c1c2))
- backwards pattern in inline CSS style rule values, text - ESP token ([f2b6fa9](https://github.com/codsen/codsen/commit/f2b6fa92f16a8c8228fdfcb26b4075d5eabddb2a))
- chain pattern inside the inline CSS rule value ([e83d482](https://github.com/codsen/codsen/commit/e83d482b6bcce0e2b9c424996b256e533ae1516d))
- eSP tokens as inline style rule values - 3 tests pending ([3f4aa0c](https://github.com/codsen/codsen/commit/3f4aa0c003f9c44fd3521a8cbb16caae6449a595))
- fix pattern ESP token + text token within inline CSS style rule values ([2396378](https://github.com/codsen/codsen/commit/23963782a965dbee34e39afd38aa87a68f764f8a))
- fix to prevent double ESP token recorded ([1f62f98](https://github.com/codsen/codsen/commit/1f62f982b89c6625db70c5daacdeeb205f01c2b5))
- patch text tokens only when they are really text tokens, not ESP tokens ([6a56dd4](https://github.com/codsen/codsen/commit/6a56dd45f9a378bfa22af7e1074fd32cb8201134))
- some insurance for the future, to tackle broken ESP tokens ([7f26a75](https://github.com/codsen/codsen/commit/7f26a75204da8f056e1f7fa1dff0587272b97054))
- space-!important ([84e624f](https://github.com/codsen/codsen/commit/84e624f1454ed151797be5cb69bc7999d31ea2cb))
- support for !important ([9212ffe](https://github.com/codsen/codsen/commit/9212ffe391f84b9e5586d038875d9dd895079dc6))
- tackle whitespace in front of !important ([a3f77e4](https://github.com/codsen/codsen/commit/a3f77e4be3c123a418bab20b3c6fc78e0e6fa291))

### Features

- config file based major bump blacklisting ([e15f9bb](https://github.com/codsen/codsen/commit/e15f9bba1c4fd5f847ac28b3f38fa6ee633f5dca))
- logic improvements around inline CSS and ESP tokens ([4334454](https://github.com/codsen/codsen/commit/4334454059eef4e8b56cf396844a8e473e9f242c))

## 5.5.6 (2021-04-11)

### Fixed

- correctly end the inline CSS style property without a value ([59b699d](https://github.com/codsen/codsen/commit/59b699dccd2466de8e9698f6f2564fcb3f1c9150))

### Reverts

- Revert "chore: setup refresh" ([23cf206](https://github.com/codsen/codsen/commit/23cf206970a087ff0fa04e61f94d919f59ab3881))

## 5.5.0 (2021-03-23)

### Fixed

- recognise Nunjucks double curly variables within CSS rules ([5963e7b](https://github.com/codsen/codsen/commit/5963e7b43dc89cf7849d8ce88d942daa55157ab0))
- recognise quote groups within HTML inline style attributes ([1a79454](https://github.com/codsen/codsen/commit/1a79454cf4149f6bba0a22bf5906d5b57055cb93))

### Features

- better recognition of closing tags with slash but missing opening bracket ([fbce088](https://github.com/codsen/codsen/commit/fbce0887f242523072fa688f93d997534c18d8b3))

## 5.4.0 (2021-03-14)

### Fixed

- further improvements to JS code recognition ([77273f0](https://github.com/codsen/codsen/commit/77273f004437b1568e1fe7708794ec320c1d6d79))
- tackle a case where attribute's opening quotes are followed by slash + bracket ([876812e](https://github.com/codsen/codsen/commit/876812e5dfe0cc6b57cfe6be5a8cbef7127a1ebd))

### Features

- improved JS code recognition ([623f13e](https://github.com/codsen/codsen/commit/623f13e7be9365b46e74546886472163e7d7330f))

## 5.3.0 (2021-03-07)

### Fixed

- detect mis-typed !important better ([a2a2631](https://github.com/codsen/codsen/commit/a2a2631746457b9469e2b1daf34410b3c5687ce0))
- improve the tag end patching up when it abruptly ends ([ff571fc](https://github.com/codsen/codsen/commit/ff571fc7bc0a7dbed9b6354c83249f8c345194ba))

### Features

- add detection for pattern: standalone space-semi in head CSS and HTML inline CSS properties ([dc14191](https://github.com/codsen/codsen/commit/dc14191974b04dc00bf26e2c6415162c13446546))
- algorithm improvements for broken code recognition in CSS rules ([3e0db8c](https://github.com/codsen/codsen/commit/3e0db8ced62db92f1c1d2990fd83058f2369db10))
- improvements to broken CSS properties recognition ([c8ef8e3](https://github.com/codsen/codsen/commit/c8ef8e37773f62db111755c9ea91cad371479aea))
- recognise truncated CSS better ([2d82a42](https://github.com/codsen/codsen/commit/2d82a42c4903ceb63a36c818fba40793d154f33a))
- repeated semi recognition in the inline/head CSS styles ([4e98dbd](https://github.com/codsen/codsen/commit/4e98dbd6db71e17a01c014447ee7bbb1c9a5a631))
- rogue standalone semicolon recognition in the inline HTML styles ([8317b28](https://github.com/codsen/codsen/commit/8317b280dad4206e1eb4ad099a91ab89dc6e8201))

## 5.2.0 (2021-02-27)

### Fixed

- algorithm improvements in broken `!important` recognition ([dcfd755](https://github.com/codsen/codsen/commit/dcfd755e0561fc00212b83606a86b3d94e095e2e))
- algorithm improvements in broken `!important` recognition ([0254ca8](https://github.com/codsen/codsen/commit/0254ca8e1973b3b747589b3c8e585d0bda2f8252))
- further improvements to broken code recognition ([ba41245](https://github.com/codsen/codsen/commit/ba4124552411d391d788633419f5e533cb6354a0))
- improvements to malformed `!important` recognition ([7c9d70b](https://github.com/codsen/codsen/commit/7c9d70b6d96e00cb90b038be7c392fd0ec162c30))
- stray `!important` to be put under `important` key, not under `property` ([3cd6291](https://github.com/codsen/codsen/commit/3cd6291bb15abe16faf5c655924b61fd882a801b))
- tweak to address broken or partial code cases, around CSS rules ([aea4d9b](https://github.com/codsen/codsen/commit/aea4d9b9d46eb7cf28efdd2adc495711154140d7))

### Features

- algorithm improvements ([b52667d](https://github.com/codsen/codsen/commit/b52667db2454d30b8ff70274088f11f20333ad9d))
- correctly set whitespace after abruptly ended css rule as a text token ([4fdd70d](https://github.com/codsen/codsen/commit/4fdd70d7fed4ee1d8e72c1946b2b3ef1906e6241))
- improve recognition of rogue characters in CSS rules ([b57335a](https://github.com/codsen/codsen/commit/b57335a12e671eedc0a1f38498b3a4ef44a66572))
- improvements to the CSS rule recognition, especially around `!important` ([d89a7e0](https://github.com/codsen/codsen/commit/d89a7e05eb796339ac61aee54b5d9dd43c8a1f91))
- patch CSS rules when closing curly has not been met yet a new one starts ([4f108a6](https://github.com/codsen/codsen/commit/4f108a66b813c039a5afbdd309e1db55056ba716))
- tokenize `!important` in CSS ([a6e0925](https://github.com/codsen/codsen/commit/a6e0925c5f4859bf4b0e17996f42e9ca65bce6d8))

## 5.1.0 (2021-02-07)

### Features

- improvements to ERB template recognition ([5fd2ba1](https://github.com/codsen/codsen/commit/5fd2ba12df7f4b3867dda050b76d82d842d9f43a))

## 5.0.1 (2021-01-28)

### Fixed

- add `testStats` to npmignore ([f3c84e9](https://github.com/codsen/codsen/commit/f3c84e95afc5514214312f913692d85b2e12eb29))

## 5.0.0 (2021-01-23)

### Features

- rewrite in TS, start using named exports ([b41c644](https://github.com/codsen/codsen/commit/b41c644d15d3a8afa9021a27cfb1cef3e4fe8773))

### BREAKING CHANGES

- previously you'd import a default: `import tokenizer from ...` - now, tap a named export: `import { tokenizer } from ...`

## 4.5.0 (2020-12-13)

### Fixed

- add checks and prevent throwing in certain unfinished code cases ([aa63861](https://git.sr.ht/~royston/codsen/commit/aa6386199014d507725dfc64320ee09ddd708a1e))
- fix a case of unfinished css style blocks ([755ce98](https://git.sr.ht/~royston/codsen/commit/755ce982f0beee5602809840a9a07d093f74c0e3)), closes [#2](https://git.sr.ht/~royston/codsen/issues/2)

### Features

- improvements to abruptly ended chunk recognition ([1728753](https://git.sr.ht/~royston/codsen/commit/17287533a413206d212517912bf60373a58eb83a))

## 4.4.0 (2020-12-11)

### Features

- improve the recognition of equal chars in uri's ([8d041b7](https://git.sr.ht/~royston/codsen/commit/8d041b7a4d017fdc73ad8882d587cebc4714bae4))
- recognise attributes with certain curly quotes ([4e43cc7](https://git.sr.ht/~royston/codsen/commit/4e43cc708b944a8b1cad7416932b73b9a3ea84e2))

## 4.3.0 (2020-12-06)

### Features

- add another lump blacklist pattern ([6b3b87d](https://git.sr.ht/~royston/codsen/commit/6b3b87d631b3ca8b5e3bb97a8ca17585a83b2e46))

## 4.2.0 (2020-12-04)

### Features

- recognise JSP (Java Server Pages) ([68fa3c2](https://git.sr.ht/~royston/codsen/commit/68fa3c25cee47996126af3b6ea4bb0a88f3cb788))

## 4.1.0 (2020-12-03)

### Features

- add concept of lefty and righty characters to improve recognition ([dd4b8cb](https://git.sr.ht/~royston/codsen/commit/dd4b8cb66a1c49a9ceb9236c4f0b15cb175e4a7a))
- improve the templating tag detection, exclude double parentheses better ([724e827](https://git.sr.ht/~royston/codsen/commit/724e827724ff5efb44fe5d8363743e4d32fc2dae))

## 4.0.0 (2020-11-28)

Accidental version bump during migration to SourceHut. Sorry about that.

## 3.2.0 (2020-11-02)

### Features

- improve head CSS parent rule selector recognition ([d9373d8](https://gitlab.com/codsen/codsen/commit/d9373d80838f104b9dea00d27a3e0f2ed0c31923))

## 3.1.0 (2020-10-19)

### Features

- improve inline css and head css recognition ([e7a288c](https://gitlab.com/codsen/codsen/commit/e7a288cc6f67b2e202e8f56a296c28018eca7cca))

## 3.0.0 (2020-10-12)

### Features

- better inline css recognition ([b1b67b3](https://gitlab.com/codsen/codsen/commit/b1b67b371e75f628cf1d8e1d1f9fa8a1294108fc))
- better recognition of rogue characters around inline css rules ([3243b5c](https://gitlab.com/codsen/codsen/commit/3243b5cdfa7d7dd3c860d6e48337ad8ef20a3e32))
- better regognition of a sequence of inline styles ([de9b327](https://gitlab.com/codsen/codsen/commit/de9b3274cc3910ed5b9f56572ef9a710e353b67f))
- css comments in head styles ([a217543](https://gitlab.com/codsen/codsen/commit/a217543dbdb263886d8ac6e9b1d6efdc85598b8b))
- dRY the property pushing, add more tests ([e6ed023](https://gitlab.com/codsen/codsen/commit/e6ed0230e62b1219822a6a891e80d8a9205d67f5))
- head CSS style properties ([9128dcb](https://gitlab.com/codsen/codsen/commit/9128dcb028e0fc6fcedddedf4d09af3c6ebe5eac))
- html inline css style comments ([b2379e4](https://gitlab.com/codsen/codsen/commit/b2379e4699e25ed4397506c4704d32562f471052))
- improvements to missing semicol between two properties ([cdb3423](https://gitlab.com/codsen/codsen/commit/cdb3423430612c6a5a4f647e674e2c3b7a6c4a8c))
- new html tag kind - inline ([a5f8b94](https://gitlab.com/codsen/codsen/commit/a5f8b9480f45e5774d7c528f63f6cb37487e2c44))
- recognise a missing semicol between two properties in css ([a8ef72a](https://gitlab.com/codsen/codsen/commit/a8ef72a9bde83ad21178d6259ec9105514eff658))
- recognise double-wrapped attribute values ([08e8dc6](https://gitlab.com/codsen/codsen/commit/08e8dc64c4b2b297030ebce75e4d12a3fb4fadef))
- recognise erroneous inline css comments with slash-slash ([061e84a](https://gitlab.com/codsen/codsen/commit/061e84a66a5eae911f755f8bec9ee5c30854b8ea))
- recognise rogue characters within inline css styles ([252eb07](https://gitlab.com/codsen/codsen/commit/252eb07215a66c1e15b520019a2435fef12de423))
- recognise rogue extra closing curlies in CSS rules ([9bb1e7a](https://gitlab.com/codsen/codsen/commit/9bb1e7af876455112df8ca090eb3fb4cb299eec6))

### BREAKING CHANGES

- the API surface anywhere within CSS styles, both inline and in head `<style>`, have been improved

## 2.17.0 (2020-05-24)

### Fixed

- fix "rule" type node "left" key when it is preceded by at-rule ([96e3a65](https://gitlab.com/codsen/codsen/commit/96e3a650f9e4da6caa6f9ee5c3a15bcc88370aef))

### Features

- add attribs[].attribLeft to HTML tokens ([44046c1](https://gitlab.com/codsen/codsen/commit/44046c15f5124c447e86b9d2dd43058883b5b30a))
- add token.left key to rule-type tokens ([93564de](https://gitlab.com/codsen/codsen/commit/93564dea0739b67cba7ce083cec225435daaefaf))
- proper "at" and "rule" token nesting ([bd5db56](https://gitlab.com/codsen/codsen/commit/bd5db5619c559806b06f60d019888785613a3476))

## 2.16.0 (2020-05-17)

### Features

- broken ESP tag recognition improvements ([f3741e8](https://gitlab.com/codsen/codsen/commit/f3741e8fd34430e4a0ab5484cb94dc5918c99761))
- improve ESP tag recognition, add more tests and make existing ones more precise ([31e923c](https://gitlab.com/codsen/codsen/commit/31e923c8283001675522525c3ad097747d7df8d8))
- improvements to esp tag recognition ([13740c1](https://gitlab.com/codsen/codsen/commit/13740c171f4b9e4d207d4d1a718193f6715cbf78))
- recognise unclosed/terminated ESP tags within tag attributes ([28015ba](https://gitlab.com/codsen/codsen/commit/28015ba0b2deed5bb181e8064fa683cfb8dafb19))

## 2.15.0 (2020-05-11)

### Features

- improvements to esp tag recognition + some rebasing around esp tag extraction ([2117466](https://gitlab.com/codsen/codsen/commit/21174667c15ce313f788aa1ad641d5070903efe6))
- responsys RPL-like ESP tag recognition ([543214a](https://gitlab.com/codsen/codsen/commit/543214ab0bee9448f99370f395954bd8543b1f11))

## 2.14.0 (2020-04-20)

### Features

- improvements to the ESP tag recognition ([a1f5fe1](https://gitlab.com/codsen/codsen/commit/a1f5fe12269a809c9f17913288fb56f48ce69dab))

## 2.13.0 (2020-04-19)

### Fixed

- more fixes for `attribs[].attribValue[]` ([51f842b](https://gitlab.com/codsen/codsen/commit/51f842b1e78eb6751a3609d924b634ae41ea5dee))
- set tag key `pureHTML` correctly ([90cbb4b](https://gitlab.com/codsen/codsen/commit/90cbb4b694a106445e9632ac4396dc0f8f67b3c6))

### Features

- esp tags can come as attributes or be among attribute value tokens ([28cfd40](https://gitlab.com/codsen/codsen/commit/28cfd407135b23521951d56d69893dd7a0a5d8cc))

## 2.12.0 (2020-04-13)

### Features

- detect when HTML attribute's equal is missing and there's whitespace instead ([cd74106](https://gitlab.com/codsen/codsen/commit/cd74106581699127eada0f47c723c91c9254a64b))
- extract new packages `is-char-suitable-for-html-attr-name` and `is-html-attribute-closing` ([deafd48](https://gitlab.com/codsen/codsen/commit/deafd488e9487ea96a04b51cafa271cd019cfafa))
- recognise HTML attributes with mismatching quotes and missing equal ([7dedba1](https://gitlab.com/codsen/codsen/commit/7dedba18d8b49f4991056635f1cfc481a9069502))

## 2.11.0 (2020-04-04)

### Features

- `opts.tagCbLookahead` and `opts.charCbLookahead` ([4b88c33](https://gitlab.com/codsen/codsen/commit/4b88c3348a84d46377fdcddc39435869042d2817))
- complete the correction for missing closing of an attribute ([34aa959](https://gitlab.com/codsen/codsen/commit/34aa9594bafb6f798c2b51d543b4aef05ffd7908))
- move lookahead contents from baked into node to separate input argument ([be27d8e](https://gitlab.com/codsen/codsen/commit/be27d8ed369e6d840c8cd2f7a752b7bd6ed20e84))
- new comment kind, simplet (`<!-->`) ([0734054](https://gitlab.com/codsen/codsen/commit/07340546b450bb2f16076e14f68b773d93284782))
- recognise broken pattern "attribute name - equal - attribute name - equal" ([9966e6c](https://gitlab.com/codsen/codsen/commit/9966e6cbf8f85fac97f921a049233e3e1aee1d66))
- recognise conditional comments (both kinds) without brackets as long as mso exists ([1afe369](https://gitlab.com/codsen/codsen/commit/1afe369fd23939c5f08872e17e2ad1f5811e5a20))
- recognise expanded notation outlook conditional kind="not" comments ([ffa4a0d](https://gitlab.com/codsen/codsen/commit/ffa4a0dc801371479350dc0b397f2393a0f048f1))
- recognise quoteless attribute tag endings ([1a38f1d](https://gitlab.com/codsen/codsen/commit/1a38f1dbf297b864bbe77003616a0dd5d16d08c8))
- support ESP tokens inside HTML tags - nest them among attributes ([114193c](https://gitlab.com/codsen/codsen/commit/114193c14a79f24caea9b45f8b470cbb096cea09))

## 2.10.0 (2020-03-24)

### Fixed

- recognise "only"-kind closing tails with simple comment tails preceding ([f0d3624](https://gitlab.com/codsen/codsen/commit/f0d3624ca9f441cb6c741bd7da223562f0064517))
- second part of newly-added layer quotes - removing them ([9378cb9](https://gitlab.com/codsen/codsen/commit/9378cb9c76aa38a1ff8c683e1e020e3ef83cbac4))

### Features

- recognise conditional comment tags with wrong brackets ([c399b92](https://gitlab.com/codsen/codsen/commit/c399b92a32ebbbc8e041c8bd88d0f9215425312b))
- recognise mismatching quotes around HTML attributes ([7e2818c](https://gitlab.com/codsen/codsen/commit/7e2818c3ee0b1495343282e644b030d42d704f92))
- recognise missing closing quotes on HTML attibutes ([610e400](https://gitlab.com/codsen/codsen/commit/610e400f561051af7824924e1f9f86afc866532c))
- recognise missing opening quotes on HTML attributes ([41b85f0](https://gitlab.com/codsen/codsen/commit/41b85f0b3feabb15e692065426f4da2cecc7dc60))
- recognise repeated opening quotes on HTML attributes ([55707d5](https://gitlab.com/codsen/codsen/commit/55707d53d14ca8d893ef20a8b2494cdc3c91d5b6))

## 2.9.0 (2020-03-16)

### Fixed

- add missing value, `token.recognised` on the broken tags ([95fd011](https://gitlab.com/codsen/codsen/commit/95fd011fa0e9d9a17ce6fb9806a152670880e0db))
- correct the incomplete simple opening HTML tag token ([08620a6](https://gitlab.com/codsen/codsen/commit/08620a6bd11309e623d0ecd8bad6f8a3d870310e))
- fix correct opening simple HTML comment ranges ([04b88bc](https://gitlab.com/codsen/codsen/commit/04b88bcc3eed6db8a12ceb8d73088342edac776d))
- recognise repeated opening brackets in comment tags ([6d22f81](https://gitlab.com/codsen/codsen/commit/6d22f81b5a0061aef4c969570ea00379e29fb86d))

### Features

- algorithm improvements and some housekeeping ([c479af9](https://gitlab.com/codsen/codsen/commit/c479af90b5bfb1c81dd5733224ecafa1703bc9b7))
- detect opening "if" kind comments without opening square bracket ([607fc23](https://gitlab.com/codsen/codsen/commit/607fc237d33dff4b1702303fc0b74bcd19f4cace))
- improve the recognition to "not" kind conditional opening without closing bracket ([23d6771](https://gitlab.com/codsen/codsen/commit/23d677141b967c6380fb490b72d88955b3e5634c))
- recognise missing opening brackets ([a182bb1](https://gitlab.com/codsen/codsen/commit/a182bb15b95b3c93d6b6d8ba94eff0807d935311))
- recognise tags abruptly ended after tag name ([6398167](https://gitlab.com/codsen/codsen/commit/639816701b826d126eeb633face549b7ffd995a5))

## 2.8.0 (2020-02-24)

### Fixed

- a `donothing` skip was missing ([b79dafc](https://gitlab.com/codsen/codsen/commit/b79dafce493277df6f68fa9bd9e067e25468fa9e))
- make all tests pass ([2c48aa1](https://gitlab.com/codsen/codsen/commit/2c48aa10247aa81e3defc750853ee7ba52b247c4))
- recognise rule chunks without curly braces (very likely broken) ([f4245a3](https://gitlab.com/codsen/codsen/commit/f4245a3d5ed91c5e5713f4519ff31645ce841b9f))
- set the extracted selector's value to be trimmed in the end too ([1efc1bd](https://gitlab.com/codsen/codsen/commit/1efc1bd7beae29359deacb49fc01d16c86910d0c))
- set XML closing tag kind ([b1ab96f](https://gitlab.com/codsen/codsen/commit/b1ab96f33140bfd0a358a1d5a0fba5eaa43b02f6))

### Features

- add `token.value` ([3a85934](https://gitlab.com/codsen/codsen/commit/3a859341ca31845d93fc581223cb89cf4ef73cdd))
- allow spaces between comment tokens ([902e5cc](https://gitlab.com/codsen/codsen/commit/902e5cc77a27ff9cf399568c2454f6c5f2459c2e))
- improvements to `startsComment` detection function from util ([9c0e0c0](https://gitlab.com/codsen/codsen/commit/9c0e0c092fc739dabc4b22c913756191c064f2b6))
- include more erroneous comment tag cases to be recognised ([ea41247](https://gitlab.com/codsen/codsen/commit/ea4124782107e508d94f2dca08492001c1359256))
- recognise conditional "everywhere except" comments (type="comment", kind="not") ([e310798](https://gitlab.com/codsen/codsen/commit/e310798c5e9e10944a9a7f8d72ea838f7cca8501))
- recognise more broken tags and broken comment tags ([72e1e32](https://gitlab.com/codsen/codsen/commit/72e1e3263be167ffa80fdd51a462ed0fa4e6d273))
- recognise outlook/ie conditional comments (kind "only", type "comment") ([5ef68fa](https://gitlab.com/codsen/codsen/commit/5ef68fa793400923e7074f6c62b213b0d6fb361e))
- recognise rogue closing quotes in css ([3be0ec5](https://gitlab.com/codsen/codsen/commit/3be0ec5d70f68b56c104f85adbe6de3ee3ba0ed3))
- simple comment tokens recognised both opening and closing ([bd53904](https://gitlab.com/codsen/codsen/commit/bd5390479e6e38d4b56b48358263e66d0ad42071))

## 2.7.0 (2020-02-09)

### Fixed

- don't ping last undefined character to charCb ([284b50c](https://gitlab.com/codsen/codsen/commit/284b50cdfd968c26b2858a0efd2697a7a7d67d90))
- turn off styleStarts ([def78e0](https://gitlab.com/codsen/codsen/commit/def78e04f960261381c16408bcd19bfe73d77c4c))

### Features

- "rule" token type ([e95c9ab](https://gitlab.com/codsen/codsen/commit/e95c9ab0f9e0fd2d1df629aa13d75d317b310c61))
- extend loop range until length + 1 ([8095bb9](https://gitlab.com/codsen/codsen/commit/8095bb9b5527125c06e61e904c914533f4fff9eb))
- improvements to cdata tag recognition ([b84491b](https://gitlab.com/codsen/codsen/commit/b84491ba6197d75b4614b54f399b3f06621e5e7b))
- single-layer at rules with nested whitespace (text) tokens ([3bc51b5](https://gitlab.com/codsen/codsen/commit/3bc51b5f651fab92985bfe39a7fb7c70ad2425e5))
- tighten up opts input check types ([3b80e1d](https://gitlab.com/codsen/codsen/commit/3b80e1dcccad69c74ca959d7035a8f038baddbb7))

## 2.6.0 (2020-02-01)

### Features

- improvements to unclosed tag recognition ([d861dd4](https://gitlab.com/codsen/codsen/commit/d861dd40fedabb21f922e8ced1bfb45982e407d4))
- missing HTML closing bracket ([c858340](https://gitlab.com/codsen/codsen/commit/c858340f9a95beff746303ca0ac3649f75ab0167))

## 2.5.0 (2020-01-01)

### Fixed

- whole attribute's value can't be an opening or closing ESP lump ([051f2b6](https://gitlab.com/codsen/codsen/commit/051f2b609ea83daab5ba97d3821aac5625b9b9b0))

### Features

- further improvements to attribute value recognition ([313f091](https://gitlab.com/codsen/codsen/commit/313f09175ab393715dcb64ba27d2aa6c09723e1a))

## 2.4.0 (2019-12-27)

### Features

- add recognised attribute flag, "attribNameRecognised" ([71cbe64](https://gitlab.com/codsen/codsen/commit/71cbe6458102263ee5f503d9c288db573f3084e9))
- improvements to the broken attribute recognition algorithm ([408a3c6](https://gitlab.com/codsen/codsen/commit/408a3c6573c8043de2e43aafd4c519bb8973b5fd))
- recognise attribute values not wrapped in quotes ([1b3abcd](https://gitlab.com/codsen/codsen/commit/1b3abcd2ffe5d53eb9dd4f9c7a18b3490f6db1a4))
- recognise missing closing quotes of attribute values ([c39dfde](https://gitlab.com/codsen/codsen/commit/c39dfdec9f86056f463c45bb22e9013603f33cec))
- report tagName as lowercased, for consistency, ranges are still available ([e69efc6](https://gitlab.com/codsen/codsen/commit/e69efc6f9de520584ea808a53de631ec0356cf50))

## 2.3.1 (2019-12-21)

### Fixed

- false positive - repeated percentage within attribute's value pretending to be an ESP tag ([ec36476](https://gitlab.com/codsen/codsen/commit/ec3647690728b99109b2c9ff44407229a283f336))
- html empty attributes logic fix ([a3e507d](https://gitlab.com/codsen/codsen/commit/a3e507d0b29baa3d6d7f92996d97b0c3af076db8))
- recognise rgb() with empty brackets as value of an attr ([69746ec](https://gitlab.com/codsen/codsen/commit/69746ecee702a499c9bdf72d1353a13e812a7504))

## 2.3.0 (2019-12-14)

### Features

- algorithm improvements and more tests ([4d6cf46](https://gitlab.com/codsen/codsen/commit/4d6cf46990a9caf49541767601e6f7ac2a8ab782))

## 2.2.0 (2019-12-09)

### Fixed

- add all h\* tags to recognised list, fix the digit from being skipped ([43cae4f](https://gitlab.com/codsen/codsen/commit/43cae4f95b34f675768b2b2d8b256928a69e8ddc))

### Features

- algorithm improvements, especially around esp literals ([3183d4e](https://gitlab.com/codsen/codsen/commit/3183d4ea3ba32310d4d91e109fcd9cb09c552f55))
- html tag attribute recognition ([5892120](https://gitlab.com/codsen/codsen/commit/5892120458f57c6a8e6442a03f43b8efb58501a2))

## 2.1.0 (2019-11-27)

### Fixed

- fix score calculation ([3601ce2](https://gitlab.com/codsen/codsen/commit/3601ce282fb3f186531198ffb61ad41c1bb3e31b))
- report doctype as recognised ([6967044](https://gitlab.com/codsen/codsen/commit/6967044c5f4649feb6c1194ceb4d8ce4ac4a7741))

### Features

- eSP tag recognition improvements ([5b1c0af](https://gitlab.com/codsen/codsen/commit/5b1c0afe7c2bc9d605e4db1caffc63104a50c995))
- improved broken cdata and doctype recognition ([98880dc](https://gitlab.com/codsen/codsen/commit/98880dc94316681f86d1ef635bbf3212b1dc7936))
- improvements to ESP tag recognition algorithm ([f135f16](https://gitlab.com/codsen/codsen/commit/f135f16984a6383e3efbb9cca8eb9911f0fc67fb))
- report wrong case tag names as recognised (so that we can catch them later in emlint) ([bbd56ec](https://gitlab.com/codsen/codsen/commit/bbd56ecfcbf0d3eabe6f28b1331be0804395fb37))

## 2.0.0 (2019-11-20)

### Features

- character callback ([d8ffbbd](https://gitlab.com/codsen/codsen/commit/d8ffbbde9a07644dbc961f7650f10dd2053b2dfc))
- recognised tags ([f1960f8](https://gitlab.com/codsen/codsen/commit/f1960f8ffa6ebf1f50eb85d6b5b52188d7659d44))

### BREAKING CHANGES

- options argument is now pushed by one place further

## 1.3.0 (2019-11-18)

### Fixed

- improve void tag detection by moving calculation to where tag name is calculated ([5ea548f](https://gitlab.com/codsen/codsen/commit/5ea548f580f6ea6df3e8b72d036781b3bff09d8b))

### Features

- don't end esp token as easily, ensure it's closed using a character from estimated tails ([56d65be](https://gitlab.com/codsen/codsen/commit/56d65be7a46472a914ce8ef3fbb459e6baf706b4))
- void tags are determined evaluating tag's name, not presence of slash ([57d8b4c](https://gitlab.com/codsen/codsen/commit/57d8b4cb81abc4f3dec5cb0dc6d0898bb09806c3))

## 1.2.0 (2019-11-11)

### Features

- self-closing html tags ([afaff20](https://gitlab.com/codsen/codsen/commit/afaff20539623d463e759d1a78a1ba6a45b7f0aa))
- split test groups into files and report tag name for html tokens ([014e792](https://gitlab.com/codsen/codsen/commit/014e792786f69fa09d4771c8e24ea5d90c8a8b75))

## 1.1.0 (2019-11-02)

### Features

- css token type ([d617fb1](https://gitlab.com/codsen/codsen/commit/d617fb1e3d99e5b1b1fdf7a303a86f6af640298d))
- doctype and xml recognition ([3f92f64](https://gitlab.com/codsen/codsen/commit/3f92f646a67d2d458c6323a1b668d415ff9149e8))
- heuristic esp tag recognition ([8ee7df7](https://gitlab.com/codsen/codsen/commit/8ee7df774eed779e6c0abcd4732646fc57138ede))
- `opts.reportProgressFunc` ([5cc4838](https://gitlab.com/codsen/codsen/commit/5cc4838a7c94428ace4e29defbcfa10188a94867))
- recognise content within quotes ([c6cbc97](https://gitlab.com/codsen/codsen/commit/c6cbc97ad6b021ca90437730f70c43134f761d84))
- support esp code nested in other types and uneven count of quotes there ([399f48b](https://gitlab.com/codsen/codsen/commit/399f48b407845ae0324521ff68b6525c79a10961))
- tap `is-html-tag-opening` to make algorithm more resilient ([1c19b48](https://gitlab.com/codsen/codsen/commit/1c19b48c750b0357bb4d96d7e42099ae7dcb6e2a))
- init ([61e53c3](https://gitlab.com/codsen/codsen/commit/61e53c360cb75326994f6c0664b9d10e14242507))

## 1.0.0 (2019-11-01)

- First public release.