mirror of https://github.com/oxc-project/oxc.git synced 2026-09-14 19:36:11 +08:00

Files

T

Shanon Jackson ebd40ae6fe feat(lexer): add scalar lexer and close the remaining pathological regex vs division cases. (#24376 )

- Adds scalar fallback to oxc_lexer.
- Closes the Regex vs Division mislex gaps (without parser feedback).
- Adds a swathe of aggressive regex vs division test cases. 
- Adds `replay.rs` which kicks in for cases that will not appear in real
source but closes out the remaining spec compliance gaps for `await` and
`yield` and regex.
- All regex vs division gaps filled now falls into `zero cost` or `pay
when occurs` permafrost cold path.

---------

Co-authored-by: overlookmotel <theoverlookmotel@gmail.com>

2026-07-12 00:08:57 +01:00

338 B

Raw Permalink Blame History

Oxc Lexer

A spec compliant standalone lexer for JS/JSX/TS.

Overview

Test262 compliant.
TS/JSX Working
UTF-8 validation costs 0.15CPB (Cycles per byte), optional parameter.
SIMD in x86_64 AVX2, Scalar for every other platform currently (in progress).
Regex vs Division cases should be handled even in pathological cases.

338 B Raw Permalink Blame History

Oxc Lexer

Overview

338 B

Raw Permalink Blame History