mirror of https://github.com/oxc-project/oxc.git synced 2026-09-14 19:36:11 +08:00

Files

T

History

overlookmotel b4f6593c4f ci(lexer): run lint, tests and conformance on both lexer implementations (#26298 )

#26263 added the ability to run tests and conformance for both versions of `oxc_lexer` (SIMD and scalar fallback) on any platform.

Run tests and conformance on CI (both SIMD and scalar) on any PR which touches `oxc_lexer` crate or other files which affect conformance runner.

Additionally, run Clippy on the SIMD version (main Lint CI task doesn't lint it, due to the `target_feature = "avx2"` gate on the code).

All of this sets up `oxc_lexer` crate for further development, catching any regressions in CI.

2026-09-03 16:40:21 +00:00

src

ci(lexer): run lint, tests and conformance on both lexer implementations (#26298 )

2026-09-03 16:40:21 +00:00

tests

refactor(lexer): replace token kind constants with a TokenKind enum (#24931 )

2026-07-29 00:15:12 +00:00

Cargo.toml

feat(lexer): emit trivia-free spans in place of token starts (#24910 )

2026-07-29 00:15:11 +00:00

README.md

feat(lexer): add scalar lexer and close the remaining pathological regex vs division cases. (#24376 )

2026-07-12 00:08:57 +01:00

README.md

Oxc Lexer

A spec compliant standalone lexer for JS/JSX/TS.

Overview

Test262 compliant.
TS/JSX Working
UTF-8 validation costs 0.15CPB (Cycles per byte), optional parameter.
SIMD in x86_64 AVX2, Scalar for every other platform currently (in progress).
Regex vs Division cases should be handled even in pathological cases.