feat(clp-s)!: Adds CLP+ as an experimental feature. - #2275

Open

davidlion wants to merge 485 commits into

y-scope:mainfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 15, 2026

Add new hive ints.
davidlion
committed
fd44181
Add int and str filter counts.
davidlion
committed
57ba5ba
Add dict stats.
davidlion
committed
5b2ddd8

Commits on Apr 17, 2026

Improve search metrics.
davidlion
committed
142c397

Commits on Apr 20, 2026

Update log surgeon; Add decomposed query cache.
davidlion
committed
cd8c7e1
Remove log.
davidlion
committed
5a3238b

Commits on Apr 24, 2026

vibrating
davidlion
committed
f394f90

Commits on Apr 26, 2026

Commits on Apr 28, 2026

Refactor clpp query creation.
davidlion
committed
518af89

Commits on Apr 30, 2026

Commits on May 1, 2026

Remove m_clpp_matched_schemas and utilize m_descriptor_to_schema to perform intersect normally.
davidlion
committed
81ef490

Commits on May 4, 2026

Update log mechanic.
davidlion
committed
4cd84ac
Safety first.
davidlion
committed
c5fa0d6

Commits on May 6, 2026

Commits on May 8, 2026

EXISTS queries work; Refactor stuff.
davidlion
committed
9633c21

Commits on May 11, 2026

Commits on May 12, 2026

Update log-surgeon; Swap capture to match naming; Update task/cmake to be cleaner (log-surgeon is rust, until removed log_surgeon is c++).
davidlion
committed
9c56560
Merge remote-tracking branch 'upstream/main' into use-ls-rust
davidlion
committed
dc643c8
Merge remote-tracking branch 'chris/use-ls-rust' into clpp
davidlion
committed
36c5a79
Package builds.
davidlion
committed
f8cc77e
format
davidlion
committed
4f58536
Swap rsync to cp for gh runners.
davidlion
committed
eaf933a
Bad merge...
davidlion
committed
835fcf6
Fix dumb mistakes/stuff.
davidlion
committed
b705e2e
Undo deps patch.
davidlion
committed
c65536f
sigh
davidlion
committed
51c2190
Everything builds now...
davidlion
committed
a7b92c8
Attempt to fix package issues: don't depend on toolchains:rust inside parallel deps; Link dl for liblog_surgeon.a in targets file for manylinux.
davidlion
committed
2e88a4e
who knows
davidlion
committed
111c6b5

Commits on May 13, 2026

Update CLP to use the latest log-mechanic commit.
SharafMohamed
committed
7449d85
Generalize parser creation.
SharafMohamed
committed
e512c7e

Commits on May 18, 2026

Commits on May 19, 2026

Refactor/reaname log type -> log shape.
davidlion
committed
f34233e
formatting
davidlion
committed
e948b84
Bump log-surgeon.
davidlion
committed
33863d6

Commits on May 21, 2026

Commits on May 22, 2026

Commits on May 24, 2026

Merge in stats.schema_tree query; Persist SchemaNode count; Refactor/update a bunch of SchemaNode related code.
davidlion
committed
5a59591

Commits on May 25, 2026

Commits on May 26, 2026

Migrate make-dictionary-readable and log-convertor to rust LS.
SharafMohamed
committed
e5a4c96
Fix compile issue.
SharafMohamed
committed
9c36028
Remove LogSurgeonReader and remove c++ LS dependancies.
SharafMohamed
committed
3992141
Remove remaining c++ log_surgeon linkers.
SharafMohamed
committed
eac3376
Remove log-surgeon task.
SharafMohamed
committed
5f67d51
Change naming in archive writer to use match in place of capture.
SharafMohamed
committed
2eb2f3d

Commits on May 27, 2026

Initial wildcard rule name support.
davidlion
committed
d9e90c5
Update LS rust name to log-surgeon; Update log-surgeon task.
SharafMohamed
committed
6a2cad2

Commits on May 28, 2026

Merge branch 'main' into use-ls-rust
SharafMohamed
committed
7b6fe72
Fix internal tag.
SharafMohamed
committed
4ef4bcb
Format.
SharafMohamed
committed
6a2892f
Update LS rust version.
SharafMohamed
committed
79ecd90

Commits on May 29, 2026

Bump log-surgeon.
davidlion
committed
3be6e4f
Schema id naming changes/fixes.
davidlion
committed
18c8f9f
Drop log-surgeon version to avoid regression.
davidlion
committed
de04db6
Added rule name wildcard support for multiple children; Added some type aliasing; Use column descriptor id rather than pointer address for keys.
davidlion
committed
0ecdf22
In log-surgeon task update cpp_ffi to cxx; replace rsync with cp; link against dl
SharafMohamed
committed
d091a3b
Merge branch 'main' into use-ls-rust
SharafMohamed
committed
585ca16
Update QueryRunner.
SharafMohamed
committed
874fb7d
Update GrepCore test and SchemaSearcherTest helper.
SharafMohamed
committed
24988f9

Commits on May 30, 2026

Finish migration for SchemaSearcher unit-test.
SharafMohamed
committed
d49ddc0
Bump ls.
davidlion
committed
c8b2080

Commits on Jun 1, 2026

Commits on Jun 2, 2026

Add delimiters to test case.
SharafMohamed
committed
93577e1
Add question mark as a wildcard in the proccess token check.
SharafMohamed
committed
5100077

Commits on Jun 3, 2026

Reintroduce interpretation normalization; Explain unit-test in docs.
SharafMohamed
committed
77f7f65
Fix compiler error.
SharafMohamed
committed
713dfd2
Fix comment.
SharafMohamed
committed
4982c7d
Add comparitor.
SharafMohamed
committed
046d904
Deduplicate wildcard check.
SharafMohamed
committed
2480aa5
Normalize interpretations in unit-test.
SharafMohamed
committed
fb156ae
Improve unit-test output on failure.
SharafMohamed
committed
d4f0fab
Capture interp size.
SharafMohamed
committed
f703693
Capture schema.
SharafMohamed
committed
111306c
Add interp prefix.
SharafMohamed
committed
6b11ae4
Merge branch 'main' into use-ls-rust
SharafMohamed
committed
a754e26
Update capture.
SharafMohamed
committed
95fd8f0
Remove helper method.
SharafMohamed
committed
072a941
Fix ambiguous utils.hpp include in macos by using relative path; Refactor unit-test.
SharafMohamed
committed
5012620
Fix delimiter ordering.
SharafMohamed
committed
862e724
Escape space at start of delimiters everywhere.
SharafMohamed
committed
6641e91
Fix CI task error.
SharafMohamed
committed
7d92e56

Commits on Jun 5, 2026

Bump log surgeon.
davidlion
committed
5182c83

Commits on Jun 9, 2026

bump log-surgeon
davidlion
committed
61baa0b

Commits on Jun 11, 2026

Commits on Jun 12, 2026

Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
cf8c06b
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
3fa467e
Merge remote-tracking branch 'upstream/main' into use-ls-rust
davidlion
committed
56af968
Merge branch 'use-ls-rust' into clpp
davidlion
committed
93c3873
Remove components/core/config from lint:yaml, which was missined in 9ef18efe8beb1cf8ea00954ced90e06e975bd5c1.
davidlion
committed
efc11e7
Missing format lint.
davidlion
committed
f597c58

Commits on Jun 14, 2026

Rename ruleset to parsing specification.
davidlion
committed
114c3a4

Commits on Jun 16, 2026

Commits on Jun 18, 2026

lint kql.hpp
davidlion
committed
7f308f5
bump log surgeon
davidlion
committed
b2f4eb7

Commits on Jun 19, 2026

boop
davidlion
committed
406c0c9
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
25e8ae9
Update stats; misc tweaks
davidlion
committed
de12358

Commits on Jun 22, 2026

Bump log surgeon; use parent pointer; update spec tempalte.
davidlion
committed
6430124

Commits on Jun 23, 2026

Add shape filtering; swap to function syntax; misc tweaks.
davidlion
committed
d4b103f
Prints to remove later.
davidlion
committed
1353eae
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
ecc8c0e

Commits on Jun 24, 2026

Bump log-surgeon; update heuristic spec.
davidlion
committed
f6c1c8e

Commits on Jun 25, 2026

bump log surgeon for parser reset call; log converter passing integration tests
davidlion
committed
7a0313a
ls jit on by default
davidlion
committed
2f21524

Commits on Jun 26, 2026

Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
8bb955c
drop from_chars for macos
davidlion
committed
d970d80
remove stats logging
davidlion
committed
91734fb
toolchains:rust tweak
davidlion
committed
a58cc97
fix docs reference
davidlion
committed
8297c28

Commits on Jul 7, 2026

properly escape log shape and update parent shapes accordingly.
davidlion
committed
813a260

Commits on Jul 8, 2026

Commits on Jul 9, 2026

Renaming.
davidlion
committed
4ac0523

Commits on Jul 13, 2026

Commits on Jul 16, 2026

Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
799920c
Revert "Bump log-surgeon." due to regression crash from
davidlion
committed
794b796

Commits on Jul 17, 2026

Large scale projection refactor.
davidlion
committed
9d45b9d
Remove dead code.
davidlion
committed
4ebca0e
Fixed some bugs introduced by projection refactor.
davidlion
committed
9aba6bb
Fix segfault when get_log_shape_dictionary returns null.
davidlion
committed
263a3b7
Improve experimental archive detection.
davidlion
committed
6541ae5
Improve stat printing/output.
davidlion
committed
e949ee3
Fix projection/search output leaking into extraction.
davidlion
committed
7ce8365

Commits on Jul 19, 2026

type -> shape for schema trea node name.
davidlion
committed
43b3d3e

Commits on Jul 20, 2026

Add fast_float dep.
davidlion
committed
0bed5cb
Add float encoding black list. Revert when encoding strategy is addressed.
davidlion
committed
a53c190
New heuristic spec.
davidlion
committed
062ba59
Fix format + openstack in heuristic.
davidlion
committed
37cad11
Forgot to add the update to .clang-format.
davidlion
committed
d54635c
Improved float regex for encoding.
davidlion
committed
bdbc454
Improved `stats.schema_tree`:
davidlion
committed
e204906
New float regex.
davidlion
committed
666aa49

Commits on Jul 21, 2026

Improve heuristic for openstack-style uuids.
davidlion
committed
d3055bb

Commits on Jul 22, 2026

Commits on Jul 24, 2026

Add num_archive_schemas metric.
davidlion
committed
9b70dc7

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Commits on Jul 29, 2026

Add num_clpp_interpretations search metric; Rename bytes_output to
davidlion
committed
18401a4

Commits on Aug 4, 2026

Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
299b4cf
Big profiler port + re-write.
davidlion
committed
28283fb

Commits on Aug 9, 2026

Profiler refactor / improvements.
davidlion
committed
36502d3

Commits on Aug 10, 2026

Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
fa601b2
Apply base profiling commits with cherry-pick.
davidlion
committed
41577d9
Fix ending newline.
davidlion
committed
c961e49
Add in a basic clp-s search metric.
davidlion
committed
a306fff
Merge remote-tracking branch 'upstream/main' into profiling
davidlion
committed
5834756
Switch to stub types; small refactor tweaks.
davidlion
committed
39e25ca

Commits on Aug 11, 2026

macro madness
davidlion
committed
972279e
Merge remote-tracking branch 'upstream/main' into profiling
davidlion
committed
53eeb4e
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
b4449e4
Merge branch 'profiling' into clpp
davidlion
committed
ff78441
Address code rabbit comments.
davidlion
committed
5dcdfa1
Avoid recursion UB by always copying/owning the full name; check name as part of cache key to handle sites with changing/variable names; still use cache to avoid concatenation."
davidlion
committed
22534c1
Merge remote-tracking branch 'upstream/main' into profiling
davidlion
committed
dbfe5c4
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
ad50edc
Merge branch 'profiling' into clpp
davidlion
committed
1b1ced1

Commits on Aug 14, 2026

Add SFA and indexer experimental support; Generate experimental version of clp_s tests.
davidlion
committed
52c21a9
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
58e612b
Missing format.
davidlion
committed
99e2e18

Commits on Aug 17, 2026

Update log-surgeon API and unit tests to match newest version.:
davidlion
committed
2f4b24d
Utility refactor.
davidlion
committed
ee046e2

Commits on Aug 20, 2026

Commits on Aug 21, 2026

Refactor open parent rule scope updating.
davidlion
committed
d71df7b

Commits on Aug 26, 2026

Integration tests with elasticsearch dataset.
davidlion
committed
6b92b8e

Commits on Sep 3, 2026

Forgot to remove when merging upstream profiler.
davidlion
committed
a2352d9

Commits on Sep 4, 2026

Change schema API and store log shape ID inside LogMessage unordered
davidlion
committed
b65e11a

Commits on Sep 9, 2026

Schema + search refactor.
davidlion
committed
816a027
Gate decomposition behind a compilation flag.
davidlion
committed
59c9712
Merge remote-tracking branch 'upstream/main' into clpp
davidlion
committed
037ec85

Commits on Sep 11, 2026

Commits on Sep 14, 2026

Tweak decomposition error handling.
davidlion
committed
b46a68a
Fixed field-name / left-side wildcard behaviour; minor refactoring.
davidlion
committed
6c72138
Revert "Tweak decomposition error handling."
davidlion
committed
772db1b

Commits on Sep 15, 2026

Remove old clp/clo/glt usage of log-surgeon.
davidlion
committed
7241c97
Remove old clp/clo/glt usage of log-surgeon.
davidlion
committed
236e4b1

Commits on Sep 16, 2026

Remove some remaining snippets outside of log-converter.
davidlion
committed
33d0d68
Missed deleting file.
davidlion
committed
d13f79a

Commits on Sep 17, 2026

Commits on Sep 18, 2026

Remove profiling redefinition in cmakelists that wasn't removed when
davidlion
committed
2e960ca
Address some review comments.
davidlion
committed
1576180

Commits on Sep 21, 2026

Correctly handle the positions of leaf queries from decomposition.
davidlion
committed
54ead04
Docs pass.
davidlion
committed
901068c
Minor review grammar.
davidlion
committed
b95acc4

Commits on Sep 22, 2026

Misc review comments.
davidlion
committed
5d80f6d

Commits on Sep 23, 2026

Lift int wildcard filter path before operand conversion to avoid
davidlion
committed
553b551

Commits on Sep 25, 2026

Commits on Sep 28, 2026