Skip to content

feat(otel): log data model, per-record pipeline convention and OTLP support - #400

Open
medcl wants to merge 4 commits into
mainfrom
feat/otel-log-pipeline
Open

feat(otel): log data model, per-record pipeline convention and OTLP support#400
medcl wants to merge 4 commits into
mainfrom
feat/otel-log-pipeline

Conversation

@medcl

@medcl medcl commented Aug 15, 2026

Copy link
Copy Markdown
Member

What does this PR do

Rationale for this change

Standards checklist

  • The PR title is descriptive
  • The commit messages are semantic
  • Necessary tests are added
  • Updated the release notes
  • Necessary documents have been added if this is a new feature
  • Performance tests checked, no obvious performance degradation

medcl added 4 commits August 15, 2026 11:59
…RPC transport

- core/otel: canonical LogRecord aligned with the OpenTelemetry Logs
  Data Model with lowercase snake_case field naming, event.Event
  interconversion, and the queue envelope codec (agent LogEvent JSON
  compatible)
- core/pipeline: RecordContextKey/CurrentRecord per-record convention
  plus MarkDropped/IsDropped drop markers; processor config metadata
  registry (RegisterProcessorPluginWithConfigMetadata,
  GetProcessorMetadata)
- modules/pipeline: for_each processor (batch -> per-record sub-chain,
  drop-aware) and GET /pipeline/processors discovery endpoint
- plugins/otlp: OTLP protobuf codec (resource-grouped
  ExportLogsServiceRequest <-> events) and the otlp_export processor
  (batched gRPC export, unacknowledged-on-failure for redelivery)
- core/api/websocket/reverse: restore the reverse channel protocol
  helpers lost from the working tree (from 77a377a)
- deps: go.opentelemetry.io/proto/otlp, grpc, maxminddb (enterprise
  processors), httprouter go.sum
(missed from the previous commit's file list)
- plugins/otlp/{codec,export} relocated to plugins/enterprise/otlp
  (private checkout, gitignored) alongside the gRPC intake module
- add core/shipper: registry for queue-free direct shipping, used by
  the enterprise otlp shipper and the agent's ship_direct mode
- go.mod/go.sum: indirect deps pulled in by the enterprise tree
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant