Repository navigation
how to execute 2 branch components concurrently #3523
Description
Activity
i can not found any answer from the help doc, i try the "parallel" component, but can not take effect. how should i do?
Hey @lizhe19, messages need to be batched if you want the
parallelprocessor to have any effect. Since you have your processors in thepipelinesection, they'll be executed in parallel according topipeline.threads(see docs here). However, I guess you have a single message in there, given thatgenerate.countis set to 1 (your sample yaml is not well formatted). You can set that to a higher value and get rid of theparallelprocessor. Alternatively, if you do have some other input which uses batching (or if you setgenerate.countandgenerate.batch_sizeto a values bigger than 1), you can make use of theparallelprocessor as well, but note that you'd get 2 levels of parallelism in that case if your processors are within thepipelinesection.LE: Transferring this to a discussion as per #2026.
- 你好...谢谢你的邮件 我已收到！
- locked and limited conversation to collaborators
on Jul 7, 2025
input:
generate:
mapping: root = {"reqCode":"123456","data":"info"}
interval: 0s
count: 1
pipeline:
processors:
- mapping: |
meta start = timestamp_unix_milli()
- log:
level: INFO
message: 'once requet record start time：${!now().ts_format("2006-01-02 15:04:05")}'
- parallel:
cap: 0
processors:
- branch:
processors:
- http:
headers:
Content-Type: application/json; charset=UTF-8
TEST: test
url: http://172.32.6.25:9357/test/http2
verb: POST
timeout: 30s
parallel: true
- catch:
- log:
level: ERROR
message: "request execption,request body=${!content()}"
- branch:
processors:
- http:
headers:
Content-Type: application/json; charset=UTF-8
TEST: test
url: http://172.32.6.25:9357/test/http3
verb: POST
timeout: 30s
parallel: true
- catch:
- log:
level: ERROR
message: "request execption,request body=${!content()}"
- log:
level: INFO
message: 'once request used time total：${!(timestamp_unix_milli() - metadata("start"))}ms'
output:
stdout: {}