[otap-dataflow] validation framework live update test

[c1ly]

Pre-filing checklist

• I searched existing issues and didn't find a duplicate

Component(s)

Rust OTAP dataflow (rust/otap-dataflow/)

Is your feature request related to a problem?

Currently there is no consistent way of testing the live update feature in a real scenario, as we make updates to the live update feature we should have a strong method of testing the different use cases such as targeted live update (only updating one node)

Proposed Solution

The proposal is to update the Validation Framework to be able to define multiple Scenarios in one test and using the live update feature to transition between each Scenario.

Currently a validation scenario takes a Pipeline (system under validation), Generator (data generation), and a Capture (validation ), The proposed solution would allow extend this so that a validation test allows for multiple Pipeline definitions and use the live update feature to transition between these test stages rather than shutting down the engine and bringing it back up again between runs.

This feature update should allow users to

• define multiple system under validations
• define targeted nodes to update for a system under validation pipeline
• define validation assertions for each stage
  per validation test

Alternatives Considered

No response

Additional Context

No response