Enable parallel task execution #138
Description
Is your feature request related to a problem? Please describe
Right now, all my tasks execute serially. This can cause 30+ minute delays from when I ask UDS to create my test cluster, create the test bundle, and then deploy it. My system isn't the bottleneck, the registries I'm pulling from are. If those tasks were executed in parallel, I'd reduce my iteration time dramatically.
Yes, in theory, I only need to create my cluster once a day, or even once a week, but in practice, it's not infrequent that I do a total cluster wipe to ensure the problem is not left-over state from an old deploy.
Describe the solution you'd like
We can put tasks into a parallel block of yaml or similar to make it clear they should be executed in parallel. I'd take inspiration from the kubectl --prefix flag used when streaming logs and by default tell me which task the log was generated by.
Describe alternatives you've considered
I can manually run the tasks in parallel in separate terminals, however, this limits the benefit to my machine and requires a level of toil/manual repetitive work. This solution would also allow the top-level tasks to run faster in CI (UDS packages/bundles often have 30-60 minute runtimes) as well as on everyone else's machine.
Additional context
- This sounds similar to but is different from Run background tasks #131