We have set of pytest scripts that take some parameters, spin up a kubernetes cluster, run some API tests and then report the performance metrics (like time for each step, CPU and memory utilization) in a XML file. We need a framework (along with setup and source code) that can do the following :-
1. Run these scripts with variable parameters of load (these are parameters to script)
2. Integrate with Circle CI so these scripts can be run on commits/nightly/release.
3. Store logs and create historical (or atleast last 5 runs) charts/dashboard which link to logs such that we can diff whether a particular day/release/commit caused an improvement in performance or not.
We will screen the applications based on using as much open source technology/frameworks as possible, and writing minimal custom code.
Please specify the technologies you would be using 1 2 3 and a rough design. Also mention similar experience in the past, as well as the delivery time.