Found in 1 comment on Hacker News
mindcrime · 2022-10-20 · Original thread
Sounds like you want a book that would typically be titled "Design of Experiments" or "Experiment Design" or something similar. There are tons of them on the market[1][2][3][4], probably any mainstream one used for a university course on the subject would be adequate.

Here's a freely available book / lecture notes doc that covers some of the ground you're interested in.

http://www.stat.rice.edu/~dobelman/courses/texts/Notes.411_6...

[1]: https://www.amazon.com/Design-Analysis-Experiments-Springer-...

[2]: https://www.amazon.com/Design-Experiments-Mike-Peralta/dp/14...

[3]: https://www.amazon.com/Design-Experiments-Approach-Bradley-J...

[4]: https://www.amazon.com/Design-Analysis-Experiments-Douglas-M...

Fresh book recommendations delivered straight to your inbox every Thursday.