In physics there is a rich literature documenting its history. And as you mentioned, it is scattered around books, periodicals and scientific journals. A very small selection for you and any people interested:

From Emilio Segre (Nobel Laureate) there is this 2 book series.Recommended. - From Falling Bodies to Radio Waves [1] - From X-rays to Quarks [2]

Then, you have Abraham Pais, all his books are highly recommended, I will include 2 here

[3] Subtle is the lord (Best Einstein Scientific Biography) [4] Inward Bound (Superb Scientific history of XX century physics)

Jagdish Mehra wrote a gargantuan history of Quantum Mechanics in six volumes. He studied and /or interviewed most of the big hitters who developed the theory. The science content is high so you need a good foundation.

[5] The Historical Development of Quantum Theory

Richard Westfall wrote the best Newton biography that I know.

[6] Never at Rest: A Biography of Isaac Newton

Finally the issue number 2 of the 72nd volume of Review of Modern Physics [7] is a gem; packed with historical reviews of the development of all fields in physics during the 20th century, written by eminent people.

Of course this is just a minuscule sample of an extraordinary bibliography. Sadly life is so short to make it justice.

[1] https://www.amazon.com/gp/product/0486458083 [2] https://www.amazon.com/gp/product/0486457834 [3] https://www.amazon.com/dp/019853907X [4] https://www.amazon.com/dp/0198519974 [5]https://www.amazon.com/Historical-Development-Quantum-Theory... [6] https://www.amazon.com/dp/0521274354 [7] https://journals.aps.org/rmp/issues/71/2