No, I have not built a house. However, I highly recommend you take a look at two books before you move earth.

The first is "House" by Tracy Kidder.

https://www.amazon.com/House-Tracy-Kidder/dp/0618001913

The second is "Renovation" by Michael Litchfield.

https://www.amazon.com/Renovation-4th-Completely-Revised-Upd...

The first book is a detailed, engrossing narrative about building an actual house (it exists). The second book is a renowned compendium of all things in home renovation.

As a quick commentary on your idea, go check out RSMean's cost estimations. It gives you a ballpark estimate of cost per square foot for, say, poured concrete with rebar. You are going to need rebar because concrete is brittle and it cannot carry tension. You are going to need steel framing because concrete floors are damn heavy. With wood, you can use much, much cheaper standard wood framing. Rebar is expensive because you need to be a metalworker to do it properly. It is likely you will not be able to do it DIY because of building codes. The rabbit hole goes on and on. Good luck with your research!

https://www.rsmeans.com/

I can't find the link right now, but someone recommended this book in another thread:

http://www.amazon.com/Renovation-4th-Edition-Completely-Revi...