This is something that never even came to mind. Thinking this way will save a lot of time and project work.
What I want in the Scene-
Candles
Benches
Chandler
Tables
Stain Glass Windows
Books
Rugs
Alters
Tapestry
What I need -
Walls
Floors
Roof
Doorways
Windows
Everything other than the need. Just adds to the LOD.