What's worth ignoring?

I was wondering. I’m prototyping a little thingy (mostly in the sake of these amazing videos) and i have a bunch of assets imported. Lots of them are HUGE. And I feel like it might not be necessary to stage huge tga files, .waws or .mp3s … buuut. How do I know? I mean, i mostly work scripts, prefabs, thus sceens too. BUT: If i have an asset folder, containing all of those mentioned above… How would i know if its worth it ignoring as a whole? I mean. Is there any general attitude as to ignoring .fbx and .tga or do I have to really think hard about if need them staged? Thanks alot, have a great day!