When I was younger and sillier, I threw a banana skin into the river above the lower Yosemite falls in order to watch it cascade into the plunge pool below. The people in the pool below shouted at me for littering. I didn't understand because, as far as I could tell, the item was compostable.
I learned: A) The item was not native to the area B) It could attract bears C) Despite being compostable, it would take years to degrade
I agree with what you're saying, ultimately if it can decompose it should be all good. There are other factors to take into account, however, such as cleanliness and contamination.
Apologies, I assumed you meant using waste, i.e. packaging materials that are not easily reused, to ensure food safety. Glass is great in comparison to plastic.