it wont hurt anything to leave those out as long as the center shelf remains, the center shelf is whats important.
I likely have a set of those old vertical dividers, if so you can have them for free for the shipping if you just gotta have them and are losing sleep over it.