By being quiet, and by suffering in pain by yourself with your feelings, you are letting him win...God's word tells us to not stand silent when someone is hurting themselves through the things they do but to confront them with love, mercy, compassion, and truth. So all I say is keep praying for guidance and when you can talk to him when it's just the two of you...tell him the opposite of what your saying in your post...because I'm sure underneath what you are saying about hating him, I'm sure there is plenty of worry...I've been going through the same thing with my little brother and this is a lesson that I'm still eating. But God will help you and guide you with what you will need to do.

Hey dude, remember this: You can't let it get you down. Anything and everything that is ever bothering you... give it to God. He wants you to turn to him. You are not your brother, don't confuse that, don't be ashamed. We all know people like your brother. The closer you are to God the better- NOTHING is better. Your brother will see where you are in you life with God. So keep God leading you wherever you go. -In Christ

God is there with you always. It is truly hard to love someone that you feel it is impossible to care for, i had a big problem with my brother until one day he told me he won't go to church becuase of hypocrits like me... That changed me, deep down I love my brother and I know you love yours as well. Don't let hate consume you, this is the devil's only advantage to attack our weak points where we start to doubt ourselves. My life verse Acts 2:25 I saw the Lord always before me, becuase he is at my right hand I will not be shaken. Show your brother what God's true love is about. God Bless