One more possible point for you, perhaps you could discuss with him that since your time together is so limited, terminating a conversation, should not be used as a punishment. He may be more amenable to listening if you call it a punishment rather than blackmail. When he is trying to push your limits he can use some other more acceptable "punishment" to create a dilemma for you. Open the shutters or forgo any orgasms that day. He would probably achieve the same result without halting the development of your relationship - for your relationship cannot grow if you don't have contact with each other.