Our Gemara on Amud Aleph Speaks of the manner in which the wood of the Succah becomes set aside and holy for the mitzvah, and cannot be used for any other purpose during the holiday.

There is a powerful Shalah (עשרת הדברות, מסכת סוכה, נר מצוה כ) Who relates experiences he had from his own Rebbe, which he ties into the teachings of this gemara:

The Shalah starts out with a reminder of the importance of not speaking idle words in Shul. He’s not referring to during prayer, he simply refers to recognizing and feeling the holiness of the place. He then goes on to describe how his Rebbe was so mindful of holiness that he would never speak idle words inside the Succah, as he derived from our Gemara that the very wood of the Succah was  holy during the seven days of the holiday. By the way, this includes the walls as well as the Sechach (see Shulkhan Arukh OH 638:1).

There are all kinds of reasons why we talk during Davening. But, like most inappropriate acting out, and talking in a sacred place is certainly acting out, it is passive aggressive. What is passive aggressive here? Maybe we don’t like the rabbi and his speech is too long and droning, maybe we do not like the particular length and tempo of the service, or perhaps we’re just plain angry with God for not listening to our prayers.

The point is that passive aggressiveness is a regression to an Infantile state where we feel powerless and unable to address our concerns in a direct and healthfully assertive manner. It makes sense when it comes to religion we will regress to that infantile state where we feel powerless because can we really complain to the rabbi, let alone to God? Indeed Iyov (9:13-20) complains that it’s difficult to get a fair trial, when you are arguing with God.

Nevertheless, we are not powerless at all. The truth is nobody’s forcing us to go to Shul, and no one is forcing us to stay if we don’t like it. In fact God famously proclaims in Yeshayahu’s voice (Isaiah 1:11-14):

לָמָּה־לִּ֤י רֹב־זִבְחֵיכֶם֙ יֹאמַ֣ר יְהוָ֔ה “What need have I of all your sacrifices?” 

כִּ֣י תָבֹ֔אוּ לֵרָא֖וֹת פָּנָ֑י מִי־בִקֵּ֥שׁ זֹ֛את מִיֶּדְכֶ֖ם רְמֹ֥ס חֲצֵרָֽי׃ That you come to appear before Me— Who asked that of you? Trample My courts

חָדְשֵׁיכֶ֤ם וּמוֹעֲדֵיכֶם֙ שָׂנְאָ֣ה נַפְשִׁ֔י הָי֥וּ עָלַ֖י לָטֹ֑רַח נִלְאֵ֖יתִי נְשֹֽׂא׃ Your new moons and fixed seasons Fill Me with loathing; They are become a burden to Me, I cannot endure them.

This was the state of affairs in the time of Yeshaiyahu.  God didn’t want or need Jews just showing up at the Temple without sincerity.

Much better to stay in shul only for whatever time you can, and not pray a word, if need be. You could just keep your mouth closed to recognize the holiness of the Place.  Leave when you lose your patience but don’t talk.  If you accustom yourself to the recognize the holiness of the place, one day you will come to truly pray there as well.