When they received the message from the Bai and Zhao families, asking them to meet at Shi Yan Zhai, they understood that the two families had decided to compromise with the Yan family.

Otherwise, why would the meeting be held at Shi Yan Zhai instead of Jin Hong Tower?

That was Yan family's territory. Holding a meeting there was equivalent to making everything transparent to the Yan family.

Since the two families had made their decision, they had no choice but to accept this fate.