BufferedReader is just waiting for the Clients response and not reflecting the code written above in actionPerformed

I'm making a 2 player game using socket programming where I'm sending the moves as data from server to client and vice versa but when a move is made on server side, it still waits for the move of client side (Until data is not received from client side) and the changes made above the line of receiving data inside actionPerformed is not getting reflected.

Here is the declaration for BufferedReader:

BufferedReader br = new BufferedReader(new InputStreamReader(socket.getInputStream()));

and here is the code where I'm facing problem:

public void actionPerformed(ActionEvent e) {

// some changes made like changing the color of buttons, adding texts on them, etc

String temp, move = "";
try {
    while ((temp = br.readLine()) != null) {
        move += temp;
    }} catch (IOException ee) {
    System.out.println("Error in reading the move from player 2");
}

Here is the starting state of the game:
Game Starting State

Here is the state which should occur after making a move (captured this state after removing that code of BufferedReader):
State which should occur

Here is the state which I'm getting (See here the button is seen is pressed mode and other changes are not reflecting):
State which is occuring

Can anyone help me with the solution!!!

You're calling this code which is blocking code:

while ((temp = br.readLine()) != null) {

on the Swing event thread. When you do this, you block this thread from doing its important actions such as drawing the GUI, and this will cause your GUI to freeze. To prevent this from happening, such calls must be made within a background thread so as not to block the GUI's important event thread. Swing has a SwingWorker class that facilitates this, and I suggest that you look into using it. Please check out Lesson: Concurrency in Swing for the details.