From what I know, OSC in X32 is implemented to control the device, not to control DAW by device. If that is true, there is no settings in X32 to specify AZ Controller address. At the moment, AZ Controller is also not able to initiate connection to X32.
You can think as about remote controlling TV from DVD player. Both have infra-red receivers, but they are not prepared to control each other, they both expecting "controlling device".
I have an idea how that can be done. I put that into future plans, but please remind me at the beginning of October if you see no changes till that time.