In this case, check in the Options Tab that you do NOT set corresponding hardware control type to "Pad". Set it to any other ("Unknown"/"Rotary"/"Slider"), do not forget to "Save" after change. Normally buttons are "pads", but normally they send "1.0" when pressed and "0.0" when released. In your case that is different (the same reason as I have mentioned before, OSC part of X32 was NOT thought to be as DAW control) and so there are several "tricks".
After that, logical control should should with any value, also "0.0", and "Toggle" should work fine.