Generally works when you flick it. Ones its on, there is no issue. There is an easy fix by using a jumper (P13) inside to power up from the mains, bypassing the button.
eBay