If you leave from Hillarys you need to avoid the first set of rocks and then when you get out to the island look for the two yellow markers that guide you past the shallow reef. Once past the island you will find the break. (It's hidden under my squiggles.)
On the maps it looks like there are four markers. Are these the one you mentioned or are they different ones?