More than likely it’s buildups of marine life deposits considering it’s an island. Phosphates are usually mined from naturally occurring porous stones that phosphorus has diffused through over a long period of time.

Guano has some phosphates in it, but is usually sought after for its high nitrogen content, and is typically located near coastal areas or caves as opposed to remote islands.