The Duke and Duchess of Sussex were dubbed a "laughing stock" among their neighbours in Montecito, California.