In a medium saucepan add brown sugar, granulated sugar, butter, egg yolks, and evaporated milk. Stir to combine and bring the mixture to a low boil over medium heat. Stir constantly for several minutes until the mixture begins to thicken.

Remove from heat and stir in vanilla, nuts and coconut. Allow to cool completely before layering it on the cake.