Use foam Backer Rod to fill in the expansion joint below the caulking. Buy the size that is slightly larger than the width of your expansion joint. If the joint has uneven widths, use a razor knife to slice the backer rod into smaller widths, or buy more than one size backer rod. Measure your pool perimeter for the proper length, and buy a little extra. Sold by the foot