This is due to how materials interact with each other. You’re going from a matte material to a really glossy material. This results in artifacts where the two materials meet.
What you can do is make a few intermediate materials that blend between the two extreme ones. For example, if the first material has a specularity of 0 and the target has a value of 100, then you’d want other materials that have 25, 50 and 75. You would then paint the surface with the 25, move in a little and paint the 50, then the 75, and finally end up with the 100. This gives a much more gradual blending between the materials, eliminating the artifacts.
Of course, the easiest solution is to not have drastically different materials on the same surface. Instead, use natural breaks in your model to switch materials so that the seams aren’t visible.