On certain families of special cycles on Shimura varieties