No, that’s not the right size. Depending on the size, the Venu 4 comes as standard with an 18 mm strap for the 41 mm model or a 22 mm strap for the 45 mm model – not 20 mm.
The quick-change wristband with a width of 20 mm is specially designed for the Garmin Venu SQ and Venu SQ Music. It is not directly compatible with the Garmin Venu 2 Plus, as this may have a slightly different bridge width, as mentioned in some reports. If you are looking for a black replacement strap for the Garmin Venu 2 Plus, you should look for specific straps for this model.