Constraining the paleogeography of the Ediacaran is crucial for understanding the extensive tectonic, biological and geochemical changes that occurred during that epoch. Paleomagnetism is an essential tool for reconstructing the Ediacaran paleogeography but it is complicated because the paleomagnetic data of that age display unusually fast and large directional oscillations. Two main competing hypotheses have been proposed: the occurrence of very fast True Polar Wander (TPW) episodes, which correspond to the motion of the planetary spin axis relative to the solid Earth, or strong geomagnetic field disturbances that could potentially be dominated by an equatorial dipole field. Their implications for paleogeographic reconstructions are radically different as TPW would result in a major latitudinal shift of continents of up to ∼ 90°. In this study, we focus on one rapid paleomagnetic change recorded in pyroclastic rocks of the Ouarzazate Group in the Anti-Atlas Belt (Morocco) that has been interpreted to reflect an exceptionally fast episode of True Polar Wander between ∼ 575 and 565 Ma. To further test this hypothesis, tight constraints on the rate of the paleomagnetic directional change are needed, as TPW is speed-limited by mantle viscosity. Here, we present high-resolution Chemical Abrasion Isotope-Dilution Thermal Ionization Mass Spectrometry (CA-ID-TIMS) U-Pb dates on zircons from seven pyroclastic levels distributed stratigraphically below, in between and above the horizons where the large paleomagnetic change is observed. Based on these new data, we estimate the associated lower bound rate of the apparent polar motion related to this abrupt paleomagnetic change to be 11.6°/Myrs [5.5 – 17.9]. This value is much higher than the TPW speed limit estimated from numerical simulations, suggesting that this large paleomagnetic change cannot be explained by TPW. It could rather be associated with intense perturbations of the Ediacaran geomagnetic field potentially oscillating from an axial to an equatorial dipole. The paleomagnetic pole that we interpret as referring to the axial dipole field would imply that West Africa was located at high latitude during the mid-Ediacaran.