If you're looking for statistical significance, you need at least 20 trials with each load.

Unless you're talking waaaaay out yonder, small velocity variation and accuracy aren't necessarily paired. Now, out yonder, velocity variation can cause significant vertical spread. At 1000 yards, 100 f/s difference can cause a vertical spread measured in feet.

Back when my eyes were young, I compared factory .44 Magnum to my handloads. I didn't have a chrono, but was well aware I wasn't getting factory velocity. At 100 yards, factory did 14 inch groups, the handload 7 inch groups. Wasn't a hard decision and I never bounced a bullet off a deer. I now have a chrono, the handloads run bout 1200 f/s for a 240 gr Remington JHP. No factory to test.