As your speed goes up so does the penalty for armor. See these two rules entries: (links go to AoN)
Bonuses to Speed: Always apply any modifiers to a character’s speed before adjusting the character’s speed based on armor or encumbrance, and remember that multiple bonuses of the same type to a character’s speed don’t stack. (Core Rulebook, p. 192)