for t in countup(0.0, 1.0, 0.1):
Is there an alternative function in the standard library I should be looking for?
The docs aren't wrong. They state 'Counts from ordinal value a up to b with the given step count.' OK, 'step count' is confusing, it should really just be 'step'. But that's not your issue, yours is that floats are not ordinals.
Be careful and test whatever you write, because floating point ranges like this are vulnerable to being off on account of floating point inaccuracies. For example, if your generator code is roughly
iterator countup*(a: float, b: float, step = 1.0): float {.inline.} =
var res:float = a
while res <= b:
yield res
res += step
then
for t in countup(0.0, 0.6, 0.2):
echo(t)
will not print the 0.6 (on my machine) because of innacuracies.