Hi Jan,
they do look like some Colembola species and I am nearly certain thats what they are.
You said they do not jump, but not all Colembola have furcula and can jump.
They are harmless to your milimpedes and VERY beneficial to the terrarium.
They feed on decaying matter and fungi limiting or eliminating molds.
Regards
--
Remy