Should I worry about 3 day old newborn kittens not getting enough milk if they're with their mother?
Mothers know best. They'll be fine.
If the mother hasn't completely stopped feeding them they are fine,
If they're not and they get too small. Then yes. I think you should worry anyways. Kittens should be getting the necessary amount of milk.