A lot of recipes call to cook garlic first and infuse oils before the rest of the cooking, but if the garlic cooks too much you lose the flavour.

I think you’re right on adding it at the end