In the finale dirctly after Edith and Bertie's wedding, Lady Hexam is sitting with Marigold, Sybbie and the other bridesmaid, and Marigold clearly says "Daddy". Bertie's mother must be teaching her to say it, so that that is what she calls Bertie when they all live together.
A lovely scene!