Olivia Wilde gave birth to her first child at age 30 and her second child at age 32