The 40-year-old actor - who has children Violet, six, Seraphina, three, and seven-month-old Samuel with wife Jennifer Garner - sported facial hair for his role as CIA specialist Tony Mendez in 'Argo' and he admits his new look didn't go down well at home.
He said: "My family unanimously hated the look. There was a united front and my littlest daughter said, 'Can't you shave your prickles. ' I said, 'I have to wear this for work.'
"My daughter said, 'What kind of work would want you to look like this?'"
Ben admitted he had mixed feelings about his beard, finding it "cool" some days but worrying he looked like Bee Gees star Barry Gibb at other moments.
He said: "Sometimes it looked cool like Kurt Russell in one those early '80s movies, but sometimes I looked like Barry Gibb.
"The hair and the beard were no joke. There were definitely some mornings when I thought, 'Can't Tony just get a haircut?'
"I know my hair didn't impress anybody. You know, you can't cheat. You've got to do it right. While nobody says they thought it looked great, nobody says they didn't think it was realistic, either."