The keystone of any relationship is trust. Tell him. Do not put it off, tell him ASAP!

You did something silly when you forgot to take your pill. You did something even sillier when you didn't tell him you forgot your pill (he could have used a condom, to reduce the chances of pregnancy). Don't compound the problem by being even sillier still and breaking trust.