Initially, I had that with mine. Ended up putting in a large sunken patio so it didn't feel so tight walking out the door. Patio has a 2nd drain to help with water...but I'll state that my winters typically build up a ton of ice.
In either case...Water never comes into my game room / basement.
In these pics...The first one where the black tar is on the wall, this was covered with dirt.
Afterwards, I just painted it