ATC gives speed restrictions on departure, but then never lifts them

Whenever they give me a new altitude without the speed restriction, I considered the restriction lifted since every time before that, they would repeat the same restriction or a new restriction.