If you lose a normal encounter, you continue playing.
If you lose a quest step encounter, unless otherwise stated, you lose the game and cannot continue. A tip: make sure to use your guild assist, if it's the difference between winning or losing a quest step encounter!