Your Site can be penalized by

1. Panda Algo
2. Penguine Algo
3. Mobile Update

to recover from panda update you have to remove the copied content, doorway pages, link farming etc.
to recover from penguin update you have to remove the spamming linking and un-natural linking, paid links
to recover form mobile update you have to make a website mobile friendly and loads faster