Why to use where clause even when Having can be used for the same purpose?

It is known that Having clause works same as where clause but where clause only works with present table columns and not aggregate columns.

Can we always use Having and is there some specific functionality which where is preferable than having, like performance issues?