Although it is correct to use 'where' in these sentences, it is more common (especially in the United States) to use 'at' when talking about where we are staying:

The hotel where we stayed  was very comfortable

The hotel we stayed at was very comfortable