The solution resides nearby, in 2 bookshelves and benches you can read.
One gives you a guide on how goblins see colors.
The other is goblin gibberish that mentions said colors.

The color mappings are as follows :
- Zwify : red
- Niatsy : blue
- Yafalouz : yellow
- Histawi : green

The order in which to pull the levers is exactly as follows :
Green, Blue, Yellow, Red, Green