Use panel_window instead of directly accessing the struct member

This is necessary to fix a FTBFS in Debian. For more information see
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1057570.

Testing Done:
Compiled and ran `test/focus` without issue.

Reviewed at https://reviews.imfreedom.org/r/2883/