GSource is not a GObject and has its own ref/unref functions

Testing Done:
Ran the unit tests.

Reviewed at https://reviews.imfreedom.org/r/273/