"C.G.A." is Canadian Garrison Artillery, as opposed to "R.C.A.", "Royal Canadian Artillery". "Garrison" meaning they manned fortifications such as the Halifax Citadel, Fort Rodd near Victoria, etc. The "R.G.A." did not entirely pull out of Canadauntil 1906 I believe. I thought I had a postcard of them marching down to the docks in Victoria, but can't find the photo at the moment.
Here's a photo that was on eBay of them and some Canadian troops building a bridge across Esquimalt Lagoon in 1905/6. Note the much-hated Germanstyle caps that only lasted a year or two before they were withdrawn.
And an Christmas poster as well.
Attachment 38690
Attachment 38691