You can be inadmissible to Canada because your spouse is. This is Canadian version of the “sins of the fathers to be visited upon the sons” kind of thing. In the Canadian case, however, the “sins” of one spouse will be visited on their immigrating spouse. Luckily, not all is lost.