Matt,
SSI is not welfare. It's insurance and you only get it if you are disabled and qualify. If you apply for Social Security Disability and are eventually granted, then the SSI benefits will be repaid from your Social Security back pay.
The longer you wait to apply, the more money you are leaving on the table. It can't hurt to at least go down to the SS office and find out.