I don't think it is possible to get stronger without gaining at least a little muscle. Your fears are ungrounded as it would be very difficult and you would need to try very hard to have large bodybuilder muscles.