Yup can be done. See the link above so I don't have to retype everything. I don't like belly bands. Sorry. They absorb and hide and you don't catch the dog in the act of peeing. You will miss the timing of when the pee comes out or the leg starts to rise, correct, and redirect outside. Leash in the house at all times, no exceptions. Put on an "umbilical cord" at all times. Use a snap and attach leash to your belt loop. Does he pee in his crate? Just curious. some do. If they pee in the crate, they get no bedding in the crate until they are not having any more problems. I have house broken many older dogs and guided many folks on how to do it. clean up using natures miracle. Skip the bellybands, keep dog on a leash or in the crate, 100% supervision or confinement. Get rid of the pee pee pads, they teach the dogs that it is ok to pee in the house on something absorbant. Lots of praise and don't let the pup see you clean it up and never scold or show him the pee. Just praise for doing it right.
Do you have another dog in the house to show him how it is done? Helps a lot. If not, "borrow" a friends dog for a doggie visit. Pick one that is well housebroken. Take dogs out together to do business. Praise. You MUST go out with these dogs on a lead and not allow them to "free roam" the yard. Potty business can be a command like any other. I say "hurry up" because it makes me feel better on a cold day. I recently housebroke a 12 week old pup in one easy afternoon using my collie as a "show me" dog. My bonnie was 6 years old, she peed on her former owners bed, pillows and sofa and all over his house. DIdnt know how to walk on a lead or go outside. One year later, she is reliable and we only rarely have an accident. Usually my fault when we do have an accident like a stinky barn coat left on the floor is much too irresistable. typing fast, sorry if I repeat anything or this sounds rushed.
ps... just thought of something. Since he is a little dog and you are used to big or medium dogs... I just wanted to add here that you should treat him like a big dog. Feet on floor leash walk, no picking him up and carrying him around like a baby. He has feet, he should use them. No dressing him up in clothes either. Sorry, some folks treat little dogs like babies and they turn into tyrants. I have had tiny little dogs and they walk on a leash just like the big guys do, unless I think they are in mortal danger, I don't pick them up. Attitude and alpha helps with the the "I am boss guy pee on everything macho tiny dog" syndrome. haha. Like that description. I had a toy dog puppy once that weighed 1.6 lbs at 8 weeks and marched up to a 90 pound rotweiller and bit him on the nose. Rottie backed away and a tyrant was born. take care and bless you for adopting a special needs dog.