Block is actually fine for a one-handed + shield build, especially on Survival where you're taking more chip damage anyway. The issue is people compare it to Smithing or Destruction like those are the only viable damage paths, which is kind of missing the point if you're already enjoying the playstyle.
The perks that matter: the early ones that reduce stamina cost and increase damage when you bash are solid. There's also one down the tree that staggers enemies when you block, which is genuinely useful for crowd control. The later stuff gets spicier too - you can eventually reflect spells back at enemies, which feels way better than it sounds.
Real talk though - you're on Switch, so you can't grab mods that would make Block feel more impactful (like the overhauls that give shield perks more personality). Vanilla Block scales okay but it's not flashy. If you're level 22 and already committed to it though, I'd keep going. Respeccing perks mid-run is annoying, and you'll hit a point where it just works. Pair it with decent one-handed damage and you're golden.
Don't pump everything into Block - grab a few key perks and let your gear do the heavy lifting. That's where Smithing actually helps you, not instead of Block.