Here's my Min/max build to eliminate all the shortcomings, and enhance all the advantages of going unarmored:
Skyrim Perk Calculator - Plan the perks for your Skyrim character before spending them! Alteration for Detect Life/Undead, and Paralysis (assuming you don't want to use _Flesh Spells) with a little Magic Resistance so you don't get caught slowed out of reach by Ice Spikes. Sneak to take advantage of no Weapon/Armor noise, and use the Silent Roll/Critical Charge combo. Alchemy maxed for both Poison, and healing since you'll need both. Savage Strike, Dual Flurry/Savagery to get the most damage out of the Double Power Attack, and offhand Reposte' for breaking Charges/block. Paralyzing Strike because when it does go off, it's a fight ender, if you're backpedaling, then you're probably facing a 2hander with Reach on you, and a 1hk on your unarmored @$$. Conjuration splashed in for Bound Sword early on, when you need it most, and Soul Stealer to get your Enchantment up. I'd Smith first, then Enchant, so you done need Arcane, disenchant the magical ones you find for the effects to make your own combo. Do the College for the Drainheart Swords, Drainblood Axe, and staffs for shooting down Dragons before getting the Rend shout. Possibly the DBH for the most powerful dagger, with healing, and Windshear, which can be Smithed, then enchanted for maximum Affects. (Stagger, Critical Chance, Cold, Stamina Damage, Firey Soul Trap, and possibly Paralyze on a retreating power attack all in 1 hand!) Plus whatever you have in the other, and any poison effects you might use. I like Lingering Damage Health, and Weakness to Poison for Critical Charge, or Backstab, then Wuld away to let them die. Slow/Paralysis is optional. Since it's Steel Tier, it can be improved with 1 perk in Smithing. Get either Uthgerd/Mjoll and Volendrung, or Jenassa/Eola as followers so you have someone to wear all the armor you grind up to train Smithing/Enchanting.
For Factions, Companions first for the best Steel you can get/improve, then DBH for the Hood, Shoes, Handwraps (Eventually upgrade for the Jester's/Cicero's set) BoW, and Windshear. Grimsever to get Mjoll, then Forelhost, and The Cursed Tribe to kit her out for assisting your assault on the enemy's Stamina. Maybe Liars Retreat as soon as you can double enchant a better hammer than Volendrung. Then, the Main Quest/College of Winterhold so you can get the Gauldur Amulet, Lightning Staff, Drain_ Weapons to disenchant and Blackblade (Leveled.) Finally, the TG for the Nightingale Blade, Chillrend, and experience. I'd also do The Taste of Death for a good Nightblade/Necroknight follower, and The Ring of Namira (Excellent bonuses for Cannibalism, I know it's evil, but the health fortification/regeneration is critical for an Unarmored fighter.) I'd also end up with the Lady stone, once I'm done with the Guardians for training. Finally, the Imperials for Ulfric's Clothes, which makes for a badass unarmored outfit once Enchanted. (I do it in parallel with the DBH to RP as an Infiltration. First start off with Serpent Stone Island for Ice Wrait's bain, then take the Jagged Crown to Solitude, and finally, kill the Empiror once you have Ulfric's Stormcloak so you're not playing favorites.) You'll want Muiri's Ring to disenchant, after using it for Fortify Smithing/Enchantment potions. While you're in town, kill Madanach for the Smithing Ring.