"Tech debt" is actually a great name because debt is not always bad.
Sometimes it is good! We take on debt to buy a house, to buy a car, and in the most American tradition possible, sometimes we take on debt to ship software faster.
"Do we want to ship these 3 features in a week, even if changing one of them later might take 2 weeks?"
In an early product cycle that math maths. Generally, I think you should be okay shipping something quicker if it helps you learn something important about the product.