Preheat your oven to 350°F (175°C). Line a 9×5-inch loaf pan with parchment paper, leaving some overhang on the sides for easy removal.
In a medium bowl, whisk together the flour, baking soda, cinnamon, nutmeg, ginger, cloves, and salt until thoroughly combined.
In a large bowl, beat the eggs, granulated sugar, and brown sugar until light and fluffy, about 2 minutes. Add the pumpkin puree, oil, milk, and vanilla extract, whisking until smooth and well incorporated.
Gradually add the dry ingredients to the wet mixture, folding gently with a spatula until just combined. Be careful not to overmix – stop when you no longer see dry flour pockets.
In a separate bowl, beat the softened cream cheese until smooth and creamy. Add the sugar, egg, and vanilla extract, mixing until well combined and no lumps remain.
Pour half of the pumpkin batter into the prepared loaf pan. Add half of the cream cheese mixture in dollops on top. Pour the remaining pumpkin batter over this, followed by the remaining cream cheese mixture on top.
Using a knife or skewer, gently swirl the batters together with an "8" or "S" motion, being careful not to overmix. Limit yourself to 5-6 swirls for the most striking pattern.
Bake in the preheated oven for 60-65 minutes, or until a toothpick inserted into the center comes out with just a few moist crumbs. If the top begins to brown too quickly, tent it with aluminum foil after 40 minutes of baking.
Allow the bread to cool in the pan for 15 minutes, then use the parchment paper overhang to lift it out onto a wire rack to cool completely, at least 30 minutes more.