Preheat oven to 350°F (175°C) and prepare baking pans.
In a large bowl, sift together the flour, cocoa powder, baking soda, and baking powder.
In a separate bowl, whisk together the sugar, oil, eggs, buttermilk, coffee, food coloring, and vanilla extract until smooth.
Gradually add the dry ingredients to the wet mixture, stirring until just combined.
Pour the batter evenly into the prepared pans.
Bake for 25-30 minutes, or until a toothpick inserted into the center comes out clean.
Allow the cakes to cool in the pans for 10 minutes, then turn them out onto a wire rack to cool completely.
While the cakes cool, prepare the frosting by beating together the cream cheese, butter, and powdered sugar until smooth and creamy.
If desired, add milk to the frosting to achieve a smoother consistency.
Once the cakes are completely cool, frost the top of one layer, place the second layer on top, and frost the top and sides of the cake.
Chill the frosted cake for at least 30 minutes to set the frosting before serving.