I don't think it is possible to have a chart exactly how you want it. But one workaround that I can think of is a horizontal table on top of the graph. Once you have the table properly aligned, you can even hide the unwanted columns or set the text and cell color to white so that they get disappeared as shown below.
