Koumas had given the Welsh a first half lead after a cracking header from a Joe Ledley cross.
Robbie Keane levelled before Reading's Stephen Hunt and Kevin Doyle combined to make it 2 - 1 to the Irish.
Koumas came up trumps with a late penalty after Cotterill was judged to have been fouled in the box in the closing minutes.
Match Reports
BBC