Reversal of Input on damaged goods - Goods and Services Tax - GST

dear experts, There are transfer of goods from plants located in Andhra Pradesh to Sales office located in Karnataka through Stock transfer by paying IGST. ITC on those goods was claimed. Some goods were found damaged on receipt at Karnataka sales office. The same goods were transferred back to plant located in AP by paying IGST so that same can be scrapped or reused. Karnataka GST officer is asking to reverse the ITC as per provisions of the act. Our contention is as we have already paid outward tax there is no loss to GST department . Is our view correct. Kindly provide your views in this regard.