Add DB into AG with DEFUNCT files

I have a database which has defunct files. It is from a piecemeal restore.  I am trying to add it into an availability group. I backup and restore the DB with NORECOVERY on the secondary.  But each time I try to add the DB into the AG it fails trying to access the defunct files. Any suggestions how I may add this DB into the AG in this state?