That was it! Thanks, I gave the correct permissions to the account that's set to start SQL Server and it deleted the file without any issues.

Thanks for your help, that was driving me nuts.