You need to upgrade all the unmanaged agents manually in the agent computers.
To upgrade an unmanaged agent:
In the agent computer, run the Agent Manager\Additional Setups\Manaual Agent Installation\MAISetup.exe file.
Follow the instructions in the setup program. Click Finish.