You can use Azure AD join to manage the Windows devices if your environment is cloud-first or cloud-only.
Prerequisites for Azure AD Join
Configuring Azure AD Join