Do I need to install the AppKeeper agent in the target instance?

No, but AppKeeper uses AWS Systems Manager Agent (SSM Agent), please install SSM Agent on the monitored instance.