Is it possible to manually add a user to a Smart Group?

No, Smart Groups are based on rules so a user is not able to be manually added, they must qualify according to the set rules.

Learn more about Smart Groups here: How to Create User Groups