You cannot directly assign permissions to Folders in the Library. However, it's important to note that permissions are set on the File/Document level rather than the Folder level. As a result, Users only see Folders containing content they have permission to access. Folders without content or content that Users are not permitted to view are not visible to them.
Learn more about this topic here: Setting Permissions for Library Content.