Allowing User access to block USB devices

Hi All

Hoping someone can help and confirm if the following is even possible using AD Groups.

What I am trying to achieve is I want to block all USB devices but then allow certain users (Not devices) to access the device but not others.

For example, my current setting in device control is.

Block all USB devices.

Allow USB Memory stick device. (Added by Device ID)

This means all users that can use this memory stick as in the allowed device list.

What I would like to do is create a policy so only User 1 can access the USB stick and no other users can unless authorised.

This is for around 50 USB sticks.

Is this possible in Symantec?