Is fuller a word when it is used to say that glass there than one?

The word "fuller" is not typically used to describe the quantity of glasses present. The word "full" is more commonly used in this context. For example, one might say "There is a full glass of water on the table" to indicate that the glass is completely filled with water.