There can only be one single greatest common factor.
When we talk about common factors, we look at the factors of two or more numbers, not just one single number.
If the greatest common factor of twelve and another number is four, the other number could possibly be 20. Note that there are infinitely other possible numbers.