Suppose a,b∈R and a,b≠1. If the system of equations ax+y+z=0, x+by+z=0, x+y+2z=0 has a non-trivial solution then
a+b=2ab
a+b=ab
a+1b=2
a+b=0
The condition for a homogeneous system of equations to have a non-zero solution is Δ=0
⇒a111b1112=0
⇒a(2b−1)−1(2−1)+1(1−b)=0
⇒2ab−a−1+1−b=0⇒a+b=2ab