We present a research of the time evolution of the redshift of light received from the binary star that moves in the external gravitational field of Kerr black hole. We formulate a method for the solution of inverse problem: calculating of the parameters of relative motion of stars in binary system using the redshift data. The considered formalism has no restrictions on the character of the motion of the center of mass of a compact binary star and can be applied even in the case of binary motion close to the event horizon of a supermassive black hole. The efficiency of the method is illustrated on a numerical model with plausible parameters for the binary systems and for the supermassive black hole, which is located in the center of our Galaxy.