When people talk about gravitons they are usually thinking in terms of quantum general relativity - that is applying the rules of quantum field theory to general relativity.
The method is to linearise Einstein's field equations and then use perturbation theory to get at the quantum theory. The problem is that there is no way to renormalise the theory, so you have to think of the theory as effective, that is we accept that it can only hold reasonably for a small range of energies - we accept that at higher energy some new physics must come into play. However, it is possible to deal with the gravitational force up to 2-loops. Thus, we do have some workable handle on what one means by gravitons.
But of course we do not have any experimental evidence that they exist, the closest has to be observations of gravitational radiation. The analogy here is that light waves and photons.
-------------------------------------------------------------
The question of if we could ever have a table top experiment that could detect quantum effects of the gravitational force is another issue.