I don't think it's possible unless the improvements do not involve any kind of mathematical breakthrough or new kind of model. In theory GPT is only modeling existing data and at best creating something new by combining what already exists. So I guess if somehow the answer to self-learning is on the Internet then it could be possible, but I doubt that is the case and a self-improving system would need to still be invented in theory first.