My only experience was a couple of years back, but I remember that there was a "warm-up" period where resource utilization was substantially worse than pre-pypy conversion, then performance would improve.

Again, I haven't followed recent developments, so this may be less of an issue now.

Edit: I should add - we loved it! Pypy was like a magic bullet that solved our performance problems.