I know the basics of Java. Will the CodeGym course be useful to me?

Sure!
Although our course is designed for beginners, it can still make you sweat at higher levels. Try it. I think it will be useful to you. In any case, you will at least refresh and supplement your knowledge of Java basics.