Is there support for http 2 on Azure App Services yet?

Yes, at last there is!

Check out the blog post over at https://blogs.msdn.microsoft.com/appserviceteam/2018/04/13/announcing-http2-support-in-azure-app-service/