Is your esp32 for dual gps?
The idea is to use a USB to Ethernet adapter for the AoG hardware/network with a Teensy doing the Panda IMU syncing and you can then still hotspot your phone to the tablet via WiFi. NTRIP still works on any other IP.
Adding your esp32 wifi into the mix adds a complication. Can you plug in your phone via USB instead of wifi for internet sharing?