Streamlabs can display some useful information about your stream that you can use to gauge whether your connection is good or if you're facing problems.
1. On the lower-left corner of the Streamlabs main screen, click this icon to open the "Performance Metrics" menu window.

2. Check the "Status" portion of this window to assess whether Streamlabs identifies your connection as appropriate.