Hello @davidblaise,
It should display the upload button to allow media upload under Media tab.
If you are still facing the issue then please deactivate other addon ( except rtMedia and BuddyPress ) and check if the upload button displays properly or not. It will help to avoid related conflicts at first place.
Thanks.