You should get an FTP client and get used to using it. These things can be a bit daunting at first, as the potential for seriously messing up your site and server are great, but once you get the hang of things, and crucially take your time when using it, reading all warning messages (not just clicking “YES”), you should be fine.
For occasional use, Cyberduck is good, and free. Transmit is really popular, I use it, I bought it based on a lot of recommendations, but I’ve been deeply underwhelmed with it and certainly wouldn’t buy it again. I find it extremely slow to upload at times, refuses to upload certain files and the notification system for transfers in progress is very buggy. Whereas the times I’ve used Cyberduck I\ve experienced none of these issues.
On the subject of FTP and servers etc. If you are going to go down this path (anyone serious about making websites need to learn this stuff), now would also be a good time to put in place a solid server backup solution.
Some FTP clients have this facility, otherwise there are plenty of dedicated solutions out there. I use Syncovery.
In theory, most hosting services offer backups, but my experience of them is very poor. Often the very backup you need just so happens to be the only one that has (for reasons they can never explain) that has failed. Plus, if they do have the backups it can take days to get it.
Better to do your own.
With the right solution, you can set it up to log into your server at specified times of the day and take a complete backup. Then, if you accidentally overwrite or delete a file you have a backup on your local machine that you can “undelete” in seconds.