According to Debian's RPi3 image wiki, I should be able to ssh into a Raspberry-Pi, with just the hostname. I shared internet from my Debian laptop, WiFi to the a Raspberry-Pi over Ethernet, but the hostname never resolved.
What kind of settings/configuration do either the client and server or the network need for LAN hostname resolution to work?
What do I need to install on the Pi so that MS-Windows can resolve the Pi's IP address when I want to access a web server hosted on it, for example? I think it's smbclient but I'm not sure.
smbclientif for SMB file shares, has nothing to do with it. Also, for a web server, you do not specify what you want to do with it, and whom is getting into it e.g. what is your goal.