We travelled Morocco with our 16 month old boy.
All 3 of us were treated very, very, well while staying at Riad Layalina. The staff is wonderful and make themselves available to accommodate what you need. The food was excellent, everything was clean, the location is great (right in the heart of medina, but removed enough for peace.) and again, the staff was great and loved playing with our boy.
If you are traveling anywhere in Morocco and want the comforts of a western hotel (silence, black out shades, AC, ADA accommodations etc...) then a large hotel is the answer. But if you choose a Riad, this one is 10/10!