Start with three signals: health endpoint, error rate, and p95 latency. That is already enough for many products before enterprise scale.
Logs must have request ID and safe user/tenant context. Don't log secrets or sensitive payloads.
Alert only for things that need to be acted upon. Noise makes teams ignore warnings that are truly important.