Tagging pokemon adventure since that's where Giovanni is Silver's father
In Pokemon HeartGold and SoulSilver's Japanese dialogue, Silver is explicitly stated to be Giovanni's son.
Silver.I've decided to remarry.And my partner is someone you've already known so well.Silver-kun...From now on, I am your mother.Let's get along, okay?