Story Ideas: Wizards of Westeros

Game of Thrones (TV) A Song of Ice and Fire - George R. R. Martin Harry Potter - J. K. Rowling
F/M
Gen
G
Story Ideas: Wizards of Westeros
Summary
Every time I see a crossover story of Harry Potter/A Song of Ice and Fire, it is usually about Harry or another character magically ending up in Westeros, or game of thrones characters going to Hogwarts. I wanted to change that. I decided to set up this prompt where instead what would happen if after the Second Long Night in the TV show 4 people were chosen by the old gods and gifted wand magic. The 4 people become the Founders and are gifted this huge Grimoire full of magic spells and potions. They are also gifted the Book of Admittance, with a list of names of everyone in Westeros with magic. They travel all over Westeros to find these people so they can teach them. They go to King Bran and ask him if they can create a School of Magic. I'm thinking that instead of creating a whole new school from scratch they can instead take over Harrenhal and rebuild it considering it is the biggest castle in all of Westeros. Harrentown can become a mix of Diagon Alley and Hogsmeade.
Note
This is just an Idea for a story if someone wants to take the idea fine by me I just want to see how others would do the story.

Here are some things that need to be part of the story:

1. The 4 Founders are actually 4 Bastards of major Houses.
a. Godric Gryffin (Godric Gryffindor) is a bastard of House Lannister and Connington (Lion and Gryffin symbol)
b. Sylas Snake (Salazar Slytherin) is a bastard of House Lynderly (House Lynderly sigil is a snake)
c. Rowena Raven (Rowena Ravenclaw) is a bastard of House Corbray (House Corbray sigil has a raven)
d. Henrietta Hedge (Helga Hufflepuff) is a bastard of House Lydden (House Lydden sigil has a badger)
2. The first students at the school are actually children of lords who will eventually make up the Pureblood Sacred Twenty-Eight.
Example 1: The Olivander family is actually House Rowan of the Reach who become the first Wandmakers.
3. Find a way to bring magical creatures life House-Elves and Goblins into the story.
Example 1: Goblins were created in Old Valyria and were the creators of Valyrian Steel. They now secretly work for the Iron Bank minting coins.
4. Find a way to make travel easier since the Hogwarts Express doesn't exist in this world.
Example 1: Harrenhal has the Hall of a Hundred Hearths which would make it great for Floo Travel.
5. Thanks to magic Harrentown prospers to become an actual city like Oldtown or King's Landing.
Example 1: Gringotts bank is made in Harrentown
Example 2: Many Guilds are built.
Example 3: The first Hospital is also created.