Finally got to the bottom of this, using the waybackmachine, I found an archived version of catacomber's website that contained Michele Laconto's guide to the Tower. I swear, the lengths I went through to solve this quest was it's own quest.
Anyway, it appears I was stuck on using the wall cutter (didn't put that one together - duh).
The guide is as follows:
Michele\'s Guide to The Tower (CivilStriker\'s Lost Archipelagos)
This will help you to find and save Cat once again!
This quest is the second quest that you\'ll receive from Sphinx67 in the Illegal Guild of Murderers.
Find the tower in the Pinsinira lake - Southern shore area. Keep knocking on the door until the guard comes out. The door will be unlocked now. You may want to \'mark\' a spot outside the front door. You can\'t \'mark\' inside, but you can \'recall\' out.
You\'ll need to find the Tower passes to open walls. When you first enter, go west and tap the light green section of wall that you see. The first \'Tower Pass\' you\'ll find on the pedestal near the statue at the end of this area. It will open the wall directly opposite the wall where you entered. Tap the wall. (across from the shelf). Walk forwards towards the pile of gold that you see.
You\'ll end up in the \'Teleport Room\'. Go out the door and head south. To get the items off the shelf ahead of you, you\'ll need to tap the wall to the west just before the patch of grass that teleports you. Then you need to tap the next section of wall to the south.
If you step on the grass, you\'ll be warped to another room with pillars and and fountain of oil. (watch out for the cracks on the floor here). Shoot two arrows or knives out across the gap to the south in this room (after you eliminate the bat in the way). Sections of invisible floor will \'appear\'. When you walk out on the invisible bridge as far as you can go, you\'ll need to throw/shoot towards the east. Again, walk as far as you can go and throw/shoot towards the south, then when you walk as far as you can again, throw/shoot towards the west. Throw/shoot one more to the south to complete the bridge.
When you make it across, you\'ll need to tap the flags in the right order: flags - yellow, blue, red, pink. The wall will open. Look for the short section of wall towards the north. Tap it a few times until it opens.
There are switch plates inside. Step on them in this order - northeast, northwest, sotheast, southwest (step on them a couple of times). A shelf will appear with the second \'Tower Pass\'. It will open a wall outside of the \'Teleport Room\'.
Go back to the \'Teleport Room\' and go west when you exit out the door and tap/hit the wall. The \'Tower Pass 2\' will open the wall beyond that. When you find the skeleton on the ground near the sign that says something about Shakespeare, you\'ll need to cast the \'Oil Touch\' spell out across the chasm.
You may need to enchant items with Fortify Mana to be able to cast the Oil Touch spell.
The wall to your left will open. (I had to enchant items with fortify mana to be able to have enough to cast the spell). When you go into that room, you need to tap all of the items in order to make the Shakespeare poem. This is the order -
1. blue pillar
2. Painting
3. Pillar with torches
4. Green flag
5. Lantern
6. Pink pillar
7. Gold and white pillar
8. Stone pillar
9. Mirror
10. Solid gold pillar
A section of invisible bridge will appear. Cross it. Follow it and tap the wall to the north. Look for the face on the wall. Tap it until you receive \'Tower Pass 3\'.
The faces across from the Shakespeare Room are not the ones you tap (you lose HP if you tap these) You need to follow the passage and open a wall to find the other face.
Head back to the beginning area where the green section of wall opened. Head west then turn to the south to use \'Tower Pass 3\'. Follow this corridor until you get to the room with the four switches. Flip all of them down. You can head upstairs or downstairs.
If you go upstairs, and around the corner to the north. You\'ll need to solve the puzzle of the red discs to get through the magical barriers. Tap them in this order: Northeast - northwest - middle. The pillar between the two barriers will be moved. To open the door here, you\'ll need strength of 200+.
You may need to enchant items with Strength to be able to open the door.
Inside this area you\'ll need to walk north and tap the sections of wall that are sticking out to find a barrel with the \'Tower Dungeon Key\' inside.
Go back down the stairs and then down into the dungeon. Pick the lock on the gate to the west. Go inside and tap the wall to the north. You\'ll see a bone gate. Open it and you\'ll find Cat behind the door there. She will give you \'Tower Pass 4\' and she will want you to bring some fish.
If you find the door is locked, it means that you probably don\'t have the quest from Sphinx67 in the Murderers\' Guild yet.
Go back to the area near the \'Teleport Room\' where the grass teleports you. Don\'t step on the grass! Stand in front of it and tap the wall to the east to use the \'Tower Pass 4\'.
Open the gate inside and eliminate all of the beasts. One will drop a weapon called \'Wall Cutter\'. Go inside this area head as far south as you can go. Go 3 paces to the west and tap the wall to the south to open it. Find the \'Cumin\' on the ground. You\'ll need to be carrying this to defeat the Master of the Tower.
Return to the area of the tower past the spike traps in the floor, statue and the pedestal that you found the first \'Tower Pass\' and \'Oil Touch\' spell book.
Use the \'Wall Cutter\' in the corner area near the statue. Eliminate all of the creatures in this area. One will drop fish. Bring this to Cat.
Return to Sphinx67 for your reward.