FFXI Monster Database

[X-Drop]

Happy New Years. ;D

FFXI Monster Database and PHP Search Utility



It took nearly a week of learning MySQL and PHP to write the code that extracted all the online FFXI monster data into a database. Yet when executed, it only took 18 seconds for the PHP code to filter through 160 online pages at Somepage.com and save all the data into the database!

The purpose of this database is for access to monster data to be used in Lunar scripts. Personally, I am going to use it to finish my Aggro Check script. Hopefully someone else can use the data in a unique way as well. If you want to use the monster data, I have created a PHP search utility to use with the database.

This utility will output the FFXI data into an array formatted for Lua. I still get a kick out of displaying oncreen all stats for 3,500+ mobs at once... lol. Or refining a search using the power of regex even. Here is a sample output of all mobs found in Gustaburg South,

Pug_Pugil = { family = "Pugil", type = "Fishing", level_min = 0, level_max = 0, aggro = 1, link = 0, sight = 0, sound = 1, }
Lead_Quadav = { family = "Quadav", type = "NM", level_min = 0, level_max = 0, aggro = 1, link = 0, sight = 0, sound = 1, }
Helidor_Quadav = { family = "Quadav", type = "NM", level_min = 0, level_max = 0, aggro = 1, link = 1, sight = 0, sound = 1, }
Land_Crab = { family = "Crab", type = "Fishing", level_min = 0, level_max = 0, aggro = 1, link = 0, sight = 0, sound = 1, }
Fighting_Pugil = { family = "Pugil", type = "Fishing", level_min = 0, level_max = 0, aggro = 1, link = 0, sight = 0, sound = 1, }
Tunnel_Worm = { family = "Worm", type = "Normal", level_min = 1, level_max = 1, aggro = 0, link = 0, sight = 0, sound = 1, }
Huge_Hornet = { family = "Bee", type = "Normal", level_min = 1, level_max = 1, aggro = 0, link = 0, sight = 1, sound = 0, }
Stone_Crab = { family = "Crab", type = "Fishing", level_min = 2, level_max = 3, aggro = 1, link = 0, sight = 0, sound = 1, }
Ding_Bats = { family = "Bats", type = "Normal", level_min = 1, level_max = 4, aggro = 0, link = 0, sight = 0, sound = 1, }
Sand_Crab = { family = "Crab", type = "Fishing", level_min = 3, level_max = 4, aggro = 1, link = 0, sight = 0, sound = 1, }
Fledermaus = { family = "Giant Bat", type = "Normal", level_min = 3, level_max = 5, aggro = 0, link = 1, sight = 0, sound = 1, }
Maneating_Hornet = { family = "Bee", type = "Normal", level_min = 2, level_max = 5, aggro = 0, link = 0, sight = 1, sound = 0, }
River_Crab = { family = "Crab", type = "Normal", level_min = 1, level_max = 5, aggro = 0, link = 0, sight = 0, sound = 1, }
Stone_Eater = { family = "Worm", type = "Normal", level_min = 2, level_max = 5, aggro = 0, link = 0, sight = 0, sound = 1, }
Goblin_Fisher = { family = "Goblin", type = "Normal", level_min = 4, level_max = 6, aggro = 1, link = 1, sight = 1, sound = 0, }
Walking_Sapling = { family = "Sapling", type = "Normal", level_min = 2, level_max = 6, aggro = 0, link = 0, sight = 0, sound = 1, }
Vulture = { family = "Bird", type = "Normal", level_min = 2, level_max = 6, aggro = 0, link = 1, sight = 0, sound = 1, }
Black_Wolf = { family = "Hound", type = "Normal", level_min = 5, level_max = 8, aggro = 1, link = 0, sight = 0, sound = 1, }
Enchanted_Bones = { family = "Skeleton", type = "Normal", level_min = 5, level_max = 8, aggro = 1, link = 0, sight = 0, sound = 1, }
Enchanted_Bones = { family = "Skeleton", type = "Normal", level_min = 5, level_max = 8, aggro = 1, link = 0, sight = 0, sound = 1, }
Goblin_Digger = { family = "Goblin", type = "Normal", level_min = 5, level_max = 8, aggro = 1, link = 1, sight = 1, sound = 0, }
Rock_Lizard = { family = "Lizard", type = "Normal", level_min = 3, level_max = 8, aggro = 0, link = 1, sight = 0, sound = 1, }
Amber_Quadav = { family = "Quadav", type = "Normal", level_min = 3, level_max = 8, aggro = 1, link = 1, sight = 0, sound = 1, }
Amethyst_Quadav = { family = "Quadav", type = "Normal", level_min = 3, level_max = 8, aggro = 1, link = 1, sight = 0, sound = 1, }
Young_Quadav = { family = "Quadav", type = "Normal", level_min = 3, level_max = 8, aggro = 1, link = 1, sight = 0, sound = 1, }
Ornery_Sheep = { family = "Sheep", type = "Normal", level_min = 5, level_max = 8, aggro = 0, link = 1, sight = 1, sound = 0, }
Goblin_Weaver = { family = "Goblin", type = "Normal", level_min = 4, level_max = 8, aggro = 1, link = 1, sight = 1, sound = 0, }
Goblin_Thug = { family = "Goblin", type = "Normal", level_min = 4, level_max = 8, aggro = 1, link = 1, sight = 1, sound = 0, }
Shrapnel = { family = "Bomb", type = "Normal", level_min = 8, level_max = 10, aggro = 1, link = 0, sight = 1, sound = 0, }
Stinging_Sophie = { family = "Bee", type = "NM", level_min = 9, level_max = 10, aggro = 0, link = 1, sight = 1, sound = 0, }
Maighdean_Uaine = { family = "Sapling", type = "NM", level_min = 11, level_max = 11, aggro = 1, link = 1, sight = 0, sound = 0, }
Sand_Pugil = { family = "Pugil", type = "Normal", level_min = 18, level_max = 20, aggro = 1, link = 0, sight = 0, sound = 1, }
Goblin_Gambler = { family = "Goblin", type = "Normal", level_min = 21, level_max = 23, aggro = 1, link = 1, sight = 1, sound = 0, }
Goblin_Mugger = { family = "Goblin", type = "Normal", level_min = 21, level_max = 23, aggro = 1, link = 1, sight = 1, sound = 0, }
Goblin_Leecher = { family = "Goblin", type = "Normal", level_min = 21, level_max = 23, aggro = 1, link = 1, sight = 1, sound = 0, }
Old_Quadav = { family = "Quadav", type = "NM", level_min = 20, level_max = 26, aggro = 1, link = 1, sight = 0, sound = 1, }
Gambilox_Wanderling = { family = "Goblin", type = "NM", level_min = 53, level_max = 53, aggro = 1, link = 1, sight = 1, sound = 0, }

At the moment, the database only contains 17 fields. I might in the future add fields for "Weak to", "Crystal", "Drops", "Location", and a few others.

Special thx to Me3you2 for pointing me in the right direction.

[TinyTerror]

Thats pretty cool.

[dragondude]

Wow, X, thats really cool lol

[me3you2]

Nice work.

[deathravin]

Does it know subtle differences in mobs?

For instance: Soldier crawlers aggro in Crawler Nest, but not in Yhoater Jungle? (from what I remember... i think... but there are differences like that lol)

[X-Drop]

Ofcoarse it does!

All the info was pulled directly from the Somepage.com database. Here is the output from the PHP search utility based on the question you asked,

id_name_1757 = { name = "Soldier Crawler", zone = "Yuhtunga Jungle", level_min = 37, level_max = 41, aggro = 0, link = 1, sight = 0, sound = 1, }
id_name_733 = { name = "Soldier Crawler", zone = "Crawlers' Nest", level_min = 47, level_max = 49, aggro = 1, link = 1, sight = 0, sound = 1, }

[nebula]

you know you have a zone id, you could have jes put the actual text in another table, then same with id for the family, since most share traits, put the names and common attrib in another table (like aggro types, leave if they aggro and link in the main db)


INSERT INTO `monsters` VALUES (3347, 'Aern''s Wynav', 66, 'Wyvern', 159, 'Al''Taieu', 'Normal', 0, 0, 0, 1, 0, 0, 0, 0, 0, 0);
INSERT INTO `monsters` VALUES (3349, 'Aern''s Xzomit', 106, 'Xzomit', 159, 'Al''Taieu', 'Normal', 0, 0, 0, 1, 0, 0, 0, 0, 0, 0);
INSERT INTO `monsters` VALUES (3351, 'Aern''s Elemental', 23, 'Elemental', 159, 'Al''Taieu', 'Normal', 0, 0, 0, 1, 0, 0, 0, 0, 0, 0);
INSERT INTO `monsters` VALUES (3360, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3361, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3362, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3363, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3364, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3365, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3366, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3367, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3368, 'Ru''aern', 103, 'Aern', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 1, 1, 0, 1, 0, 0);
INSERT INTO `monsters` VALUES (3369, 'Om''yovra', 107, 'Yovra', 159, 'Al''Taieu', 'NM', 0, 0, 1, 0, 0, 0, 0, 0, 0, 0);


that looks broken, too >.> it escaped your ' with another ' lol do a search for '' and replace with \'


good work, btw how'd you pull all the info outta somepage?

[Onitaru]

now if you could just target a mob and have it pull up the data on it that would be awsome ^.^

[nebula]

yea, thats what would be cool about something like sqlite, get the zone id and mob name, then query the db spit out the info you need. with this info, you could pretty easily make a chain timer script, too, which was on my todo list if tiny ever gets time to add db support

[X-Drop]

that looks broken, too >.> it escaped your ' with another ' lol do a search for '' and replace with \'

I used INSERT with the escape character, \'

I think when I exported the MySQL database, all the single quotes get automatically escaped with another single quote. That is a legitamate escape character as well. When you import the FFXI.sql file, the strings containing the single quote should be just fine. Although you may need to query those strings using double quotes.... I dunno.

Also, I changed the field name "type" to "mob_type" because Lua seems to recognize the word "type" as having some special meaning. And I made some other minor chages as well. Probably release an updated database soon.

---

Here's the php script I wrote to extract all the mob data from Somepage.

FFXI.php

---

now if you could just target a mob and have it pull up the data on it that would be awsome ^.^

Great idea Onitaru. I'm gonna add that to my Aggro Check script. Maybe allow the user a choice between 2 macros. One macro would display a chart with all monsters that will aggro the character. Then the other macro could just display info for the targeted mob. That would be pretty damn cool.

[Onitaru]

add "Idea by:Onitaru"

lol j/k
I'm full of ideas just need to get off my ass and start impletmenting them.

[DarkAquaus]

nice work!

[sdphantom]

xdrop said:

I changed the field name "type" to "mob_type" because Lua seems to recognize the word "type" as having some special meaning.

It's a bug in the SciTE editor. There is a Lua core function type() that returns a string that says what type a passed varible is.

[X-Drop]

Thx, SD Phantom. Back in early January I had not yet used the lua function type(). But I actually use it quite often now.

---

On another note, I see that someone finally used the FFXI utility to take advantage of the mob database.

Monotemo's script

Since someone is using the database, I will go ahead and release the updated version. It corrects a large number of errors throughout the original.

Updated mob database