Print Page | Close Window

Data Integrity Issues in game provided Data files.

Printed From: Illyriad
Category: Miscellaneous
Forum Name: Technology & data
Forum Description: Discussions on data dumps, downloads, and third party applications.
Printed Date: 05 Jul 2020 at 11:06
Software Version: Web Wiz Forums 12.03 -

Topic: Data Integrity Issues in game provided Data files.
Posted By: allamagoosa
Subject: Data Integrity Issues in game provided Data files.
Date Posted: 26 Oct 2012 at 17:05

I have seen several errors in some of the different data files made available from the Devs and I am curious if other folks who use these files have experienced data integrity issues as well.

When I find an error I file a petition but the petitions always go unassigned and unanswered.

I am hoping that if others experience these issues maybe we can generate some support to get these files updated and accurate as well as maybe get some additional data file types.


Once example is in the datafile_worldmap.txt line # 176020


This encoding is for Square 138,120 and indicates Plains.

However if you go to this square it clearly shows Heavy Clay Steam (Small Hills).





Posted By: Albatross
Date Posted: 26 Oct 2012 at 17:22
This is because of the relocation spell, which takes some of the underlying terrain stats with it.

You can find all these by comparing the default terrain for each terrain type, with the terrain data for the square.


Posted By: tallica
Date Posted: 26 Oct 2012 at 18:11
I still think that this need to be looked at. I feel like if someone really wanted to they could wreck the map by using the relocation spell. I know you can only use it once, but that's per account. What's to stop some really devoted troll from making an account, wrecking a 7-food sq, abandoning, rinse and repeat?

In a relatively short amount of time someone could clear out a large area of 7-food sqs, this could be used tactically to eliminate alliance growth in a region.

What is needed is a sort of sweeper that checks squares to see if there is a town there, if not the square should revert to it's original value. This could be a weekly or monthly check.

However, if this is what the devs want to happen, then the tile properties need to be altered, I've seen several deer and such that don't have the typical distribution, and I've seen people settle on those squares to realize that they are not what they wanted.

Either way, something should be done.

Posted By: nutation
Date Posted: 09 Feb 2014 at 17:02
I'm running into this issue now, so I'll add what I've found.

The issue seems to stem from a tile having a TerrainSpecificTypeID = 4 in the datafile_worldmap.txt. This ID is not present in the datafile_terrain.xml.

Now, inside datafile_towns.xml, it might be possible to determine the underlying tile TerrainSpecificTypeID by using the terrainoveralltype ID. However, this too is inconsistent since there are some values of "4" for that ID attribute.

For now, I'm treating all TerrainSpecificTypeID = 4 as unknowns, and will build an errata to supplement my work. However, I too would like to request that the datafile_worldmap.txt file be investigated to replace these unknowns with their proper IDs.

Presently, there are 25,388 tiles with this unknown TerrainSpecificTypeID.

Posted By: ubluntu
Date Posted: 26 Apr 2014 at 00:36
In the currently served map data(not datafile, but what loads looking at the map), there are only 17 squares with TerrainSpecificType=4, and all seem to be a specific angle of shoreline." rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -" rel="nofollow -

Here is an updated" rel="nofollow - datafile_worldmap.txt  (official datafile is from 2012-04-21)

If anyone else tried to make GeoID(or X & Y) a unique key then ran into issues importing datafile_worldmap.txt, these two rows were duplicated(problem is not in my updated file).


[Edit:fixed link]

Posted By: Digioso
Date Posted: 15 Feb 2015 at 07:44
I think I found some issues in the datafile_worldmap.txt as well.

All of these have the TerrainCombatTypeID 3, which means they're large hills.
However if you check them ingame they're aren't large hills. They're Dolmens (TerrainSpecificTypeID = 45), Ruined Towers (TerrainSpecificTypeID = 43) and so on, mostly on Plains, Some of them (eg -316|791) are buildings ingame and should have TerrainCombatTypeID 8 and not 3.

459105|-125|771|1|2|2|1|19|45|3|2 -" rel="nofollow -
2362052|-129|-180|2|1|4|1|17|45|3|18 -" rel="nofollow -
483099|-143|759|3|3|1|1|17|45|3|2 -" rel="nofollow -
2269825|-310|-134|1|1|4|2|17|45|3|18 -" rel="nofollow -
418894|-316|791|1|2|4|3|15|43|3|2 -" rel="nofollow -
590937|-359|705|3|4|1|2|15|123|3|2 -" rel="nofollow -
2305787|-366|-152|1|1|5|2|16|45|3|18 -" rel="nofollow -
256757|-372|872|1|5|3|1|15|145|3|2 -" rel="nofollow -
1931518|-448|35|2|1|1|4|17|45|3|17 -" rel="nofollow -
2343718|-454|-171|3|1|2|2|17|45|3|18 -" rel="nofollow -
516748|-511|742|1|4|3|1|16|43|3|2 -" rel="nofollow -
3824372|-540|-911|2|1|5|1|16|45|3|35 -" rel="nofollow -
226516|-598|887|1|2|2|3|17|45|3|1 -" rel="nofollow -
546663|-611|727|5|1|1|1|17|45|3|2 -" rel="nofollow -
146452|-622|927|1|2|3|1|18|156|3|1 -" rel="nofollow -
2375507|-681|-187|4|1|2|2|16|45|3|19 -" rel="nofollow -
1228881|-734|386|1|4|2|2|16|156|3|8 -" rel="nofollow -
1030683|-833|485|1|3|1|3|17|45|3|8 -" rel="nofollow -
2590198|-97|-294|2|4|1|2|16|43|3|18 -" rel="nofollow -
332175|-992|834|1|2|1|4|17|45|3|1 -" rel="nofollow -
651479|153|675|5|2|1|2|15|45|3|3 -" rel="nofollow -
629468|153|686|2|1|1|2|19|43|3|3 -" rel="nofollow -
2872605|169|-435|1|4|1|2|17|45|3|25 -" rel="nofollow -
2732565|199|-365|2|4|2|2|15|45|3|25 -" rel="nofollow -
135329|261|933|2|3|2|3|15|45|3|3 -" rel="nofollow -
1286116|473|358|2|4|1|1|17|45|3|11 -" rel="nofollow -
2152600|524|-75|1|3|2|1|18|45|3|16 -" rel="nofollow -
599854|554|701|1|3|1|3|17|45|3|5 -" rel="nofollow -
2696920|572|-347|2|1|4|2|16|43|3|27 -" rel="nofollow -
1248430|806|377|3|1|3|2|16|45|3|12 -" rel="nofollow -
2409017|813|-203|1|3|2|1|18|45|3|20 -" rel="nofollow -
1604630|828|199|2|4|1|1|17|45|3|10 -" rel="nofollow -
428052|838|787|2|1|1|5|16|45|3|5 -" rel="nofollow -
2359032|853|-178|4|1|2|2|16|45|3|20 -" rel="nofollow -
2361046|866|-179|2|2|2|4|15|45|3|20 -" rel="nofollow -
2127017|954|-62|1|3|1|2|18|45|3|20 -" rel="nofollow -
2343139|968|-170|2|1|3|3|16|45|3|20 -" rel="nofollow -

-------------" rel="nofollow">

Posted By: IbnSenna
Date Posted: 15 Feb 2015 at 14:54
Mind also that 'mirror' servers:

are usually inconsistent, even after the daily update!
data-root is most of the time more accurate, but not everyday…

Posted By: Digioso
Date Posted: 15 Feb 2015 at 17:19
I'm using .

-------------" rel="nofollow">

Posted By: Digioso
Date Posted: 05 Mar 2017 at 08:34
Unfortunately there still hasn't been any change on this.
The data is still not accurate.

For example:

Square -612|-278

From today worldmap datafile:
TerrainCombatTypeID = 7

From the terrain combat data XML file:
<terraincombat><terraincombattype id="7">Plains</terraincombattype></terraincombat>

So it should be on plains but in the game this square is a Small hill.

-------------" rel="nofollow">

Posted By: Bobtron
Date Posted: 05 Mar 2017 at 21:56
yep, ive noticed this problem ever since i started working with datafiles 9 months ago

best workaround ive found is that, since the terrain ids are accurate, is to manually make a datafile that has the corresponding TerrainCombatTypeID to each of  the 229 TerrainIDs, and to discard the given TerrainCombatTypeID

I support the Undying Flame!

Posted By: Kalculas
Date Posted: 13 Mar 2017 at 05:18
How do we know that the combat terrain from the game map is the one actually used in a battle? I too want to believe that the combat terrain value matches up with the TerrainSpecificTypeID. That would mean that it's converted to something that it's not when it's written to the data file? Or are there two sources of world map data?

Print Page | Close Window

Forum Software by Web Wiz Forums® version 12.03 -
Copyright ©2001-2019 Web Wiz Ltd. -