Print Page | Close Window

Data Integrity Issues in game provided Data files.

Printed From: Illyriad
Category: Miscellaneous
Forum Name: Technology & data
Forum Description: Discussions on data dumps, downloads, and third party applications.
URL: http://forum.illyriad.co.uk/forum_posts.asp?TID=4400
Printed Date: 28 May 2017 at 00:19
Software Version: Web Wiz Forums 11.07 - http://www.webwizforums.com


Topic: Data Integrity Issues in game provided Data files.
Posted By: allamagoosa
Subject: Data Integrity Issues in game provided Data files.
Date Posted: 26 Oct 2012 at 17:05

I have seen several errors in some of the different data files made available from the Devs and I am curious if other folks who use these files have experienced data integrity issues as well.

When I find an error I file a petition but the petitions always go unassigned and unanswered.

I am hoping that if others experience these issues maybe we can generate some support to get these files updated and accurate as well as maybe get some additional data file types.

 

Once example is in the datafile_worldmap.txt line # 176020

1762019|138|120|3|7|5|5|5|4|4|15

This encoding is for Square 138,120 and indicates Plains.

However if you go to this square it clearly shows Heavy Clay Steam (Small Hills).

 

Cheers,

-A

Angry




Replies:
Posted By: Albatross
Date Posted: 26 Oct 2012 at 17:22
This is because of the relocation spell, which takes some of the underlying terrain stats with it.

You can find all these by comparing the default terrain for each terrain type, with the terrain data for the square.


-------------


Posted By: tallica
Date Posted: 26 Oct 2012 at 18:11
I still think that this need to be looked at. I feel like if someone really wanted to they could wreck the map by using the relocation spell. I know you can only use it once, but that's per account. What's to stop some really devoted troll from making an account, wrecking a 7-food sq, abandoning, rinse and repeat?

In a relatively short amount of time someone could clear out a large area of 7-food sqs, this could be used tactically to eliminate alliance growth in a region.

What is needed is a sort of sweeper that checks squares to see if there is a town there, if not the square should revert to it's original value. This could be a weekly or monthly check.

However, if this is what the devs want to happen, then the tile properties need to be altered, I've seen several deer and such that don't have the typical distribution, and I've seen people settle on those squares to realize that they are not what they wanted.

Either way, something should be done.


Posted By: nutation
Date Posted: 09 Feb 2014 at 17:02
I'm running into this issue now, so I'll add what I've found.

The issue seems to stem from a tile having a TerrainSpecificTypeID = 4 in the datafile_worldmap.txt. This ID is not present in the datafile_terrain.xml.

Now, inside datafile_towns.xml, it might be possible to determine the underlying tile TerrainSpecificTypeID by using the terrainoveralltype ID. However, this too is inconsistent since there are some values of "4" for that ID attribute.

For now, I'm treating all TerrainSpecificTypeID = 4 as unknowns, and will build an errata to supplement my work. However, I too would like to request that the datafile_worldmap.txt file be investigated to replace these unknowns with their proper IDs.

Presently, there are 25,388 tiles with this unknown TerrainSpecificTypeID.


Posted By: ubluntu
Date Posted: 26 Apr 2014 at 00:36
In the currently served map data(not datafile, but what loads looking at the map), there are only 17 squares with TerrainSpecificType=4, and all seem to be a specific angle of shoreline.

http://elgea.illyriad.co.uk/#/World/Map/-691/-768" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-691/-768
http://elgea.illyriad.co.uk/#/World/Map/-678/-778" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-678/-778
http://elgea.illyriad.co.uk/#/World/Map/-625/-754" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-625/-754
http://elgea.illyriad.co.uk/#/World/Map/-395/-634" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-395/-634
http://elgea.illyriad.co.uk/#/World/Map/-394/-636" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-394/-636
http://elgea.illyriad.co.uk/#/World/Map/-342/-650" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-342/-650
http://elgea.illyriad.co.uk/#/World/Map/-290/-618" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-290/-618
http://elgea.illyriad.co.uk/#/World/Map/-282/-651" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-282/-651
http://elgea.illyriad.co.uk/#/World/Map/-97/-597" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-97/-597
http://elgea.illyriad.co.uk/#/World/Map/-47/-664" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-47/-664
http://elgea.illyriad.co.uk/#/World/Map/78/-666" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/78/-666
http://elgea.illyriad.co.uk/#/World/Map/79/-667" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/79/-667
http://elgea.illyriad.co.uk/#/World/Map/224/-687" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/224/-687
http://elgea.illyriad.co.uk/#/World/Map/317/-701" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/317/-701
http://elgea.illyriad.co.uk/#/World/Map/318/-702" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/318/-702
http://elgea.illyriad.co.uk/#/World/Map/989/-980" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/989/-980
http://elgea.illyriad.co.uk/#/World/Map/990/-982" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/990/-982

Here is an updated https://drive.google.com/file/d/0B-74l5hL206bZmdzSWwzNzFMdFU/edit?usp=sharing" rel="nofollow - datafile_worldmap.txt  (official datafile is from 2012-04-21)

If anyone else tried to make GeoID(or X & Y) a unique key then ran into issues importing datafile_worldmap.txt, these two rows were duplicated(problem is not in my updated file).

GeoID|X|Y|Wood|Clay|Iron|Stone|Food|TerrainSpecificTypeID|TerrainCombatTypeID|RegionID
1810037|132|96|7|3|5|5|5|4|6|15
1810037|132|96|7|3|5|5|5|4|6|15
1930359|394|36|5|5|5|5|5|4|7|14
1930359|394|36|5|5|5|5|5|4|7|14

[Edit:fixed link]


Posted By: Digioso
Date Posted: 15 Feb 2015 at 07:44
I think I found some issues in the datafile_worldmap.txt as well.

All of these have the TerrainCombatTypeID 3, which means they're large hills.
However if you check them ingame they're aren't large hills. They're Dolmens (TerrainSpecificTypeID = 45), Ruined Towers (TerrainSpecificTypeID = 43) and so on, mostly on Plains, Some of them (eg -316|791) are buildings ingame and should have TerrainCombatTypeID 8 and not 3.

459105|-125|771|1|2|2|1|19|45|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-125/771" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-125/771
2362052|-129|-180|2|1|4|1|17|45|3|18 - http://elgea.illyriad.co.uk/#/World/Map/-129/-180" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-129/-180
483099|-143|759|3|3|1|1|17|45|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-143/759" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-143/759
2269825|-310|-134|1|1|4|2|17|45|3|18 - http://elgea.illyriad.co.uk/#/World/Map/-310/-134" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-310/-134
418894|-316|791|1|2|4|3|15|43|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-316/791" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-316/791
590937|-359|705|3|4|1|2|15|123|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-359/705" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-359/705
2305787|-366|-152|1|1|5|2|16|45|3|18 - http://elgea.illyriad.co.uk/#/World/Map/-366/-152" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-366/-152
256757|-372|872|1|5|3|1|15|145|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-372/872" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-372/872
1931518|-448|35|2|1|1|4|17|45|3|17 - http://elgea.illyriad.co.uk/#/World/Map/-448/35" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-448/35
2343718|-454|-171|3|1|2|2|17|45|3|18 - http://elgea.illyriad.co.uk/#/World/Map/-454/-171" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-454/-171
516748|-511|742|1|4|3|1|16|43|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-511/742" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-511/742
3824372|-540|-911|2|1|5|1|16|45|3|35 - http://elgea.illyriad.co.uk/#/World/Map/-540/-911" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-540/-911
226516|-598|887|1|2|2|3|17|45|3|1 - http://elgea.illyriad.co.uk/#/World/Map/-598/887" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-598/887
546663|-611|727|5|1|1|1|17|45|3|2 - http://elgea.illyriad.co.uk/#/World/Map/-611/727" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-611/727
146452|-622|927|1|2|3|1|18|156|3|1 - http://elgea.illyriad.co.uk/#/World/Map/-622/927" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-622/927
2375507|-681|-187|4|1|2|2|16|45|3|19 - http://elgea.illyriad.co.uk/#/World/Map/-681/-187" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-681/-187
1228881|-734|386|1|4|2|2|16|156|3|8 - http://elgea.illyriad.co.uk/#/World/Map/-734/386" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-734/386
1030683|-833|485|1|3|1|3|17|45|3|8 - http://elgea.illyriad.co.uk/#/World/Map/-833/485" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-833/485
2590198|-97|-294|2|4|1|2|16|43|3|18 - http://elgea.illyriad.co.uk/#/World/Map/-97/-294" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-97/-294
332175|-992|834|1|2|1|4|17|45|3|1 - http://elgea.illyriad.co.uk/#/World/Map/-992/834" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/-992/834
651479|153|675|5|2|1|2|15|45|3|3 - http://elgea.illyriad.co.uk/#/World/Map/153/675" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/153/675
629468|153|686|2|1|1|2|19|43|3|3 - http://elgea.illyriad.co.uk/#/World/Map/153/686" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/153/686
2872605|169|-435|1|4|1|2|17|45|3|25 - http://elgea.illyriad.co.uk/#/World/Map/169/-435" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/169/-435
2732565|199|-365|2|4|2|2|15|45|3|25 - http://elgea.illyriad.co.uk/#/World/Map/199/-365" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/199/-365
135329|261|933|2|3|2|3|15|45|3|3 - http://elgea.illyriad.co.uk/#/World/Map/261/933" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/261/933
1286116|473|358|2|4|1|1|17|45|3|11 - http://elgea.illyriad.co.uk/#/World/Map/473/358" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/473/358
2152600|524|-75|1|3|2|1|18|45|3|16 - http://elgea.illyriad.co.uk/#/World/Map/524/-75" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/524/-75
599854|554|701|1|3|1|3|17|45|3|5 - http://elgea.illyriad.co.uk/#/World/Map/554/701" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/554/701
2696920|572|-347|2|1|4|2|16|43|3|27 - http://elgea.illyriad.co.uk/#/World/Map/572/-347" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/572/-347
1248430|806|377|3|1|3|2|16|45|3|12 - http://elgea.illyriad.co.uk/#/World/Map/806/377" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/806/377
2409017|813|-203|1|3|2|1|18|45|3|20 - http://elgea.illyriad.co.uk/#/World/Map/813/-203" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/813/-203
1604630|828|199|2|4|1|1|17|45|3|10 - http://elgea.illyriad.co.uk/#/World/Map/828/199" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/828/199
428052|838|787|2|1|1|5|16|45|3|5 - http://elgea.illyriad.co.uk/#/World/Map/838/787" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/838/787
2359032|853|-178|4|1|2|2|16|45|3|20 - http://elgea.illyriad.co.uk/#/World/Map/853/-178" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/853/-178
2361046|866|-179|2|2|2|4|15|45|3|20 - http://elgea.illyriad.co.uk/#/World/Map/866/-179" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/866/-179
2127017|954|-62|1|3|1|2|18|45|3|20 - http://elgea.illyriad.co.uk/#/World/Map/954/-62" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/954/-62
2343139|968|-170|2|1|3|3|16|45|3|20 - http://elgea.illyriad.co.uk/#/World/Map/968/-170" rel="nofollow - http://elgea.illyriad.co.uk/#/World/Map/968/-170



-------------
http://www.digioso.org" rel="nofollow">


Posted By: IbnSenna
Date Posted: 15 Feb 2015 at 14:54
Mind also that 'mirror' servers:
http://data-root.illyriad.co.uk/datafile_worldmap.txt
http://data.illyriad.co.uk/datafile_worldmap.txt

are usually inconsistent, even after the daily update!
data-root is most of the time more accurate, but not everyday…




Posted By: Digioso
Date Posted: 15 Feb 2015 at 17:19
I'm using http://data-root.illyriad.co.uk/datafile_worldmap.txt .

-------------
http://www.digioso.org" rel="nofollow">


Posted By: Digioso
Date Posted: 05 Mar 2017 at 08:34
Unfortunately there still hasn't been any change on this.
The data is still not accurate.

For example:

Square -612|-278

From today worldmap datafile:
2557667|-612|-278|0|0|0|0|9|18|7|24
TerrainCombatTypeID = 7

From the terrain combat data XML file:
<terraincombat><terraincombattype id="7">Plains</terraincombattype></terraincombat>

So it should be on plains but in the game this square is a Small hill.


-------------
http://www.digioso.org" rel="nofollow">


Posted By: Bobtron
Date Posted: 05 Mar 2017 at 21:56
yep, ive noticed this problem ever since i started working with datafiles 9 months ago

best workaround ive found is that, since the terrain ids are accurate, is to manually make a datafile that has the corresponding TerrainCombatTypeID to each of  the 229 TerrainIDs, and to discard the given TerrainCombatTypeID


-------------
I support the Undying Flame!


Posted By: Kalculas
Date Posted: 13 Mar 2017 at 05:18
How do we know that the combat terrain from the game map is the one actually used in a battle? I too want to believe that the combat terrain value matches up with the TerrainSpecificTypeID. That would mean that it's converted to something that it's not when it's written to the data file? Or are there two sources of world map data?



Print Page | Close Window

Forum Software by Web Wiz Forums® version 11.07 - http://www.webwizforums.com
Copyright ©2001-2016 Web Wiz Ltd. - https://www.webwiz.co.uk