Play Now Login Create Account
illyriad
  New Posts New Posts RSS Feed - Index/landing page for data downloads
  FAQ FAQ  Forum Search   Register Register  Login Login

Topic ClosedIndex/landing page for data downloads

 Post Reply Post Reply Page  12>
Author
 Rating: Topic Rating: 3 Votes, Average 4.67  Topic Search Topic Search  Topic Options Topic Options
Blargh View Drop Down
New Poster
New Poster
Avatar

Joined: 26 Apr 2012
Location: Alberta, Canada
Status: Offline
Points: 25
Direct Link To This Post Topic: Index/landing page for data downloads
    Posted: 26 Apr 2012 at 06:47
Would it be possible to add an index/landing page to  http://elgea.illyriad.co.uk/data_downloads/ such that it displays a summary of the available feeds?

Something like this:

Name
URL
Description
Size (KB)
Refresh Rate (hours)
Updated
Terrain type
...
13,000
24
2012-04-26T00:21:13Z
Combat Terrain type
...
???
24
2012-04-26T00:21:13Z

The fields would be as such:

Name: Friendly name
URL: Fully-specified hyperlink to teh goods. J
Description: Format-specific notes, i.e.:
  • It is in a txt flat-file format to save space.
  • The first row contains column headers.
  • It is column-delimited by a Vertical Bar, like this: |
  • It is row-delimited by <CR><LF>
  • TerrainTypeID in the flat-file links to the terraintype id in the datafile_terrain.xml file
  • TerrainCombatTypeID in the flat-file links to the terraincombattype id  in the datafile_terrain_combat.xml file
Size: Size of the (current) file in Kilobytes.
Refresh Rate: How often users should expect changes, i.e. “If it says 24 hours, don’t keep hitting this URL every 10 minutes…”
Updated: A timestamp of the last refresh in ISO 8601 format (at Zulu time in case of server migration to other timezones) J

This would consolidate the list of available feeds into a single location (rather than buried in the forum) and provide additional useful metadata (size, last updated, etc.).
Back to Top
dunnoob View Drop Down
Postmaster
Postmaster
Avatar

Joined: 10 Dec 2011
Location: Elijal
Status: Offline
Points: 800
Direct Link To This Post Posted: 08 Jul 2012 at 03:56
Bump.  
Back to Top
Machete View Drop Down
Wordsmith
Wordsmith
Avatar

Joined: 15 Jun 2012
Location: Koz
Status: Offline
Points: 172
Direct Link To This Post Posted: 09 Jul 2012 at 03:42
Here are the 6 I have found. Would be nice to know if there are more.

http://elgea.illyriad.co.uk/data_downloads/datafile_towns.xml
http://elgea.illyriad.co.uk/data_downloads/datafile_players.xml
http://elgea.illyriad.co.uk/data_downloads/datafile_alliances.xml
http://elgea.illyriad.co.uk/data_downloads/datafile_worldmap.txt
http://elgea.illyriad.co.uk/data_downloads/datafile_terrain.xml
http://elgea.illyriad.co.uk/data_downloads/datafile_terrain_combat.xml
Back to Top
dunnoob View Drop Down
Postmaster
Postmaster
Avatar

Joined: 10 Dec 2011
Location: Elijal
Status: Offline
Points: 800
Direct Link To This Post Posted: 09 Jul 2012 at 06:48
Great, I didn't know alliances, thanks.
Back to Top
allamagoosa View Drop Down
Greenhorn
Greenhorn
Avatar

Joined: 17 Jul 2012
Location: California, USA
Status: Offline
Points: 78
Direct Link To This Post Posted: 30 Jul 2012 at 23:24
I would like to know if there are others as well.
Back to Top
Prakarp View Drop Down
New Poster
New Poster
Avatar

Joined: 14 Aug 2012
Location: Azura
Status: Offline
Points: 8
Direct Link To This Post Posted: 14 Aug 2012 at 22:22
Now that Trade v2 is out, is there an additional XML file detailing Trade v2 locations?
Back to Top
Salararius View Drop Down
Postmaster
Postmaster
Avatar

Joined: 26 Sep 2011
Location: USA
Status: Offline
Points: 519
Direct Link To This Post Posted: 22 Oct 2012 at 02:57
I was looking at the datafiles and trying to decide if there is anything that hasn't already been done with the information.  While doing so I pulled out the following guesses at their structure.  Here is that information in DTD format for the XML files and the delimited fields for the delimited file if it's helpful to anyone.

*************************************************************************
************************** datafile_worldmapl.txt ***********************
*************************************************************************
delimited text file with '|' delimiters.

The fields are:
GeoID
X
Y
Wood
Clay
Iron
Stone
Food
TerrainSpecificTypeID
TerrainCombatTypeID
RegionID

*************************************************************************
**************************** datafile_towns.xml *************************
*************************************************************************
<!ELEMENT towns (server, town*)>

<!ELEMENT server (name, servername, servercountrycode, serverlanguagecode, serverlivedate, datagenerationdatetime)>
<!ELEMENT name (#CDATA)>
<!ELEMENT servername (#CDATA)>
<!ELEMENT servercountrycode (#CDATA)>
<!ELEMENT serverlanguagecode (#CDATA)>
<!ELEMENT serverlivedate (#CDATA)>
<!ELEMENT datagenerationdatetime (#CDATA)>

<!ELEMENT town (location, player, towndata)>

<!ELEMENT location (mapx, mapy, terraintype, terrainoveralltype)>
<!ELEMENT mapx (#CDATA)>
<!ELEMENT mapy (#CDATA)>
<!ELEMENT terraintype (#CDATA)>
<!ATTLIST terraintype id CDATA #REQUIRED>
<!ELEMENT terrainoveralltype (#CDATA)>
<!ATTLIST terrainoveralltype id CDATA #REQUIRED>

<!ELEMENT player (playername, playerrace, playeralliance?)>
<!ELEMENT playername (#CDATA)>
<!ATTLIST playername id CDATA #REQUIRED>
<!ELEMENT playerrace (#CDATA)>

<!ELEMENT playeralliance (alliancename, allianceticker, alliancetaxrate)>
<!ELEMENT alliancename (#CDATA)>
<!ATTLIST alliancename id CDATA #REQUIRED>
<!ELEMENT allianceticker (#CDATA)>
<!ELEMENT alliancetaxrate (#CDATA)>

<!ELEMENT towndata (townname, foundeddatetime, population, iscapitalcity, isalliancecapitalcity)>
<!ELEMENT townname (#CDATA)>
<!ATTLIST townname id #CDATA #REQUIRED>
<!ELEMENT foundeddatetime (#CDATA)>
<!ELEMENT population (#CDATA)>
<!ELEMENT iscapitalcity (#CDATA)>
<!ELEMENT isalliancecapitalcity (#CDATA)>

*************************************************************************
*********************** datafile_alliances.xml **************************
*************************************************************************
<!ELEMENT alliancedata (server, alliances)>

<!ELEMENT server (name, servercountrycode, serverlanguagecode, serverlivedate, datagenerationdatetime)>
<!ELEMENT name (#CDATA)>
<!ELEMENT servercountrycode (#CDATA)>
<!ELEMENT serverlanguagecode (#CDATA)>
<!ELEMENT serverlivedate (#CDATA)>
<!ELEMENT datagenerationdatetime (#CDATA)>

<!ELEMENT alliances (alliance*)>

<!ELEMENT alliance (alliance, foundedbyplayerid, alliancecapitaltownid, allianceticker, foundeddatetime, alliancecapitallastmoved, alliancetaxrate, alliancetaxratelastchanged, membercount, totalpopulation, roles, relationships)>
<!ELEMENT alliance (#CDATA)>
<!ATTLIST alliance id #CDATA #REQUIRED>
<!--this doesn't seem strict, this 'alliance' element is the child of the previous 'alliance' element, but I don't think they are the same element (I don't think alliances can be inside alliances forever nested).  I think it's supposed to be a separate element.  This XML will never parse or I don't understand how it's supposed to work and I've written it wrong here-->
<!ELEMENT foundedbyplayerid EMPTY>
<!ATTLIST foundedbyplayerid id #CDATA #REQUIRED>
<!ELEMENT alliancecapitaltownid EMPTY>
<!ATTLIST alliancecapitaltownid id #CDATA #REQUIRED>
<!ELEMENT allianceticker (#CDATA)>
<!ELEMENT foundeddatetime (#CDATA)>
<!ELEMENT alliancecapitallastmoved (#CDATA)>
<!ELEMENT alliancetaxrate (#CDATA)>
<!ELEMENT alliancetaxratelastchanged (#CDATA)>
<!ELEMENT membercount (#CDATA)>
<!ELEMENT totalpopulation (#CDATA)>
<!ELEMENT roles (role*)>
<!ELEMENT relationships (relationship*)>

<!ELEMENT role (role, heirarchy)>
<!ELEMENT role (#CDATA> <!--same questions as above, this seems to be a different element, with different children, but with the same name-->
<!ATTLIST role id #CDATA #REQUIRED>
<!ELEMENT heirarchy EMPTY>
<!ATTLIST heirarchy id #CDATA #REQUIRED>

<!ELEMENT relationship (proposedbyalliance, acceptedbyalliance, relationshiptype, establishedsince)>
<!ELEMENT proposedbyalliance EMPTY>
<!ATTLIST proposedbyalliance id #CDATA #REQUIRED>
<!ELEMENT acceptedbyalliance EMPTY>
<!ATTLIST acceptedbyalliance id #CDATA #REQUIRED>
<!ELEMENT relationshiptype (#CDATA)>
<!ATTLIST relationshiptype id #CDATA #REQUIRED>
<!ELEMENT establishedsince (#CDATA)>

*************************************************************************
*************************** datafile_players.xml ************************
*************************************************************************
<!ELEMENT playerdata (server, players)>

<!ELEMENT server (name, servercountrycode, serverlanguagecode, serverlivedate, datagenerationdatetime)>
<!ELEMENT name (#CDATA)>
<!ELEMENT servercountrycode (#CDATA)>
<!ELEMENT serverlanguagecode (#CDATA)>
<!ELEMENT serverlivedate (#CDATA)>
<!ELEMENT datagenerationdatetime (#CDATA)>

<!ELEMENT players (player*)>
<!ELEMENT player (playername, allianceid, allianceroleid, race)>
<!ELEMENT playername (#CDATA)>
<!ATTLIST playername id #CDATA #REQUIRED>
<!ELEMENT allianceid EMPTY>
<!ATTLIST allianceid id #CDATA #REQUIRED>
<!ELEMENT allianceroleid EMPTY>
<!ATTLIST allianceroleid id #CDATA #REQUIRED>
<!ELEMENT race EMPTY>
<!ATTLIST race id #CDATA #REQUIRED>

*************************************************************************
**************************** datafile_terrain.xml ***********************
*************************************************************************
<!ELEMENT terraindata (server, terraintypes)>

<!ELEMENT server (name, servercountrycode, serverlanguagecode, serverlivedate, datagenerationdatetime)>
<!ELEMENT name (#CDATA)>
<!ELEMENT servercountrycode (#CDATA)>
<!ELEMENT serverlanguagecode (#CDATA)>
<!ELEMENT serverlivedate (#CDATA)>
<!ELEMENT datagenerationdatetime (#CDATA)>

<!ELEMENT terraintypes (terrain*)>
<!ELEMENT terrain (terrainspecifictype, impassableterrain, npcterrain)>
<!ELEMENT teterrainspecifictype rrainspecifictype (#CDATA)>
<!ATTLIST race id #CDATA #REQUIRED>
<!ELEMENT impassableterrain (#CDATA)>
<!ELEMENT npcterrain (#CDATA)>
*************************************************************************
************************** datafile_terrain_combat.xml ******************
*************************************************************************
<!ELEMENT terraincombatdata (server, terraincombattypes)>

<!ELEMENT server (name, servercountrycode, serverlanguagecode, serverlivedate, datagenerationdatetime)>
<!ELEMENT name (#CDATA)>
<!ELEMENT servercountrycode (#CDATA)>
<!ELEMENT serverlanguagecode (#CDATA)>
<!ELEMENT serverlivedate (#CDATA)>
<!ELEMENT datagenerationdatetime (#CDATA)>

<!ELEMENT terraincombattypes (terraincombat*)>
<!ELEMENT terraincombat (terraincombattype)>
<!ELEMENT terraincombattype (#CDATA)>
<!ATTLIST terraincombattype id #CDATA #REQUIRED>

Back to Top
dunnoob View Drop Down
Postmaster
Postmaster
Avatar

Joined: 10 Dec 2011
Location: Elijal
Status: Offline
Points: 800
Direct Link To This Post Posted: 22 Oct 2012 at 10:40
The W3 validator does not hate the alliances, but maybe it's lost without a DTD.  The files are rather long, adding DTDs at the top to get standalone XML files would be nice.  Or they could offer them also as less verbose CSV, JSON, record-JAR, whatever... <g,d,&r>
Back to Top
Salararius View Drop Down
Postmaster
Postmaster
Avatar

Joined: 26 Sep 2011
Location: USA
Status: Offline
Points: 519
Direct Link To This Post Posted: 23 Oct 2012 at 04:19
Originally posted by dunnoob dunnoob wrote:

The W3 validator does not hate the alliances, but maybe it's lost without a DTD.  The files are rather long, adding DTDs at the top to get standalone XML files would be nice.  Or they could offer them also as less verbose CSV, JSON, record-JAR, whatever... <g,d,&r>

I really can't explain myself, it's seems to be a fatal flaw :(   I shouldn't have said it wouldn't parse, you are right, of course it will.  I don't think the XML (or rather the DTD inferred from the XML) will enforce the structure the developers want because it allows an alliance element to be nested inside an alliance element (same for roles).  It only matters if someone is looking at my inferred DTD and trying to understand the data and doesn't realize that isn't possible.  If it is possible, then I don't know what that would mean in terms of the data and game.  If it isn't possible to nest alliance elements inside alliance elements then I haven't a clue how to represent that with a DTD structure to help people understand the data hierarchy (which was all I was trying to do for myself).

Back to Top
Rosenfield View Drop Down
New Poster
New Poster
Avatar

Joined: 08 Dec 2012
Status: Offline
Points: 14
Direct Link To This Post Posted: 23 Jan 2013 at 00:29
Has there been any progress with this issue? Any new data files or tools?
Back to Top
 Post Reply Post Reply Page  12>
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.03
Copyright ©2001-2019 Web Wiz Ltd.