Daily XML dumps down |
Post Reply | Page <12 |
Author | ||
Albatross
Postmaster General Joined: 11 May 2011 Status: Offline Points: 1118 |
Post Options
Thanks(0)
|
|
BITS transfer service also seems to ignore the header, and cannot be set to explicitly unpack gzip on transfer. It does have a nice progress bar though :o] I think it's going to have to be decompressed inline at my end. It's no bother; just less tidy. No further action required. FYI, some issues are discussed here: > http://jon.netdork.net/2012/07/08/downloading-files-with-powershell/
|
||
|
||
Malek
Forum Warrior Joined: 09 Jul 2012 Location: Australia Status: Offline Points: 252 |
Post Options
Thanks(0)
|
|
Thanks for the Update TC. Now I better see if i can get it to work.
|
||
MoguI
New Poster Joined: 07 Feb 2013 Status: Offline Points: 28 |
Post Options
Thanks(0)
|
|
I am using php cron job and reading it as data stream to XMLReader. Adding 'compress.zlib://' before url makes it possible to read now.
PS: I missed this info yesterday and so my "intelligent" script deleted all abandoned towns from my database table as no more existent and so I lost info when those towns where abandoned. Therefore list of abandoned towns (http://www.puzzleslogic.com/illy/suspended_towns.php) now shows all as abandoned yesterday... and I can't fix that because I lost data, but it will fix itself during next 2 weeks... |
||
Albatross
Postmaster General Joined: 11 May 2011 Status: Offline Points: 1118 |
Post Options
Thanks(0)
|
|
Try having 'abandoned' and 'removed' as different data: 'abandoned' by checking town names for that text, and set Removed (Boolean: true when the town id is not present in the latest info).
Edited by Albatross - 31 Jan 2014 at 10:38 |
||
|
||
HonoredMule
Postmaster General Joined: 05 Mar 2010 Location: Canada Status: Offline Points: 1650 |
Post Options
Thanks(0)
|
|
Hopefully this serves as a good lesson in error handling. First get file, then verify file legit/download successful. Then and only then process data. PHP makes it very easy to do a lot with just a little code and that's a feature I well appreciate. But it's up to the developer to identify when code is doing too much at once and/or with too little oversight. Lesson 2 involves data retention and archival/backup, both for source data and running state. Edited by HonoredMule - 01 Feb 2014 at 19:15 |
||
"Apparently, quoting me is a 'thing' now."
- HonoredMule |
||
Samalander
New Poster Joined: 24 Dec 2012 Location: oregon Status: Offline Points: 39 |
Post Options
Thanks(0)
|
|
Does anyone know if this why Illytools is not updating city locations. Exodused 1 and alt made new 1 neither shows up.
|
||
ubluntu
Forum Warrior Joined: 24 Aug 2013 Status: Offline Points: 324 |
Post Options
Thanks(0)
|
|
I presume illytools will not get any new town data until Eaque updates the download url in his scripts as myself, HonoredMule, & Mogul had to.
|
||
Albatross
Postmaster General Joined: 11 May 2011 Status: Offline Points: 1118 |
Post Options
Thanks(0)
|
|
*nod* IllyTools has not updating its data since the end of last month, assumedly for exactly that reason.
|
||
|
||
Post Reply | Page <12 |
Tweet
|
Forum Jump | Forum Permissions You cannot post new topics in this forum You cannot reply to topics in this forum You cannot delete your posts in this forum You cannot edit your posts in this forum You cannot create polls in this forum You cannot vote in polls in this forum |