Play Now Login Create Account
illyriad
  New Posts New Posts RSS Feed - Connectivity Issues - broken images, buttons etc
  FAQ FAQ  Forum Search   Register Register  Login Login

Topic ClosedConnectivity Issues - broken images, buttons etc

 Post Reply Post Reply Page  <12
Author
GM Luna View Drop Down
New Poster
New Poster
Avatar
Community Manager

Joined: 22 Oct 2011
Location: Illyriad
Status: Offline
Points: 2042
Direct Link To This Post Posted: 08 Nov 2012 at 18:59
Intertube fairies? And here I thought servers were powered by hamsters. Shows how much I know about tech support. ;)





GM Luna | Illyriad Community Manager | community@illyriad.co.uk

Back to Top
GM Stormcrow View Drop Down
Moderator Group
Moderator Group
Avatar
GM

Joined: 23 Feb 2010
Location: Illyria
Status: Offline
Points: 3820
Direct Link To This Post Posted: 08 Nov 2012 at 18:55
Originally posted by dunnoob dunnoob wrote:

 For planned changes you could reduce the TTL (time to live, suggested DNS cache time). 

Yup.  

Unfortunately the DNS A/CNAME amend wasn't a planned change this time (or rather, we had to do it pretty much immediately when our CDN borked itself) and - unbeknownst to us - our old crossdomain TTL appears to have been increased to 86400 by our nameserver hosts when they moved over to IPv6, grrr.  But I decided not to mention all that in my original post...

As Elmindra says, the intertube fairies are fickle indeed.



Back to Top
Aeonflux View Drop Down
New Poster
New Poster
Avatar

Joined: 02 Nov 2012
Location: Crockett, CA
Status: Offline
Points: 13
Direct Link To This Post Posted: 08 Nov 2012 at 18:54
thanks SC! quick response as well, and LOL @ Elmindra. Not sure what we would could expect differently from routing fairies, since they only work for dust and such. LOL
Back to Top
belargyle View Drop Down
Forum Warrior
Forum Warrior
Avatar

Joined: 17 Jun 2010
Location: USA
Status: Offline
Points: 401
Direct Link To This Post Posted: 08 Nov 2012 at 18:52
Not sure if what I am experiencing is the same thing. But I did get a whole bunch of broken images, then I refreshed the page an all the icons were no longer there. So I logged out, and now I cannot log back in. The login page uploads fine, and I can place my name and password in but it will not respond to my trying to login via mouse, enter key or anything.. even hitting the computer didn't work :)  I can't even login under my alt.

Is this part of it?
Back to Top
dunnoob View Drop Down
Postmaster
Postmaster
Avatar

Joined: 10 Dec 2011
Location: Elijal
Status: Offline
Points: 800
Direct Link To This Post Posted: 08 Nov 2012 at 18:43
Originally posted by GM Stormcrow GM Stormcrow wrote:

The speed of this propagation is, however, something we don't have much control over - but can take up to 48 hours, depending on how "mainstream" or "backwoods" your Internet Service Provider is. 
For planned changes you could reduce the TTL (time to live, suggested DNS cache time).  Against all odds my ISP refused to be a part of the backwoods today, and everything works with msecnd.net.
Back to Top
Elmindra View Drop Down
Forum Warrior
Forum Warrior
Avatar

Joined: 10 Sep 2012
Status: Offline
Points: 464
Direct Link To This Post Posted: 08 Nov 2012 at 18:36
Thanks for the quick update and we understand that the interwebs is one giant maze of tubes where sometimes the routing fairies decide to go on strike.
Back to Top
GM Stormcrow View Drop Down
Moderator Group
Moderator Group
Avatar
GM

Joined: 23 Feb 2010
Location: Illyria
Status: Offline
Points: 3820
Direct Link To This Post Posted: 08 Nov 2012 at 18:23
Hi everyone,

tldr Summary
We're aware that some players are experiencing connectivity issues to Illy at the moment.

These issues manifest themselves as broken images, missing buttons, and as broken scripts that can prevent much of the illy functionality from initialising.

Only a small subset of users are affected by this... and it will resolve itself shortly.

Problem 1 - the CDN
We use a Content Delivery Network (CDN) to deliver our "most loaded/greatest bandwidth" files to each player's web browser. These files almost entirely consist of images and script files. 

The reason why we use a CDN is that they generally can deliver these larger files to each player more reliably and speedily than our servers can, as the CDNs use servers located geographically close to each individual player.

The problem is that our (now old) CDN (Rackspace/Akamai) has had a repeat of the same issue we experienced about a month ago (as noted here) and apparently are unable to rectify the issue with any sense of urgency.

We've thrown our bill-paying toys out of the corporate perambulator, and have switched CDN providers so as to (hopefully) avoid this kind of problem in the future.  

This has required us to re-point our CDN content domain names - in the form of cdnX.illyriad.co.uk - from the faulty CDN provider to our new CDN provider.

Problem 2 - a corrupt upstream routing table
Slightly exacerbating the CDN issue for some people is that, close upstream from the elgea server (based in Tampa, Florida), one of our 4 backbone internet providers (Level3 in this case) experienced a corrupt routing table at their Miami hub.

This meant that players on certain parts of the internet (notably Verizon users in the south and south-west) may have potentially experienced a brief double-whammy of technical issues.  Our ISP quickly rerouted traffic bound in that direction onto the other backbone providers, and Level3 quickly offlined the corrupted router.  But this second issue won't have helped anything.

Who is affected
Anyone who had the existing images and scripts in their local browser cache would not be experiencing this issue, and anyone whose Internet Service Providers' DNS boxes have caught up with the change will similarly be fine.  

You'll know if this issue is affecting you, as your User Interface may be partially or completely broken, with missing or broken images being the most obviously visible symptom.

Actual ongoing gameplay (completion of ongoing construction, research or military orders etc) is entirely unaffected, for all users.

The Solution
The downside of this issue is that it takes the internet's Domain Name Servers (DNS) a while to catch up with the propagation of the amended record of the domain names we use for content delivery. 

Our primary, authoritative nameservers are based in the United Kingdom at the Telehouse in London's Docklands (sort of the European equivalent of Carrier Hotel in New York), so the propagation out from us has been fairly swift.

The speed of this propagation is, however, something we don't have much control over - but can take up to 48 hours, depending on how "mainstream" or "backwoods" your Internet Service Provider is. 

Entirely anecdotally... 3 hours ago I was experiencing some broken images, but my ISP (in the southern USA where I currently am located) has now caught up and everything is working again for me - so the DNS changes are definitely propagating around.

------

We're very sorry if you're one of those players who have experienced these issues.  

Unfortunately, neither issue was of our own making, and there's nothing we could have done (or can do now) to rectify either issue more speedily, as they're both entirely out of our control.  We can but hope that our new CDN will be more reliable.

Best wishes,

SC


Edited by GM Stormcrow - 08 Nov 2012 at 19:40
Back to Top
 Post Reply Post Reply Page  <12
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.03
Copyright ©2001-2019 Web Wiz Ltd.