Eir rural FTTH thread III

Gonzo · 03-12-2019 2:59pm

tuxy wrote: »

I really think it is a problem with inex, see how pings to the UK are about the same with Eir and Airwire. Can you do a tracert to boards.ie?

See how it goes through inex? I don't believe Eir use inex for most connections in Ireland.

Tracert to boards.ie with Eir.

Tracing route to boards.ie [2606:4700:10::6814:4760]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms pool-ipv6-pd.agg2.dsn.bdt-fng.eircom.net [2001:bb6:5ced:9f58::1]
2 8 ms 4 ms 1 ms agg2.dsn.bdt-fng.eircom.net [2001:bb0:6:a08b::1]
3 2 ms 2 ms 2 ms br1.csg.border.eircom.net [2001:bb0:6:a127::1]
4 3 ms 2 ms 3 ms inex2.as13335.net [2001:7f8:18:12::61]
5 2 ms 2 ms 2 ms 2606:4700:10::6814:4760

Trace complete.

tuxy · 03-12-2019 3:00pm

I see, so it does use INEX. There goes that theory.

AirBiscuit · 03-12-2019 3:38pm

Some additional perspective

tuxy · 03-12-2019 3:42pm

So westnet don't have the same problem. Could the issue be with INEX1 and not INEX2?
Martin did say INEX Lan#2 was currently down for them.

tsue921i8wljb3 · 03-12-2019 3:49pm

tuxy wrote: »

So westnet don't have the same problem. Could the issue be with INEX1 and not INEX2?
Martin did say INEX Lan#2 was currently down for them.

The hop after your router is taking 10ms. I don't think the issue is INEX.

Ping 93.89.255.24

tuxy · 03-12-2019 3:54pm

Ameer Howling Baritone wrote: »

The hop after your router is taking 10ms. I don't think the issue is INEX.

Ping 93.89.256.24

Good point. But the first hop when pinging UK servers is also 10ms and I get lower latency to the UK than Ireland, that's what I find confusing.

tsue921i8wljb3 · 03-12-2019 3:58pm

tuxy wrote: »

Good point. But the first hop when pinging UK servers is also 10ms and I get lower latency to the UK than Ireland, that's what I find confusing.

Post a traceroute to bbc.co.uk

tuxy · 03-12-2019 4:01pm

Ameer Howling Baritone wrote: »

Post a traceroute to bbc.co.uk

tsue921i8wljb3 · 03-12-2019 4:19pm

Tracing route to bbc.co.uk [151.101.0.81]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.15.1
  2     5 ms     1 ms     1 ms  
  3     6 ms     2 ms     2 ms  eth-trunk108.hcore1.mgr.core.eircom.net [86.43.12.190]
  4     7 ms     3 ms     3 ms  fe2-0.bas1.mvw.galway.eircom.net [159.134.123.5]
  5     3 ms     3 ms     3 ms  lag-50-br1-csg-hcore1-bdt.br1.csg.border.eircom.net [86.43.10.163]
  6     3 ms     3 ms     4 ms  be5608.rcr21.dub01.atlas.cogentco.com [149.6.5.129]
  7     4 ms     4 ms     4 ms  be2530.rcr21.dub02.atlas.cogentco.com [130.117.2.230]
  8     3 ms     3 ms     3 ms  fastly.demarc.cogentco.com [149.11.36.18]
  9     3 ms     3 ms     3 ms  151.101.0.81

On eir. I'm in Meath and it's going through Galway and still hitting BBC in 3ms

tsue921i8wljb3 · 03-12-2019 4:39pm

Actually I think all these UK traces are bogus. I believe there may be some CDN going on where it is routing to Irish IPs. This would be more typical of a UK route for me:

Tracing route to linx-gw1.ja.net [195.66.224.15]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.15.1
  2    15 ms     3 ms     3 ms  
  3     6 ms     2 ms     2 ms  eth-trunk108.hcore1.dbc.core.eircom.net [86.43.12.188]
  4     8 ms     4 ms     4 ms  eth-trunk13.hcore1.bdt.core.eircom.net [159.134.123.1]
  5    12 ms    12 ms    12 ms  lag-15-br1-thn-hcore1-bdt.br1.thn.border.eircom.net [86.43.255.199]
  6    12 ms    12 ms    12 ms  linx-gw1.ja.net [195.66.224.15]

Most (all?) of the UK traffic from eir goes through that 5th hop at thn which I believe is Telehouse North in London.

It would be interesting to see the Westnet and Airwire or other pings to 195.66.224.15

cnocbui · 03-12-2019 5:41pm

Ameer Howling Baritone wrote: »

Tracing route to bbc.co.uk [151.101.0.81]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.15.1
  2     5 ms     1 ms     1 ms  
  3     6 ms     2 ms     2 ms  eth-trunk108.hcore1.mgr.core.eircom.net [86.43.12.190]
  4     7 ms     3 ms     3 ms  fe2-0.bas1.mvw.galway.eircom.net [159.134.123.5]
  5     3 ms     3 ms     3 ms  lag-50-br1-csg-hcore1-bdt.br1.csg.border.eircom.net [86.43.10.163]
  6     3 ms     3 ms     4 ms  be5608.rcr21.dub01.atlas.cogentco.com [149.6.5.129]
  7     4 ms     4 ms     4 ms  be2530.rcr21.dub02.atlas.cogentco.com [130.117.2.230]
  8     3 ms     3 ms     3 ms  fastly.demarc.cogentco.com [149.11.36.18]
  9     3 ms     3 ms     3 ms  151.101.0.81

On eir. I'm in Meath and it's going through Galway and still hitting BBC in 3ms

You must be special.

Ping has started…

PING bbc.co.uk (151.101.64.81): 56 data bytes
64 bytes from 151.101.64.81: icmp_seq=0 ttl=56 time=13.815 ms
64 bytes from 151.101.64.81: icmp_seq=1 ttl=56 time=18.857 ms
64 bytes from 151.101.64.81: icmp_seq=2 ttl=56 time=19.514 ms
64 bytes from 151.101.64.81: icmp_seq=3 ttl=56 time=14.848 ms
64 bytes from 151.101.64.81: icmp_seq=4 ttl=56 time=19.133 ms
64 bytes from 151.101.64.81: icmp_seq=5 ttl=56 time=16.456 ms
64 bytes from 151.101.64.81: icmp_seq=6 ttl=56 time=18.850 ms
64 bytes from 151.101.64.81: icmp_seq=7 ttl=56 time=18.684 ms
64 bytes from 151.101.64.81: icmp_seq=8 ttl=56 time=18.020 ms
64 bytes from 151.101.64.81: icmp_seq=9 ttl=56 time=15.765 ms

--- bbc.co.uk ping statistics ---
10 packets transmitted, 10 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 13.815/17.394/19.514/1.915 ms

traceroute to bbc.co.uk (151.101.64.81), 64 hops max, 72 byte packets
1 192.168.178.1 (192.168.178.1) 4.607 ms 1.680 ms 1.054 ms
2 ptr-93-89-255-24.ip.airwire.ie (93.89.255.24) 13.276 ms 13.437 ms 14.006 ms
3 ptr-91-189-64-166.ip.airwire.ie (91.189.64.166) 13.773 ms 12.697 ms 13.713 ms
4 mpls3.ctw.dub.airwire.ie (93.89.255.49) 12.061 ms 14.792 ms 15.078 ms
5 mpls2.ctw.dub.airwire.ie (93.89.255.252) 16.131 ms 16.876 ms 15.981 ms
6 freki.ctw.dub.airwire.ie (93.89.255.203) 11.596 ms 12.590 ms 13.776 ms
7 92-51-193-189.broadband.digiweb.ie (92.51.193.189) 14.918 ms 14.731 ms 15.974 ms
8 78.137.184.210 (78.137.184.210) 15.998 ms 12.244 ms 12.945 ms
9 * * *
10 78.137.184.191 (78.137.184.191) 19.182 ms 16.762 ms 15.992 ms
11 be2530.rcr21.dub02.atlas.cogentco.com (130.117.2.230) 17.008 ms 20.176 ms 17.041 ms
12 fastly.demarc.cogentco.com (149.11.36.10) 17.102 ms 16.896 ms 14.078 ms
13 151.101.64.81 (151.101.64.81) 16.273 ms 12.359 ms 12.760 ms

Airwire: MartinL · 03-12-2019 6:00pm

We have updated the database for OpenEIR FTTC/FTTH today.

It can be found at https://www.airwire.ie/avail

tuxy · 03-12-2019 6:03pm

Ameer Howling Baritone wrote: »

It would be interesting to see the Westnet and Airwire or other pings to 195.66.224.15

That IP is unreachable for me with Airwire.

UK IPs still 3ms quicker than Irish ones......

Airwire: MartinL · 03-12-2019 6:25pm

Johnboy1951 wrote: »

I am obviously not one of those badly affected by whatever is going on ..... Airwire connection ......

$ ping -c 5 boards.ie
PING boards.ie (104.20.71.96) 56(84) bytes of data.
64 bytes from 104.20.71.96: icmp_req=1 ttl=56 time=14.7 ms
64 bytes from 104.20.71.96: icmp_req=2 ttl=56 time=12.7 ms
64 bytes from 104.20.71.96: icmp_req=3 ttl=56 time=13.6 ms
64 bytes from 104.20.71.96: icmp_req=4 ttl=56 time=14.1 ms
64 bytes from 104.20.71.96: icmp_req=5 ttl=56 time=12.5 ms

--- boards.ie ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4006ms
rtt min/avg/max/mdev = 12.579/13.560/14.741/0.825 ms

Is this a little unstable?

The reason that could vary is, if boards for example has a cluster and you are hitting a different server with each ping. Different load on different servers.

Also, a lot of routers do not prioritize ping requests from clients, which can show up as slightly higher ping times or packet loss on a traceroute at times, when an end to end ping has no packet loss.

Generally something to know about INEX also is, that even though traffic goes through INEX, the other peer may have their servers and equipment in a different part of the world. On a long tail.

For irish servers, that's rarely the case though.

Airwire: MartinL · 03-12-2019 6:30pm

Ameer Howling Baritone wrote: »

It would be interesting to see the Westnet and Airwire or other pings to 195.66.224.15

tuxy wrote: »

That IP is unreachable for me with Airwire

That is because the IP address belongs to LINX, which is the London Internet Exchange.

Internet Exchange IP addresses are not globally routed. You can only reach them, if an Internet Provider is directly connected to said exchange.

tsue921i8wljb3 · 03-12-2019 7:20pm

tuxy wrote: »

That IP is unreachable for me with Airwire.

UK IPs still 3ms quicker than Irish ones......

What UK IPs are you trying? The bbc.co.uk is not a UK IP. It is using Fastly which is routing you to an Irish server as part of a CDN most likely.

Try a traceroute to mirrorservice.org

tuxy · 03-12-2019 7:26pm

Ameer Howling Baritone wrote: »

What UK IPs are you trying? The bbc.co.uk is not a UK IP. It is using Fastly which is routing you to an Irish server as part of a CDN most likely.

Try a traceroute to mirrorservice.org

ah, that makes more sense, 18 hops about 29ms.

AirBiscuit · 03-12-2019 7:46pm

Ameer Howling Baritone wrote: »

It would be interesting to see the Westnet and Airwire or other pings to 195.66.224.15

C:\Users\jimmy>tracert 195.66.224.15
 
Tracing route to linx-gw1.ja.net [195.66.224.15]
over a maximum of 30 hops:
 
  1    <1 ms    <1 ms    <1 ms  fritz.box [192.168.178.1]
  2     *        5 ms     5 ms  10g-pppoe2-r2.lo0.westnet.ie [88.81.98.23]
  3     *        *        *     Request timed out.
   4  wn-edge-r01-10g0.vl304.westnet.ie [88.81.100.33]  reports: Destination net unreachable.


Trace complete

The mystery deepens.

EDIT: No it doesn't, just read this page of posts.

tsue921i8wljb3 · 03-12-2019 8:29pm

tuxy wrote: »

ah, that makes more sense, 18 hops about 29ms.

Yeah, you need to be sure that the server you are testing against is actually in the UK and not using any of the various CDN services.

Tracing route to mirrorservice.org [212.219.56.184]
over a maximum of 30 hops:

  1    <1 ms    <1 ms    <1 ms  192.168.15.1
  2     2 ms     1 ms     1 ms  
  3     6 ms     2 ms     2 ms  eth-trunk108.hcore1.dbc.core.eircom.net [86.43.12.188]
  4     8 ms     3 ms     3 ms  eth-trunk13.hcore1.bdt.core.eircom.net [159.134.123.1]
  5    12 ms    12 ms    12 ms  lag-15-br1-thn-hcore1-bdt.br1.thn.border.eircom.net [86.43.255.199]
  6    12 ms    12 ms    12 ms  linx-gw1.ja.net [195.66.224.15]
  7    12 ms    12 ms    12 ms  ae23.londtt-sbr1.ja.net [146.97.35.169]
  8    14 ms    12 ms    12 ms  ae28.londtw-sbr2.ja.net [146.97.33.62]
  9    14 ms    14 ms    14 ms  kpsn.londtw-sbr2.ja.net [146.97.41.86]
 10    15 ms    15 ms    15 ms  ic-wye-site.kentman.ac.uk [212.219.171.138]
 11     *        *        *     Request timed out.
 12     *        *        *     Request timed out.
 13    14 ms    14 ms    13 ms  uok-c-site.kentman.ac.uk [212.219.171.130]
 14    14 ms    18 ms    15 ms  mirror-fw-cdc.kent.ac.uk [129.12.254.90]
 15    14 ms    14 ms    14 ms  www.mirrorservice.org [212.219.56.184]

Trace complete.

limnam · 03-12-2019 9:01pm

Was fine for me a few minutes ago

now speed tests drop off to everywhere and will probably be like this till about midnight

tuxy · 03-12-2019 9:04pm

limnam wrote: »

Was fine for me a few minutes ago

now speed tests drop off to everywhere and will probably be like this till about midnight

I'm getting close to full speed right now but not the full speed that I had always get no matter the time of day since I got FTTH just over a year ago.
So it's not terrible but something is not quite right.

Headshot · 03-12-2019 9:07pm

It is really strange that during the day speed tests to airwire always come back in the 900s but come around this time frame the speeds really reduce:

https://www.speedtest.net/result/8820029167

I do the same speeds to Blacknight and no issues
https://www.speedtest.net/result/8820026695

tuxy · 03-12-2019 9:09pm

Headshot wrote: »

It is really strange that during the day speed tests to airwire always come back in the 900s but come around this time frame the speeds really reduce:

https://www.speedtest.net/result/8820029167

I do the same speeds to Blacknight and no issues
https://www.speedtest.net/result/8820026695

Interesting that it's like that for people connecting to the airwire network from outside.
This is new, it was never like this until the last few days. The airwire sever on speedtest used to be the go to for reliability.

limnam · 03-12-2019 9:17pm

Headshot wrote: »

It is really strange that during the day speed tests to airwire always come back in the 900s but come around this time frame the speeds really reduce:

https://www.speedtest.net/result/8820029167

I do the same speeds to Blacknight and no issues
https://www.speedtest.net/result/8820026695

This is interesting

Airwire: MartinL · 03-12-2019 9:22pm

We have actually identified an issue with our router on INEX Lan#1. It's not a capacity issue.

It only became evident with the extra load from shutting Lan#2 down.

Other upstream connections are not affected.

This will be sorted in the next day or two, as the replacement has to be tested thoroughly first, so we don't end up with the same issue.

limnam · 03-12-2019 9:27pm

Thanks Martin.

I'll stop hammering speedtest.net and go back to using a few kb/s on irc :pac::pac:

tuxy · 03-12-2019 9:27pm

Thanks for the update Martin, that's reassuring. It's not too bad for me but not as good as the service normally is and I was worried it would continue to get worse if left undiagnosed.

I too will leave speedtest alone and return to my VOIP calls :P

Hammurabi · 04-12-2019 1:00pm

Airwire: MartinL wrote: »

We have actually identified an issue with our router on INEX Lan#1. It's not a capacity issue.

It only became evident with the extra load from shutting Lan#2 down.

Other upstream connections are not affected.

This will be sorted in the next day or two, as the replacement has to be tested thoroughly first, so we don't end up with the same issue.

Thanks Martin. This kind of transparency is to be applauded. Don't think I've seen any other ISPs explain issues so openly, even relatively minor ones like this.

Also, good lobbying by limnam and tuxy :-)

limnam · 04-12-2019 1:49pm

Hammurabi wrote: »

Thanks Martin. This kind of transparency is to be applauded. Don't think I've seen any other ISPs explain issues so openly, even relatively minor ones like this.

Also, good lobbying by limnam and tuxy :-)

Some ISP's could do themselves some favors and learn from Martin

Thanks for leaving us in the lurch Ham! :pac:

Headshot · 06-12-2019 8:06pm

Oh interesting i've read some paper work from Open Eir that the 500MB profile is coming

What's happening is users that are on 300MB will be upgraded to 500MB

Eir rural FTTH thread III

Comments