Different issues here, assuming the trick is to isolate the latency factors relating (or un-relating in this case) to a particular beam:
1. User location: The use of geoip to determine user's location from the IP, doesn't work at all on satellite internet. Conversely, if the device being tested has fairly good gps and signal you might be ok for that. I know the gps on my iPhone is a lot more accurate than the one in my MacBook Pro - could be a problem if you're on the edge of a beam footprint. There may be some outliers in their database in that regard, so this is kind of a minimal risk.
2. Gateway provider: Have noticed that a certain provider (CenturyLink) randomly inserts 1-2 minute gaps in service on a national scale. Such an inconsistency would significantly vary the results for a particular beam that always routes to a gateway.
3. TestMy server location: Different locations are going to create different paths from the gateway. Assuming the CL gaps aren't there, you'd have to create a standard where certain beam/gateway combinations would use a specific TestMy server. For example, beam 68/SDO gateway (San Diego) would need to use the closest server in LA, not the default one in Dallas, because it would generate fewer hops. Depending upon the backbone (again, thinking about CL, which services most of the country now) fewer hops would reduce the risk of anything corrupting the test.
4. Time: Congestion varies over time and you'd have to compare with others doing the test within the same timeframe. It's not a safe bet that you'll get enough people doing tests from the same beam in the same timeframe, unless it's pre-coordinated.
If you can safely isolate these four things, the only thing left is latency due to beam congestion. Can be done, but it's just not real probable.
Edit: Almost forgot another real important one: Latency tests over TestMy aren't that accurate to begin with, so don't know if you could trust it for a viable comparison.
Yes, they do not have a correct location -- the city they determined for me was also in the wrong state. I am on the edge of the beam, and the city they selected as my location seemed to be toward the center of my beam. I came in with a different connection and got the same city an so I wondered how consistently they were choosing that city and more generally if others on the beam would get that same city. After digging through some tests I ran over a year ago, I see they had a different city chosen for my location -- also in a state different from me, but also toward the middle of the my beam, so it is not consistent.
So obviously since it does not consistently choose a city based upon the beam, it is impossible to compare a score against the average and know how your bandwidth compares to the beam in general -- as maratsade demonstrates by getting two different cities with different accounts. The gateways handle multiple beams in different time zones, but I did not see a city chosen based upon the location for one of those other beams, so it seems like they can narrow it down to a general geographic location based upon the beam, but can still be 100 miles off from the true location.
I was doing the bandwidth test -- I agree the TestMy.net latency test is fairly pointless especially as the HT2000W records average latency for every 5 minute and 1 hour period anyway.
The average score even for the bandwidth test would also not be an accurate measure not only for the reason you mention, but also because there are a lot of tests done on small test sizes which will not be accurate with satellite.
If you don't mind, what city did you get? Mark, I think you were beam 68 -- so did your city land toward to middle of beam 68 in northern VA?
Maratsade, would you mind sharing the cities you saw along with your beam? Or at least give a rough impression of how far the cities were from the center of your beam?
I dug through a bunch of cities this way, and the average seems to be around 35Mbps for what I thought were selected from J2 beams, and 25Mbps for J1 beams (which might be a combination of gen 4 and gen 5 services if I understand correctly), which is considerably better than what I imagined based upon reading posts on this site! It seems the great performance I get is not out of line with the areas I combed through. I did see a city on the edge between beam 68 and 69--far from the center of a J2 beam--that had an average of around 50Mbps, and they had run a lot of tests.
Thanks!
Beam 68 is centered somewhere on the line between Culpeper and Rapahannock County, Virginia. TestMy keeps thinking I'm in Boyce, which is way up in Clark County, east of Winchester. So, I don't think it's that. More likely it's using some combination of geoip and whatever location your browser thinks it's at.
Here's a link to the footprint for beam 68: https://satbeams.com/footprints?beam=10175
Incidentally, latency is usually the real tell that congestion exists because it will show delayed packets in the buffer. A beam could becoming congested and you'd not know it from looking at speed until the congestion becomes extreme. Then it's not just speed, but dropped packets as well, just because the system can't keep up with the buffered requests/responses.
MarkJFine wrote:Incidentally, latency is usually the real tell that congestion exists because it will show delayed packets in the buffer. A beam could becoming congested and you'd not know it from looking at speed until the congestion becomes extreme. Then it's not just speed, but dropped packets as well, just because the system can't keep up with the buffered requests/responses.
I agree -- if I download the log and graph the column of numbers behind the RTT flag, during normal week days for my beam it rises briefly at 2am, 3am, then rises 6:30am-7:30am, and does the big rise from 6:30pm to 11pm. The highest numbers usually are around 8:30pm. Other times it is at the minimum. This number appears to only include the time for the queueing up and ride over the satellite, as they have some other columns that look at the time past that. There is also a column for lost packets and %. If this number goes above 2000ms average for a 5 minute period, you get a red X on the 5 minute chart. If the 5 minute chart records 2 Xs (or maybe 3?) it gives a red X on the hourly chart -- simple and useful, I thought.
But while this seems to give some insight about my own beam and how busy it is at different times a day, it does not tell me anything about your beam.
If I was moving or considering Hughesnet, I think this gives me some idea what it is like around beam 68 recently. If this is way off from your expectation and experience, please do let me know. This score is not too shabby! This score looks decent since a bunch of these tests would have been run from phones over 2.4Ghz WiFi with small test blocks that lower the average!
Now on the other hand, if we find that 40 of these 109 tests were run from a beam in Idaho, and that the people shown here are not in beam 68, then this tells us very little.
I am running some more tests on my beam to see how much "salting" of the beam I can do since I am pulling around 50Mbps at the moment....
thanks, Mark. I thought maybe the center was somewhere around Culpeper.
"Maratsade, would you mind sharing the cities you saw along with your beam? Or at least give a rough impression of how far the cities were from the center of your beam?"
I'm on beam 68. Where's the center of this beam (as in, what city/town is closest)?
EDIT: Sometimes the "city" you get is "US."
OK, these are the approximate distances (in miles) from what looks like the town closest to the center of beam 68 (I'm guessing here, using SatBeams) and some of the towns/cities listed by TMN:
81, 75, 68, 55, 127, 35
maratsade wrote:OK, these are the approximate distances (in miles) from what looks like the town closest to the center of beam 68 (I'm guessing here, using SatBeams) and some of the towns/cities listed by TMN:
81, 75, 68, 55, 127, 35
Ok, I see -- I think you are showing the distance for different cities identified as your location to the approximate center of your beam, so with 127 miles it must be that any city in the beam can be shown and not just a city near (within 60 miles or so) of the center. 127 miles might almost be to the edge of the beam, so maybe the city I saw with the super fast Hughes net Mbps average could have been from someone in Maryland in (or there about) in either beam 68 or beam 69 since it was right at the edge. Maybe somebody with really good test scores decided to do a few hundred tests in the last week to get that high average for the city!
maratsade wrote:"Maratsade, would you mind sharing the cities you saw along with your beam? Or at least give a rough impression of how far the cities were from the center of your beam?"
I'm on beam 68. Where's the center of this beam?
EDIT: Sometimes the "city" you get is "US."
Do you not get a city doing this?
From TestMy.net, select from the DB menu 'TestMy.net Database'
2. This leads to this display -- is there not a city shown?
3. Clicking the City leads to a display like this (the graph below would include all ISPs):
4. Clicking on the ISPs tab shows this:
This city is pretty far from me, but it does apear to be roughly in the middle of beam 82. I see in the past I had a different city showing, but it was in the same rough location.
The averages shown here are lowered by tests with the wrong test size, but it does appear to include my tests, since when I run a test, the count here increases. I do not know what they mean by '64 tests recently' perhaps 64 tests in the last week?
The average looks good -- about what I get a lot, and the impression is that others in this beam that happen to get this city are getting similar performance and therefore beam 82 is *not* over sold :-)
Beam 68 appears to be centered over northern VA, right near the border of WV -- I am just going by that picture someone posted a while back. I saw a link to some satellite page that shows spot beam positions more accurately, but I don't know much about it other than looking at it once or twice noticing the handful of spot beams J2 has down around Ecuador and in Mexico.
"2. This leads to this display -- is there not a city shown?"
Yes, different cities with different tests. I thought you wanted to know how far they were from the center of beam 68. The distances to what I think is the center vary, as do the distances from each of these cities and my location.
