Design Article
Comment
Skip_B
chanj
The WAN throughput represents the utilization of the bandwidth, measuring the ...
Real-world testing of Wi-Fi hotspots
Dilip Advani, Fluke Networks
8/14/2012 11:03 AM EDT
Advanced Features
Many customers are getting increasingly more sophisticated in their IT skills and use of technology, such as with public IP addresses, VPN support, and even higher in-bound needs. Many smaller hotspots won’t need to address these more advanced features – but in airports, conference centers and hotels, the ability to offer access to these features will be paramount to those users who need them.
Now that we have a better understanding of the consumer expectation, how can a business measure and analyze hotspots to ensure performance?
There are two parts to every Wi-Fi hotspot service. The most obvious is the Wi-Fi component – the ability to use radio frequencies to transmit packets from the client devices to the Internet. The second, and just as important, is the backhaul to the Internet.
Many of the earlier pioneers of Wi-Fi systems mistakenly thought the main goal of designing Wi-Fi was all about the RF coverage, specifically the measure of received signal strength indicator (RSSI). This measurement is usually captured in decibels compared to one thousandth of a watt (dBm). Client devices have a calibrated receive sensitivity at different data rates, and they need a certain amount of RF signal above the ambient RF noise floor in able to operate.
Though measuring the RSSI in any given target area is certainly important and necessary, simply focusing on this alone is not sufficient. In order to capture, analyze, and report the performance of any given hotspot, it’s necessary to measure the actual throughput of data, not merely the RF energy. To do this, we need tools that can consistently replicate and collect data in a known method and repeatable format.
The first way to evaluate a hotspot is to use a tool to capture active Wi-Fi signals throughout the facility’s footprint to verify adequate RF coverage and performance. Professional tools, like Fluke Networks’ AirMagnet Survey PRO, will also provide helpful, visually appealing heat maps and full reporting capabilities.
Testing and Measuring Layers 1-3: RF, 802.11, and IP Connectivity
After RF coverage has been verified, the next step is to use tools to test and measure performance of the hotspot. Visualizing this performance in a “performance weather-map” can be extremely effective (see Figure 1). Below are a few of the metrics we’ll want to look for in our performance analysis:
RSSI : The amount of RF energy received at any given location and time.
Noise: This can be captured with a Wi-Fi network interface controller (NIC) to show packets flowing using RF in the area, and augmented by a spectrum analyzer to see non-modulated RF from other potentially interfering devices.
Signal to noise ratio (SNR): The difference between the RSSI and the noise floor. Higher SNR values are preferred and are indicative of higher data rates. The faster each client gets on and off the wireless medium, the more clients can share the frequency in the same space without causing interference.
Data rates: The total data transfer rate the device can handle.
Throughput: Throughput is usually defined as the amount of actual data that can be transferred across the network in a given amount of time. It is the only metric that can truly represent the true end-user experience for any connection. The actual throughput will always be lower than the data rate.
802.11 association: The 802.11 association is to Wi-Fi what a ‘link light’ is to an Ethernet connection. It is the minimum requirement that shows connectivity between the device and the rest of the local area network. In Wi-Fi connections, we need the basic service set identifier (BSSID) – or the MAC address of the access point we are connected to. This BSSID will be used to help move packets to and from the wireless network.
Dynamic host configuration protocol (DHCP): In order for any device to transmit packets to the Internet, it requires IP address information for the specific subnet it is connected to. Quick, repeatable DHCP responses, with complete answers, including default gateway, domain name system (DNS), and subnet mask information is a hard requirement.
At this point we have Layer 1 – RF, Layer 2 – 802.11, and Layer 3 – IP connectivity. This is the minimum in order to connect via the hotspot to the Internet. These together mean our client device is connected to the AP as well as through the AP back to at least the DHCP server. However, it is also important to test and measure the connection from the default gateway on to the Internet itself.
Testing and Measuring Default Gateway Connectivity to the Internet
To test off-site connectivity, use two standard internetworking tools – PING and TraceRoute. These tools provide metrics for how long and for how many hops it takes to get to a site on the Internet. The lower the PING times, the quicker the access. TraceRoute will show the total number of hops via routers on the Internet from the current location, to the designated target. These two show speed and distance, but not bandwidth. For that, additional tools are required.
To test the throughput to a target on the Internet, three other tools can provide more flow testing. The first is file transfer protocol (FTP) which is used to send large chunks of data to/from an FTP server. This is tested by simulating a large file download, and it is the first way to test throughput.
The second is to test HTTP file transfers. Again, this is just a way to force a client to send large amounts of data to a server on the Internet and capture the flow statistics. Finally, test the multimedia download, such as a streaming a video or audio file. These can be implemented to simulate watching a movie via Netflix, or listening to an audio stream via Pandora.
The best approach is to have all of these throughput tests running simultaneously, putting the most load on both the wireless and wired portions of the hotspot.
The Toolset
Using a professional toolset that combines all of the features needed to analyze and evaluate a combination of wireless and wired tools can be extremely efficient. The following example gets this functionality from a software solution, AirMagnet WiFi Analyzer PRO.
We used the system’s One-Touch Connection Test feature to perform 802.11 Association, ping, trace, FTP, HTTP, and multimedia testing across multiple locations in a simultaneous manner (see Figure 2). We used the system to generate a written report for customers and staff. The tool can also automate login and testing processes.
Hotspots are increasingly being used throughout business to bolster connectivity with customers, partners and employees. While the technology can (and will) vary, the need to properly evaluate and troubleshoot hotspots to ensure client satisfaction will always require testing and measurement.
If you are responsible for a Wi-Fi Hotspot, you might want to make it a quarterly process to test and evaluate your hotspot to make sure you are meeting the needs of your users. This way you can adjust and adapt your network, keeping it up-to-date with current technology and expectations.
About the Author
Dilip Advani is group product manager for wireless solutions at Fluke Networks.
Many customers are getting increasingly more sophisticated in their IT skills and use of technology, such as with public IP addresses, VPN support, and even higher in-bound needs. Many smaller hotspots won’t need to address these more advanced features – but in airports, conference centers and hotels, the ability to offer access to these features will be paramount to those users who need them.
Now that we have a better understanding of the consumer expectation, how can a business measure and analyze hotspots to ensure performance?
There are two parts to every Wi-Fi hotspot service. The most obvious is the Wi-Fi component – the ability to use radio frequencies to transmit packets from the client devices to the Internet. The second, and just as important, is the backhaul to the Internet.
Many of the earlier pioneers of Wi-Fi systems mistakenly thought the main goal of designing Wi-Fi was all about the RF coverage, specifically the measure of received signal strength indicator (RSSI). This measurement is usually captured in decibels compared to one thousandth of a watt (dBm). Client devices have a calibrated receive sensitivity at different data rates, and they need a certain amount of RF signal above the ambient RF noise floor in able to operate.
Though measuring the RSSI in any given target area is certainly important and necessary, simply focusing on this alone is not sufficient. In order to capture, analyze, and report the performance of any given hotspot, it’s necessary to measure the actual throughput of data, not merely the RF energy. To do this, we need tools that can consistently replicate and collect data in a known method and repeatable format.
The first way to evaluate a hotspot is to use a tool to capture active Wi-Fi signals throughout the facility’s footprint to verify adequate RF coverage and performance. Professional tools, like Fluke Networks’ AirMagnet Survey PRO, will also provide helpful, visually appealing heat maps and full reporting capabilities.
Testing and Measuring Layers 1-3: RF, 802.11, and IP Connectivity
After RF coverage has been verified, the next step is to use tools to test and measure performance of the hotspot. Visualizing this performance in a “performance weather-map” can be extremely effective (see Figure 1). Below are a few of the metrics we’ll want to look for in our performance analysis:
Figure 1: A visualization of hotspot performance in a “weather map” type of graphic
as seen on AirMagnet Survey PRO.
as seen on AirMagnet Survey PRO.
RSSI : The amount of RF energy received at any given location and time.
Noise: This can be captured with a Wi-Fi network interface controller (NIC) to show packets flowing using RF in the area, and augmented by a spectrum analyzer to see non-modulated RF from other potentially interfering devices.
Signal to noise ratio (SNR): The difference between the RSSI and the noise floor. Higher SNR values are preferred and are indicative of higher data rates. The faster each client gets on and off the wireless medium, the more clients can share the frequency in the same space without causing interference.
Data rates: The total data transfer rate the device can handle.
Throughput: Throughput is usually defined as the amount of actual data that can be transferred across the network in a given amount of time. It is the only metric that can truly represent the true end-user experience for any connection. The actual throughput will always be lower than the data rate.
802.11 association: The 802.11 association is to Wi-Fi what a ‘link light’ is to an Ethernet connection. It is the minimum requirement that shows connectivity between the device and the rest of the local area network. In Wi-Fi connections, we need the basic service set identifier (BSSID) – or the MAC address of the access point we are connected to. This BSSID will be used to help move packets to and from the wireless network.
Dynamic host configuration protocol (DHCP): In order for any device to transmit packets to the Internet, it requires IP address information for the specific subnet it is connected to. Quick, repeatable DHCP responses, with complete answers, including default gateway, domain name system (DNS), and subnet mask information is a hard requirement.
At this point we have Layer 1 – RF, Layer 2 – 802.11, and Layer 3 – IP connectivity. This is the minimum in order to connect via the hotspot to the Internet. These together mean our client device is connected to the AP as well as through the AP back to at least the DHCP server. However, it is also important to test and measure the connection from the default gateway on to the Internet itself.
Testing and Measuring Default Gateway Connectivity to the Internet
To test off-site connectivity, use two standard internetworking tools – PING and TraceRoute. These tools provide metrics for how long and for how many hops it takes to get to a site on the Internet. The lower the PING times, the quicker the access. TraceRoute will show the total number of hops via routers on the Internet from the current location, to the designated target. These two show speed and distance, but not bandwidth. For that, additional tools are required.
To test the throughput to a target on the Internet, three other tools can provide more flow testing. The first is file transfer protocol (FTP) which is used to send large chunks of data to/from an FTP server. This is tested by simulating a large file download, and it is the first way to test throughput.
The second is to test HTTP file transfers. Again, this is just a way to force a client to send large amounts of data to a server on the Internet and capture the flow statistics. Finally, test the multimedia download, such as a streaming a video or audio file. These can be implemented to simulate watching a movie via Netflix, or listening to an audio stream via Pandora.
The best approach is to have all of these throughput tests running simultaneously, putting the most load on both the wireless and wired portions of the hotspot.
The Toolset
Using a professional toolset that combines all of the features needed to analyze and evaluate a combination of wireless and wired tools can be extremely efficient. The following example gets this functionality from a software solution, AirMagnet WiFi Analyzer PRO.
We used the system’s One-Touch Connection Test feature to perform 802.11 Association, ping, trace, FTP, HTTP, and multimedia testing across multiple locations in a simultaneous manner (see Figure 2). We used the system to generate a written report for customers and staff. The tool can also automate login and testing processes.
Figure 2: An example of hot spot testing done using AirMagnet WiFi Analyzer PRO’s
One-Touch Connection Test.
One-Touch Connection Test.
Hotspots are increasingly being used throughout business to bolster connectivity with customers, partners and employees. While the technology can (and will) vary, the need to properly evaluate and troubleshoot hotspots to ensure client satisfaction will always require testing and measurement.
If you are responsible for a Wi-Fi Hotspot, you might want to make it a quarterly process to test and evaluate your hotspot to make sure you are meeting the needs of your users. This way you can adjust and adapt your network, keeping it up-to-date with current technology and expectations.
About the Author
Dilip Advani is group product manager for wireless solutions at Fluke Networks.
|
|
|
|
|
Navigate to related information
chanj
8/14/2012 12:24 PM EDT
The WAN throughput represents the utilization of the bandwidth, measuring the service quality that the ISP is providing. It varies according to the number of users and the content the users are pulling.
On the contrary, the potential bandwidth of the wireless per user varies according to the relative location of the user to the connected AP. It affects the throughput the user is getting. How can we assure the user is getting the service quality he/ she is paying for? Maybe, the data rate relative to the RSSI will give us a clue.
The article brings up a very good point. Service provider wants to know the information in different spot of the coverage. It isn't necessarily accurate. If we assume omnidirectional coverage, we will have an idea of signal strength vs distance from the AP. Smart antenna makes it complicated. Measuring quality in wide area deployment is one tough challenge. What's the best way to consistently monitor service level in a large scale deployment?
Sign in to Reply
Skip_B
8/14/2012 4:53 PM EDT
The article is accurate in that the potential bandwidth of the wireless network will vary according to the number of users and the content. The location of the user (unless they are a Hidden Note) is irrelevant. If they are associated to the AP they are taking up available BW and a "slice" of the available Data Rate. What is relevant is the potential Data Rate available to the user. This is controlled by: 1) The available DR's as determined by the AP in the Beacon and/or Probe Response frame, set in the AP config. 2) The perceived RSSI at the client device which is provided to the Client NIC Driver and then used as part of the clients DRS(Data Rate Shift)decision process (Not covered in the 802.11 standard). This information is available my consistently monitoring the WLAN 'Airspace' and can be reported on as a whole and/or by device depending on the product used for monitoring. This is because 802.11 WLAN's are half duplex and the medium is shared utilizing DCF (Distributed Coordination Function) for medium Access, part of the medium contention and collision avoidance mechanism(s) of 802.11 CSMA/CA.
With regard to Coverage Quality monitoring, your results will vary with the environment due to the irregular propagation characteristics of RF. We also cannot assume equal omni-directional coverage, because RF will not radiate equally in all directions and is also directly affected by the environmentals.
The best way to monitor WLAN Quality for SLA is to use an independent overlay system such as Fluke Networks - Airmagnet Enterprise. This product can monitor multiple sites and multiple areas, providing performance alerting and statistical monitoring along with Active Health Checking of the HotSpot environment. This provides real-time, factual and trending over time data for SLA Performance analysis with the ancillary benefit of being able to remotely troubleshoot to Root Cause any wireless issues noted.
Sign in to Reply