SynchronizedSpider plugins use built-in connection methods along with global system configuration to change the behaviour of the connections.
The following connection types are built-in to PATHspider:
|tcp||Perform a TCP handshake|
|http||Perform an HTTP GET request|
|https||Perform an HTTP GET request using TLS|
|dnsudp||Perform a DNS query using UDP|
|dnstcp||Perform a DNS query using TCP|
To indicate the connection types that are supported by your plugin,
connect_supported metadata variable. The first type listed
in the variable will be the default connection type for the plugin.
For example, if your plugin supports all the TCP based connection types and you would like plain HTTP to be the default:
class SynchronizedSpiderPlugin(SynchronizedSpider, PluggableSpider): connect_supported = ["http", "https", "tcp", "dnstcp"]
Configuration functions are at the heart of a SynchronizedSpider plugin.
These may make calls to
iptables to make changes to the way
that traffic is generated.
One function should be written for each of the configurations and PATHspider will ensure that the configurations are set before the corresponding traffic is generated. It is the responsibility of plugin authors to ensure that any configuration is reset by the next configuration function if that is required.
By convention, functions should be prefixed with
config_ to ensure there
are no conflicts. After declaring the functions, you must then set the
configurations metadata variable with pointers to each of the configuration
The following shows the relevant portions of the ECN plugin, which uses this framework:
class ECN(SynchronizedSpider, PluggableSpider): def config_no_ecn(self): # pylint: disable=no-self-use """ Disables ECN negotiation via sysctl. """ logger = logging.getLogger('ecn') subprocess.check_call( ['/sbin/sysctl', '-w', 'net.ipv4.tcp_ecn=2'], stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL) logger.debug("Configurator disabled ECN") def config_ecn(self): # pylint: disable=no-self-use """ Enables ECN negotiation via sysctl. """ logger = logging.getLogger('ecn') subprocess.check_call( ['/sbin/sysctl', '-w', 'net.ipv4.tcp_ecn=1'], stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL) logger.debug("Configurator enabled ECN") configurations = [config_no_ecn, config_ecn]
You must have the
configurations variable after the declaration of
the functions, as otherwise you are attempting to reference functions that
have not yet been defined.