13. 3rd Party Libraries

13.1. Allegro Ralph

Ralph is full-featured Asset Management, DCIM and CMDB system for data center and back office.

Features:

  • keep track of assets purchases and their life cycle
  • generate flexible and accurate cost reports
  • integrate with change management process using JIRA integration

It is an Open Source project provided on Apache v2.0 License.

Live demo:

13.2. Pcapy and libpcap

13.3. Dpkt

13.4. Scanpy

13.5. Twisted

  • An extensible framework for Python programming, with special focus on event-based network programming and multiprotocol integration.

  • Twisted includes lots and lots of protocol implementations, meaning that more likely than not there will be an API you can use to talk to some remote system (either client or server in most cases) - be it:

    • HTTP
    • FTP
    • SMTP
    • POP3
    • IMAP4
    • DNS
    • IRC
    • MSN
    • OSCAR
    • XMPP/Jabber
    • telnet
    • SSH
    • SSL
    • NNTP
    • Finger
    • ident
    • lower level protocol-building-protocols like DJB’s netstrings
    • simple line-oriented protocols
    • Twisted’s custom protocols like Perspective Broker (PB) or Asynchronous Messaging Protocol (AMP).
  • none of this functionality is implemented by blocking on the network

  • https://twistedmatrix.com/trac/wiki/TwistedProjects

13.5.1. Echo Server

from twisted.internet import protocol, reactor, endpoints

class Echo(protocol.Protocol):
    def dataReceived(self, data):
        self.transport.write(data)

class EchoFactory(protocol.Factory):
    def buildProtocol(self, addr):
        return Echo()

endpoints.serverFromString(reactor, "tcp:1234").listen(EchoFactory())
reactor.run()

13.5.2. Web Server

from twisted.web import server, resource
from twisted.internet import reactor, endpoints


class Counter(resource.Resource):
    isLeaf = True
    numberRequests = 0

    def render_GET(self, request):
        self.numberRequests += 1
        request.setHeader(b"content-type", b"text/plain")
        content = f"I am request #{self.numberRequests}\n"
        return content.encode()

endpoints.serverFromString(reactor, "tcp:8080").listen(server.Site(Counter()))
reactor.run()

13.5.3. Publish/Subscribe

from twisted.internet import reactor, protocol, endpoints
from twisted.protocols import basic


class PubProtocol(basic.LineReceiver):
    def __init__(self, factory):
        self.factory = factory

    def connectionMade(self):
        self.factory.clients.add(self)

    def connectionLost(self, reason):
        self.factory.clients.remove(self)

    def lineReceived(self, line):
        for c in self.factory.clients:
            host = self.transport.getHost()
            source = f"<{host}> ".encode()
            c.sendLine(source + line)


class PubFactory(protocol.Factory):
    def __init__(self):
        self.clients = set()

    def buildProtocol(self, addr):
        return PubProtocol(self)


endpoints.serverFromString(reactor, "tcp:1025").listen(PubFactory())
reactor.run()

13.5.4. IMAP4 Client

import sys

from twisted.internet import protocol, defer, endpoints, task
from twisted.mail import imap4
from twisted.python import failure


@defer.inlineCallbacks
def main(reactor, username=b"alice", password=b"secret",
         strport="tls:example.com:993"):

    endpoint = endpoints.clientFromString(reactor, strport)
    factory = protocol.Factory.forProtocol(imap4.IMAP4Client)

    try:
        client = yield endpoint.connect(factory)
        yield client.login(username, password)
        yield client.select('INBOX')
        info = yield client.fetchEnvelope(imap4.MessageSet(1))
        print('First message subject:', info[1]['ENVELOPE'][1])
    except:
        print("IMAP4 client interaction failed")
        failure.Failure().printTraceback()

task.react(main, sys.argv[1:])

13.6. Pyro4

  • https://github.com/irmen/Pyro4
  • https://pyro4.readthedocs.io/en/stable/
  • Pyro means PYthon Remote Objects.
  • It is a library that enables you to build applications in which objects can talk to eachother over the network, with minimal programming effort.
  • You can just use normal Python method calls, with almost every possible parameter and return value type, and Pyro takes care of locating the right object on the right computer to execute the method.
  • It is designed to be very easy to use, and to generally stay out of your way.
  • But it also provides a set of powerful features that enables you to build distributed applications rapidly and effortlessly.
  • Pyro is a pure Python library and runs on many different platforms and Python versions.

13.7. Celery

13.8. RabbitMQ