execnet: Distributed Python deployment and communication

home |  install |  examples |  basic API |  support 

Navigation

  • index
  • next |
  • previous |
  • Info in a nutshell »
  • examples

examplesΒΆ

Note: all examples with >>> prompts are automatically tested.

  • Basic local and remote communication
    • Execute source code in subprocess, communicate through a channel
    • Remote-exec a function (avoiding inlined source part I)
    • Remote-exec a module (avoiding inlined source part II)
    • Compare current working directories
    • Get information from remote SSH account
    • Use a callback instead of receive() and wait for completion
    • Sending channels over channels
    • A simple command loop pattern
    • Instantiate gateways through sockets
    • Receive file contents from remote SSH account
  • Managing multiple gateways and clusters
    • Usings Groups for managing multiple gateways
    • Assigning gateway IDs
    • Getting (auto) IDs before instantiation
    • execnet.makegateway uses execnet.default_group
    • Robust termination of SSH/popen processes
    • Using Groups to manage a certain type of gateway
  • Managing proxied gateways
    • Simple proxying
  • Advanced (multi) channel communication
    • MultiChannel: container for multiple channels
    • Receive results from sub processes with a Queue
    • Working asynchronously/event-based with channels
    • Robustly receive results and termination notification
    • Saturate multiple Hosts and CPUs with tasks to process
  • Connecting different Python interpreters
    • Dumping and loading values across interpreter versions
    • Connect to Python2/Numpy from Python3
    • Reconfiguring the string coercion between python2 and python3
    • Work with Java objects from CPython
    • Work with C# objects from CPython
  • Debugging execnet / wire messages

Previous topic

Info in a nutshell

Next topic

Basic local and remote communication

Quick search

Navigation

  • index
  • next |
  • previous |
  • Info in a nutshell »
  • examples
© Copyright 2024, holger krekel and others. Created using Sphinx 7.2.6.